00000001:02000400:3.0F:1788843265.366183:0:3286:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg333-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1788843279.801890:0:3507:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg333-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1788843281.925684:0:3567:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 747 MB/s 00000001:01000000:3.0:1788843282.175745:0:3567:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 827 MB/s 00000001:01000000:2.0:1788843282.426520:0:3567:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4426 MB/s 00000020:02000000:3.0:1788843283.095770:0:3598:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_111_g33f3974 00000400:02000000:2.0:1788843284.012186:0:3613:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.133@tcp [8/256/0/180] 00008000:02000000:1.0F:1788843287.684194:0:3763:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1788843350.904681:0:5732:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg333-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788843365.291796:0:6483:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788843365.291806:0:6483:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788843365.291808:0:6483:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788843365.294596:0:6483:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000012ebbd79 00000080:02000400:2.0:1788843365.294619:0:6483:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788843365.306329:0:6483:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788843365.306342:0:6483:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788843365.306592:0:6483:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000b64f9f15) 00000020:00000080:3.0:1788843365.306623:0:6483:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788843365.379550:0:6483:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788843365.379679:0:6483:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1788843365.437917:0:6483:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788843365.438593:0:6483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788843365.438605:0:6483:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788843365.438622:0:6483:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa762dfcbd58d0b20 00000020:01000004:3.0:1788843365.438631:0:6483:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788843365.438637:0:6483:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788843365.438643:0:6483:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000012ebbd79 from MGS 00000020:01000004:3.0:1788843365.438648:0:6483:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788843365.438662:0:6483:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000033c2240e) 00000020:00000080:3.0:1788843365.438673:0:6483:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788843365.438742:0:6483:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000012ebbd79 from MGS, refs=2 00080000:01000000:3.0:1788843365.438748:0:6483:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788843365.438753:0:6483:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa762dfcbd58d0b2e 00000100:00100000:3.0:1788843365.438906:0:6483:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788843365.439544:0:6483:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788843365.439555:0:6483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788843365.449647:0:6483:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788843365.449665:0:6483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788843365.459666:0:6483:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788843365.460703:0:6483:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788843365.460712:0:6483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788843365.463648:0:6483:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788843365.463664:0:6483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788843365.465014:0:6483:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788843365.465035:0:6483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788843365.471796:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843365.471806:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843365.471809:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843365.477603:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843365.477612:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843365.477615:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843365.479091:0:6483:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788843365.485565:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1788843365.728278:0:6483:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2807 MB/s 00000001:01000000:2.0:1788843365.980525:0:6483:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3476 MB/s 00000001:01000000:2.0:1788843366.236382:0:6483:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 527 MB/s 00000001:01000000:2.0:1788843366.486566:0:6483:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 715 MB/s 00010000:00010000:1.0:1788843366.493117:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1788843366.496639:0:6483:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:2.0:1788843366.510088:0:6483:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788843366.511247:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788843366.511304:0:6483:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788843366.511360:0:6483:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788843366.511560:0:6483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788843366.511582:0:6483:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788843366.512030:0:6483:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788843366.515478:0:6483:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788843366.515499:0:6483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788843366.521104:0:6483:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788843366.521123:0:6483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788843366.521989:0:6483:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788843366.522000:0:6483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:2.0:1788843366.522831:0:6502:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1788843366.522908:0:6483:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788843366.522935:0:6483:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.133@tcp' 00000020:01000004:3.0:1788843366.522938:0:6483:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788843366.523505:0:6483:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.133@tcp (typ=mgc) 00000020:00000080:3.0:1788843366.523524:0:6483:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.133@tcp (0000000072f55555) 00000020:00000080:3.0:1788843366.523552:0:6483:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788843366.523676:0:6483:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000051cdc00b@MGC192.168.203.133@tcp: add connection 192.168.203.133@tcp at head 00010000:00010000:3.0:1788843366.523862:0:6483:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.133@tcp-0 is initialized 00000040:01000000:3.0:1788843366.523870:0:6483:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.133@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788843366.534754:0:6503:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788843366.534901:0:6483:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.133@tcp (uuid e79d9884-ba2e-42e7-accb-b4784b9c1837) 00000020:00000080:2.0:1788843366.534940:0:6483:0:(genops.c:1385:class_connect()) connect: client e79d9884-ba2e-42e7-accb-b4784b9c1837, cookie 0xa762dfcbd58d0b3c 00000100:00080000:2.0:1788843366.534958:0:6483:0:(import.c:510:import_select_connection()) MGC192.168.203.133@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788843366.534966:0:6483:0:(import.c:624:import_select_connection()) MGC192.168.203.133@tcp: import 0000000051cdc00b using connection 192.168.203.133@tcp/0@lo 00000100:00100000:2.0:1788843366.535043:0:6483:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f2e6a58b x1875738134315136/t0(0) o250->MGC192.168.203.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788843366.535082:0:6483:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import e79d9884-ba2e-42e7-accb-b4784b9c1837->MGS 00000020:01000004:2.0:1788843366.535112:0:6483:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788843366.535119:0:6483:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788843366.535184:0:6483:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000075119501) 00000020:00000080:2.0:1788843366.535210:0:6483:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788843366.542305:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f2e6a58b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e79d9884-ba2e-42e7-accb-b4784b9c1837:3629:1875738134315136:0@lo:250: 00000100:00100000:3.0:1788843366.542440:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843366.542551:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134315136 00000100:00100000:3.0:1788843366.542563:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134315136 00000100:00100000:3.0:1788843366.542617:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788843366.542624:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075a77ba9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3629:x1875738134315136:12345-0@lo:250: 00010000:00080000:3.0:1788843366.542657:0:6498:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e79d9884-ba2e-42e7-accb-b4784b9c1837@0@lo t0 exp 0000000000000000 cur 144 last 0 00000020:00000080:3.0:1788843366.542693:0:6498:0:(genops.c:1385:class_connect()) connect: client e79d9884-ba2e-42e7-accb-b4784b9c1837, cookie 0xa762dfcbd58d0b4a 00000100:00080000:3.0:1788843366.542888:0:6498:0:(import.c:65:import_set_state_nolock()) 000000001482c706 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788843366.542952:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075a77ba9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+5:3629:x1875738134315136:12345-0@lo:250: Request processed in 326us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843366.542960:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788843366.543012:0:3629:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.133@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788843366.543023:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.133@tcp: connect to target with instance 0 00000100:00080000:3.0:1788843366.543032:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.133@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788843366.543037:0:3629:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788843366.543039:0:3629:0:(import.c:65:import_set_state_nolock()) 0000000051cdc00b MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788843366.543050:0:3629:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788843366.543060:0:3629:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788843366.543066:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f2e6a58b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e79d9884-ba2e-42e7-accb-b4784b9c1837:3629:1875738134315136:0@lo:250: 00000100:00100000:3.0:1788843366.573038:0:6483:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788843366.573658:0:6483:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788843366.573666:0:6483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788843366.577265:0:6483:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788843366.577286:0:6483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788843366.577802:0:6483:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788843366.577811:0:6483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788843366.579526:0:6483:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788843366.579783:0:6483:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788843366.579790:0:6483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788843366.581127:0:6483:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788843366.581173:0:6483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788843366.667518:0:6483:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788843366.667821:0:6483:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788843366.667829:0:6483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788843366.674175:0:6483:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788843366.674191:0:6483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788843366.674935:0:6483:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788843366.676234:0:6483:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788843366.676245:0:6483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788843366.677795:0:6483:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788843366.677806:0:6483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788843366.678492:0:6483:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788843366.678698:0:6483:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788843366.678702:0:6483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788843366.679218:0:6483:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788843366.679225:0:6483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788843366.679728:0:6483:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788843366.679897:0:6483:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788843366.679901:0:6483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788843366.684775:0:6483:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788843366.684789:0:6483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788843366.730655:0:6483:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788843366.737663:0:6483:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788843366.737673:0:6483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788843366.738832:0:6483:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788843366.738842:0:6483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788843366.742039:0:6483:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788843366.742060:0:6483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788843366.742931:0:6483:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788843366.742958:0:6483:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788843366.742964:0:6483:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.133@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788843366.743068:0:6483:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.133@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788843366.743100:0:6483:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.133@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1788843366.743104:0:6483:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788843366.743106:0:6483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788843366.743107:0:6483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788843366.743109:0:6483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788843366.743110:0:6483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788843366.743111:0:6483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788843366.743112:0:6483:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788843366.743113:0:6483:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788843366.743115:0:6483:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788843366.743116:0:6483:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788843366.743117:0:6483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788843366.743118:0:6483:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788843366.743120:0:6483:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1788843366.743122:0:6483:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788843366.743123:0:6483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788843366.743124:0:6483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788843366.743125:0:6483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788843366.743126:0:6483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788843366.743127:0:6483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788843366.743127:0:6483:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788843366.743131:0:6483:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788843366.743132:0:6483:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788843366.743133:0:6483:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788843366.743134:0:6483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788843366.743134:0:6483:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788843366.743196:0:6483:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788843366.743211:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008e8a400b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:6483:1875738134315264:0@lo:253: 00000100:00100000:1.0:1788843366.743277:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843366.743328:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set 0000000032f95e96 going to sleep for 11 seconds 00000100:00100000:3.0:1788843366.743385:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134315264 00000100:00100000:3.0:1788843366.743393:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134315264 00000100:00100000:3.0:1788843366.743426:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788843366.743433:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e92b502 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+5:6483:x1875738134315264:12345-0@lo:253: 20000000:01000000:3.0:1788843366.743474:0:6501:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788843366.743477:0:6501:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788843366.743710:0:6522:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788843366.743748:0:6501:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1788843366.744052:0:6501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788843366.744994:0:6523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1788843366.745287:0:6501:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788843366.745291:0:6501:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1788843366.745297:0:6501:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1788843366.745300:0:6501:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1788843366.745308:0:6501:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1788843366.745425:0:6501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788843366.745590:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1788843366.745602:0:6501:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788843366.745627:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1788843366.745642:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1788843366.745654:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1788843366.745697:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1788843366.745703:0:6501:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1788843366.745714:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1788843366.745718:0:6501:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1788843366.745728:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1788843366.745732:0:6501:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1788843366.745741:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1788843366.745753:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1788843366.745784:0:6501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788843366.745789:0:6501:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1788843366.745796:0:6501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788843366.745887:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1788843366.745897:0:6501:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788843366.745923:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1788843366.745937:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1788843366.745950:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1788843366.745959:0:6501:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1788843366.745982:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1788843366.745990:0:6501:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788843366.746000:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1788843366.746012:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1788843366.746025:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1788843366.746032:0:6501:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1788843366.746053:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1788843366.746059:0:6501:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1788843366.746070:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1788843366.746083:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1788843366.746125:0:6501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1788843366.746175:0:6501:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788843366.746181:0:6501:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1788843366.748209:0:6524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788843366.748494:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788843366.748524:0:6501:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.133@tcp for mdt 20000000:01000000:3.0:1788843366.748526:0:6501:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.133@tcp (null) (null) (null) 00000040:00080000:3.0:1788843366.748543:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788843366.748551:0:6501:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788843366.748582:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788843366.748588:0:6501:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.133@tcp (null) (null) 00000040:00080000:3.0:1788843366.748602:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788843366.748611:0:6501:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788843366.748638:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788843366.748657:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788843366.748688:0:6501:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788843366.748691:0:6501:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788843366.748695:0:6501:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788843366.748780:0:6501:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788843366.748783:0:6501:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788843366.757194:0:6525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1788843366.757727:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788843366.757761:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1788843366.757789:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:3.0:1788843366.757803:0:6501:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788843366.757806:0:6501:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788843366.758796:0:6526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1788843366.759882:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1788843366.759914:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1788843366.759931:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1788843366.759944:0:6501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788843366.759946:0:6501:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1788843366.759952:0:6501:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788843366.759954:0:6501:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788843366.759959:0:6501:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788843366.759965:0:6501:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788843366.760830:0:6527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1788843366.761042:0:6501:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1788843366.778619:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1788843366.778674:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1788843366.778830:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1788843366.778852:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788843366.778876:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e28d712a/0xa762dfcbd58d0b51 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843366.778893:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e28d712a/0xa762dfcbd58d0b51 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843366.778904:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e28d712a/0xa762dfcbd58d0b51 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843366.778909:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e28d712a/0xa762dfcbd58d0b51 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843366.778915:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e28d712a/0xa762dfcbd58d0b51 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843366.778945:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e28d712a/0xa762dfcbd58d0b51 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843366.778951:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e28d712a already unused, calling callback (00000000f1e7cbc1) 00010000:00010000:2.0:1788843366.778954:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e28d712a/0xa762dfcbd58d0b51 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843366.778962:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e28d712a/0xa762dfcbd58d0b51 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843366.778975:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e28d712a/0xa762dfcbd58d0b51 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843366.778982:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e28d712a/0xa762dfcbd58d0b51 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843366.778987:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e28d712a/0xa762dfcbd58d0b51 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788843366.779006:0:6501:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788843366.793242:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e92b502 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+5:6483:x1875738134315264:12345-0@lo:253: Request processed in 49795us (49951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843366.793262:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788843366.793309:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008e8a400b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:6483:1875738134315264:0@lo:253: 10000000:01000000:1.0:1788843366.793333:0:6483:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788843366.793336:0:6483:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788843366.793339:0:6483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788843366.793341:0:6483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788843366.793343:0:6483:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1788843366.793345:0:6483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788843366.793348:0:6483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788843366.793349:0:6483:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788843366.793351:0:6483:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788843366.793352:0:6483:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788843366.793353:0:6483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788843366.793354:0:6483:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788843366.793374:0:6483:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000012ebbd79 from lustre-MDT0000 10000000:01000000:1.0:1788843366.793404:0:6483:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788843366.793406:0:6483:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788843366.793411:0:6483:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9bd13339b370 10000000:01000000:1.0:1788843366.793414:0:6483:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788843366.793422:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9bd13339b370 from 1 10000000:01000000:1.0:1788843366.793425:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788843366.793467:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: 00000000239018ee/0xa762dfcbd58d0b58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843366.793477:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: 00000000239018ee/0xa762dfcbd58d0b58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843366.793485:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: 00000000239018ee/0xa762dfcbd58d0b58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843366.793500:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008e8a400b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:6483:1875738134315392:0@lo:101: 00000100:00100000:1.0:1788843366.793554:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843366.793679:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134315392 00000100:00100000:3.0:1788843366.793690:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134315392 00000100:00100000:3.0:1788843366.793734:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788843366.793743:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000568cbfc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+5:6483:x1875738134315392:12345-0@lo:101: 00010000:00010000:3.0:1788843366.793761:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843366.793795:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000264e066/0xa762dfcbd58d0b5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0b58 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843366.793803:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f9900241 going to sleep for 11 seconds 00010000:00010000:3.0:1788843366.793827:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000264e066/0xa762dfcbd58d0b5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0b58 expref: 6 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843366.793877:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000264e066/0xa762dfcbd58d0b5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0b58 expref: 6 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843366.793888:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000264e066, rc 0) 00000100:00100000:2.0:1788843366.793998:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000568cbfc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+6:6483:x1875738134315392:12345-0@lo:101: Request processed in 254us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843366.794008:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788843366.797126:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008e8a400b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:6483:1875738134315392:0@lo:101: 00010000:00010000:3.0:1788843366.797189:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: 00000000239018ee/0xa762dfcbd58d0b58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0b5f expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843366.797205:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: 00000000239018ee/0xa762dfcbd58d0b58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0b5f expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843366.797350:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e40f5f79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:6483:1875738134315520:0@lo:501: 00000100:00100000:3.0:1788843366.797430:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843366.797502:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set 00000000baeb5950 going to sleep for 11 seconds 00000100:00100000:2.0:1788843366.797591:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134315520 00000100:00100000:2.0:1788843366.797606:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134315520 00000100:00100000:2.0:1788843366.797669:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788843366.797678:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c69962e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+6:6483:x1875738134315520:12345-0@lo:501: 00000100:00100000:2.0:1788843366.797816:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c69962e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+6:6483:x1875738134315520:12345-0@lo:501: Request processed in 139us (387us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788843366.797841:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788843366.797956:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e40f5f79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:6483:1875738134315520:0@lo:501: 10000000:01000000:3.0:1788843366.798008:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788843366.798090:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: 00000000239018ee/0xa762dfcbd58d0b58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0b5f expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843366.798101:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: 00000000239018ee/0xa762dfcbd58d0b58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0b5f expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843366.798120:0:6483:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bd118db4800 10000000:01000000:3.0:1788843366.798126:0:6483:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788843366.798131:0:6483:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9bd118db4800 10000000:01000000:3.0:1788843366.798134:0:6483:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788843366.798138:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9bd118db4800 from 1 10000000:01000000:3.0:1788843366.798176:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788843366.798209:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: 00000000feef1e72/0xa762dfcbd58d0b66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843366.798217:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: 00000000feef1e72/0xa762dfcbd58d0b66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843366.798226:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: 00000000feef1e72/0xa762dfcbd58d0b66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843366.798238:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e40f5f79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:6483:1875738134315648:0@lo:101: 00000100:00100000:3.0:1788843366.798281:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843366.798317:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set 00000000baeb5950 going to sleep for 11 seconds 00000100:00100000:1.0:1788843366.798339:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134315648 00000100:00100000:1.0:1788843366.798352:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134315648 00000100:00100000:1.0:1788843366.798394:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788843366.798400:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006648beb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+6:6483:x1875738134315648:12345-0@lo:101: 00010000:00010000:1.0:1788843366.798410:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843366.798427:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f43cff97/0xa762dfcbd58d0b6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0b66 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843366.798458:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f43cff97/0xa762dfcbd58d0b6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0b66 expref: 7 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843366.798468:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f43cff97/0xa762dfcbd58d0b6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0b66 expref: 7 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843366.798477:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f43cff97, rc 0) 00000100:00100000:1.0:1788843366.798528:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006648beb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+7:6483:x1875738134315648:12345-0@lo:101: Request processed in 128us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843366.798534:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788843366.799614:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e40f5f79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:6483:1875738134315648:0@lo:101: 00010000:00010000:3.0:1788843366.799640:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: 00000000feef1e72/0xa762dfcbd58d0b66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0b6d expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843366.799651:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: 00000000feef1e72/0xa762dfcbd58d0b66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0b6d expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843366.799677:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788843366.804725:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: 00000000feef1e72/0xa762dfcbd58d0b66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0b6d expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843366.804749:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: 00000000feef1e72/0xa762dfcbd58d0b66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0b6d expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843366.804759:0:6483:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788843366.804870:0:6483:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788843366.804896:0:6483:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9bd118db4800 10000000:01000000:2.0:1788843366.804900:0:6483:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788843366.804904:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788843366.804907:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788843366.804954:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: 00000000e28d712a/0xa762dfcbd58d0b74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843366.804967:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: 00000000e28d712a/0xa762dfcbd58d0b74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843366.804976:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: 00000000e28d712a/0xa762dfcbd58d0b74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843366.804998:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000070a1f7cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:6483:1875738134315776:0@lo:101: 00000100:00100000:2.0:1788843366.805069:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843366.805224:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set 000000009a951efe going to sleep for 11 seconds 00000100:00100000:1.0:1788843366.806033:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134315776 00000100:00100000:1.0:1788843366.806044:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134315776 00000100:00100000:1.0:1788843366.806107:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788843366.806116:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f209e01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+7:6483:x1875738134315776:12345-0@lo:101: 00010000:00010000:1.0:1788843366.806130:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843366.806263:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000092bcb600/0xa762dfcbd58d0b7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0b74 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843366.806292:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000092bcb600/0xa762dfcbd58d0b7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0b74 expref: 8 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843366.806302:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000092bcb600/0xa762dfcbd58d0b7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0b74 expref: 8 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843366.806331:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000092bcb600, rc 0) 00000100:00100000:1.0:1788843366.806546:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f209e01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+8:6483:x1875738134315776:12345-0@lo:101: Request processed in 430us (1476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843366.806553:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788843366.812578:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000070a1f7cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:6483:1875738134315776:0@lo:101: 00010000:00010000:2.0:1788843366.812607:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: 00000000e28d712a/0xa762dfcbd58d0b74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0b7b expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843366.812620:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: 00000000e28d712a/0xa762dfcbd58d0b74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0b7b expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843366.813217:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000070a1f7cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:6483:1875738134315904:0@lo:501: 00000100:00100000:2.0:1788843366.813292:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843366.813356:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set 000000009a951efe going to sleep for 11 seconds 00000100:00100000:3.0:1788843366.813457:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134315904 00000100:00100000:3.0:1788843366.813464:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134315904 00000100:00100000:3.0:1788843366.813517:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788843366.813524:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ceff1e42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+8:6483:x1875738134315904:12345-0@lo:501: 00000100:00100000:3.0:1788843366.813654:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ceff1e42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+9:6483:x1875738134315904:12345-0@lo:501: Request processed in 130us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843366.813661:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788843366.813841:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000070a1f7cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:6483:1875738134315904:0@lo:501: 00000100:00100000:1.0:1788843366.813876:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a8f1376 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:6483:1875738134316032:0@lo:503: 00000100:00100000:1.0:1788843366.813925:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843366.813937:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f6ab5f1c going to sleep for 11 seconds 00000100:00100000:0.0:1788843366.814061:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134316032 00000100:00100000:0.0:1788843366.814065:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134316032 00000100:00100000:0.0:1788843366.814101:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788843366.814106:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003141d8c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+9:6483:x1875738134316032:12345-0@lo:503: 00000100:00100000:0.0:1788843366.814201:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003141d8c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+9:6483:x1875738134316032:12345-0@lo:503: Request processed in 95us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843366.814207:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788843366.814276:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a8f1376 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:6483:1875738134316032:0@lo:503: 00000100:00100000:1.0:1788843366.814672:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a8f1376 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:6528:1875738134316160:0@lo:502: 00000100:00100000:1.0:1788843366.814710:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843366.814740:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ecc6221b going to sleep for 11 seconds 00000100:00100000:2.0:1788843366.814793:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134316160 00000100:00100000:2.0:1788843366.814797:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134316160 00000100:00100000:2.0:1788843366.814825:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788843366.814831:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d81191e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+9:6528:x1875738134316160:12345-0@lo:502: 00000100:00100000:2.0:1788843366.814925:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d81191e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+9:6528:x1875738134316160:12345-0@lo:502: Request processed in 94us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843366.814932:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788843366.815096:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a8f1376 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:6528:1875738134316160:0@lo:502: 00000020:01000000:1.0:1788843366.815116:0:6528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843366.815126:0:6528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843366.815128:0:6528:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788843366.815133:0:6528:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788843366.815135:0:6528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788843366.815183:0:6528:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000001f2c10cd) 00000020:00000080:1.0:1788843366.815198:0:6528:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788843366.815203:0:6528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788843366.815372:0:6528:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788843366.815379:0:6528:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa762dfcbd58d0b89 00000020:00000080:1.0:1788843366.815614:0:6528:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788843366.815618:0:6528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843366.815625:0:6528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843366.815627:0:6528:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788843366.815629:0:6528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843366.815632:0:6528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843366.815633:0:6528:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788843366.815637:0:6528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788843366.815642:0:6528:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000a64aa807) 00000020:00000080:1.0:1788843366.815652:0:6528:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788843366.815655:0:6528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788843366.815657:0:6528:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788843366.815659:0:6528:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788843366.815664:0:6528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788843366.815711:0:6528:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000012ebbd79 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788843366.815722:0:6528:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000043dee3e4) 00000020:00000080:1.0:1788843366.815728:0:6528:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788843366.815783:0:6528:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788843366.815787:0:6528:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa762dfcbd58d0b9e 00000020:00000080:1.0:1788843366.815876:0:6528:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788843366.815882:0:6528:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788843366.815885:0:6528:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa762dfcbd58d0ba5 00080000:01000000:1.0:1788843366.815889:0:6528:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788843366.815893:0:6528:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa762dfcbd58d0bac 00080000:10000000:1.0:1788843366.816301:0:6528:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1788843366.816412:0:6528:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1788843366.820301:0:6528:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788843366.906969:0:6528:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788843366.907496:0:6528:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788843366.911710:0:6528:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788843366.912399:0:6528:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788843366.916665:0:6528:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000061ca9e3d) 00000020:00000080:2.0:1788843366.916698:0:6528:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788843366.916807:0:6528:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788843366.916816:0:6528:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa762dfcbd58d0bba 00000020:00000080:2.0:1788843366.930927:0:6528:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788843366.932593:0:6528:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1788843366.939850:0:6528:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1788843366.945777:0:6528:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1788843366.949581:0:6528:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1788843366.959084:0:6528:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1788843366.964044:0:6528:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1788843366.970971:0:6528:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa762dfcbd58d0bc1 00000020:00000080:3.0:1788843366.971354:0:6528:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788843366.971366:0:6528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843366.971372:0:6528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843366.971374:0:6528:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788843366.971382:0:6528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788843366.971386:0:6528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843366.971387:0:6528:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788843366.971390:0:6528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788843366.971392:0:6528:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788843366.971394:0:6528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843366.971396:0:6528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843366.971397:0:6528:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788843366.971399:0:6528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788843366.971404:0:6528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843366.971405:0:6528:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788843366.971409:0:6528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788843366.971630:0:6528:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1788843366.971684:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e40f5f79 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:6528:1875738134316288:0@lo:502: 00000100:00100000:3.0:1788843366.971775:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843366.971883:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c47e23b7 going to sleep for 11 seconds 00000100:00100000:2.0:1788843366.971978:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134316288 00000100:00100000:2.0:1788843366.971986:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134316288 00000100:00100000:2.0:1788843366.972066:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788843366.972074:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000216d3a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+9:6528:x1875738134316288:12345-0@lo:502: 00000100:00100000:2.0:1788843366.972224:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000216d3a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+9:6528:x1875738134316288:12345-0@lo:502: Request processed in 150us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843366.972232:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788843366.972359:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e40f5f79 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:6528:1875738134316288:0@lo:502: 00000020:01000000:3.0:1788843366.972385:0:6528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843366.972391:0:6528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843366.972393:0:6528:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1788843366.972395:0:6528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1788843366.972548:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1788843366.972572:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788843366.972594:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: 00000000e28d712a/0xa762dfcbd58d0b74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0b7b expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843366.972605:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: 00000000e28d712a/0xa762dfcbd58d0b74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0b7b expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843366.972623:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd118db4800 from 1 10000000:01000000:1.0:1788843366.972626:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788843366.972650:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: 00000000685f98e5/0xa762dfcbd58d0bc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843366.972657:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: 00000000685f98e5/0xa762dfcbd58d0bc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843366.972665:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: 00000000685f98e5/0xa762dfcbd58d0bc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843366.972679:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a8f1376 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:6483:1875738134316416:0@lo:101: 00000100:00100000:1.0:1788843366.972711:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843366.973021:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set 000000008414560b going to sleep for 11 seconds 00000100:00100000:0.0:1788843366.973094:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134316416 00000100:00100000:0.0:1788843366.973101:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134316416 00000100:00100000:0.0:1788843366.973129:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788843366.973136:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7681e0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+9:6483:x1875738134316416:12345-0@lo:101: 00010000:00010000:0.0:1788843366.973158:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843366.973173:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000082ca18a7/0xa762dfcbd58d0bcf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0bc8 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843366.973195:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000082ca18a7/0xa762dfcbd58d0bcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0bc8 expref: 10 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843366.973215:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000082ca18a7/0xa762dfcbd58d0bcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0bc8 expref: 10 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843366.973223:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000082ca18a7, rc 0) 00000100:00100000:0.0:1788843366.973271:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7681e0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+10:6483:x1875738134316416:12345-0@lo:101: Request processed in 136us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843366.973277:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788843366.973398:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a8f1376 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:6483:1875738134316416:0@lo:101: 00010000:00010000:1.0:1788843366.973410:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: 00000000685f98e5/0xa762dfcbd58d0bc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0bcf expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843366.973419:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: 00000000685f98e5/0xa762dfcbd58d0bc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0bcf expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843366.973975:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a8f1376 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:6483:1875738134316544:0@lo:256: 00000100:00100000:1.0:1788843366.974023:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843366.974058:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set 000000008414560b going to sleep for 11 seconds 00000100:00100000:0.0:1788843366.974197:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134316544 00000100:00100000:0.0:1788843366.974204:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134316544 00000100:00100000:0.0:1788843366.974242:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788843366.974248:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7286f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+10:6483:x1875738134316544:12345-0@lo:256: 20000000:01000000:0.0:1788843366.974265:0:6500:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788843366.974271:0:6500:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788843366.974372:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7286f7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+10:6483:x1875738134316544:12345-0@lo:256: Request processed in 123us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843366.974379:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788843366.974562:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a8f1376 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:6483:1875738134316544:0@lo:256: 10000000:01000000:1.0:1788843366.975104:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788843366.975132:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: 00000000685f98e5/0xa762dfcbd58d0bc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0bcf expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843366.975184:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: 00000000685f98e5/0xa762dfcbd58d0bc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0bcf expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843366.975192:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd118db4800 from 1 10000000:01000000:1.0:1788843366.975195:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788843366.975405:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: 000000002596e231/0xa762dfcbd58d0bd6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843366.975413:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: 000000002596e231/0xa762dfcbd58d0bd6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843366.975421:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: 000000002596e231/0xa762dfcbd58d0bd6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843366.975444:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a8f1376 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:6483:1875738134316672:0@lo:101: 00000100:00100000:1.0:1788843366.975487:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843366.975516:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set 000000008414560b going to sleep for 11 seconds 00000100:00100000:0.0:1788843366.975625:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134316672 00000100:00100000:0.0:1788843366.975631:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134316672 00000100:00100000:0.0:1788843366.975659:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788843366.975665:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000072a302f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+10:6483:x1875738134316672:12345-0@lo:101: 00010000:00010000:0.0:1788843366.975676:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843366.975688:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000000507c68/0xa762dfcbd58d0bdd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0bd6 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843366.975707:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000000507c68/0xa762dfcbd58d0bdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0bd6 expref: 11 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843366.975717:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000000507c68/0xa762dfcbd58d0bdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0bd6 expref: 11 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843366.975724:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000000507c68, rc 0) 00000100:00100000:0.0:1788843366.975774:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000072a302f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+11:6483:x1875738134316672:12345-0@lo:101: Request processed in 101us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843366.975791:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788843366.975940:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a8f1376 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:6483:1875738134316672:0@lo:101: 00010000:00010000:1.0:1788843366.975951:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: 000000002596e231/0xa762dfcbd58d0bd6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0bdd expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843366.975959:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: 000000002596e231/0xa762dfcbd58d0bd6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0bdd expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843366.976014:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a8f1376 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:6483:1875738134316800:0@lo:501: 00000100:00100000:1.0:1788843366.976039:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843366.976060:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set 000000008414560b going to sleep for 11 seconds 00000100:00100000:0.0:1788843366.976116:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134316800 00000100:00100000:0.0:1788843366.976121:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134316800 00000100:00100000:0.0:1788843366.976164:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788843366.976171:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6809a0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+11:6483:x1875738134316800:12345-0@lo:501: 00000100:00100000:0.0:1788843366.976342:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6809a0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+11:6483:x1875738134316800:12345-0@lo:501: Request processed in 172us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843366.976349:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788843366.976588:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a8f1376 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:6483:1875738134316800:0@lo:501: 00000100:00100000:1.0:1788843366.976617:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a8f1376 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:6483:1875738134316928:0@lo:503: 00000100:00100000:1.0:1788843366.976658:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843366.976682:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set 000000008414560b going to sleep for 11 seconds 00000100:00100000:0.0:1788843366.976725:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134316928 00000100:00100000:0.0:1788843366.976730:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134316928 00000100:00100000:0.0:1788843366.976758:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788843366.976773:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001bc052e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+11:6483:x1875738134316928:12345-0@lo:503: 00000040:00080000:0.0:1788843366.976804:0:6500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788843366.976924:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001bc052e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+11:6483:x1875738134316928:12345-0@lo:503: Request processed in 161us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843366.976931:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788843366.977082:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a8f1376 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:6483:1875738134316928:0@lo:503: 00000040:00080000:3.0:1788843366.978123:0:6532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788843366.978543:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788843366.978570:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788843366.978624:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: 000000002596e231/0xa762dfcbd58d0bd6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0bdd expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843366.978635:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: 000000002596e231/0xa762dfcbd58d0bd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0bdd expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843366.978680:0:6483:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788843366.978683:0:6483:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bd118db4800 10000000:01000000:1.0:1788843366.978686:0:6483:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bd118db4800 10000000:01000000:1.0:1788843366.978689:0:6483:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788843366.978695:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd118db4800 from 1 10000000:01000000:1.0:1788843366.978698:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788843366.978730:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: 0000000027231346/0xa762dfcbd58d0be4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843366.978737:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: 0000000027231346/0xa762dfcbd58d0be4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843366.978746:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: 0000000027231346/0xa762dfcbd58d0be4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843366.978774:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a8f1376 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:6483:1875738134317056:0@lo:101: 00000100:00100000:1.0:1788843366.978847:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843366.978888:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set 000000008414560b going to sleep for 11 seconds 00000100:00100000:2.0:1788843366.978960:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134317056 00000100:00100000:2.0:1788843366.978968:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134317056 00000100:00100000:2.0:1788843366.979013:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788843366.979021:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000253df8a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+11:6483:x1875738134317056:12345-0@lo:101: 00010000:00010000:2.0:1788843366.979041:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843366.979055:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000064774e0e/0xa762dfcbd58d0beb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0be4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843366.979078:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000064774e0e/0xa762dfcbd58d0beb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0be4 expref: 12 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843366.979089:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000064774e0e/0xa762dfcbd58d0beb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0be4 expref: 12 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843366.979096:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000064774e0e, rc 0) 00000100:00100000:2.0:1788843366.979161:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000253df8a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+12:6483:x1875738134317056:12345-0@lo:101: Request processed in 141us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843366.979167:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788843366.979373:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a8f1376 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:6483:1875738134317056:0@lo:101: 00010000:00010000:3.0:1788843366.979387:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: 0000000027231346/0xa762dfcbd58d0be4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0beb expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843366.979395:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: 0000000027231346/0xa762dfcbd58d0be4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0beb expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843366.979511:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e40f5f79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:6483:1875738134317184:0@lo:501: 00000100:00100000:3.0:1788843366.979541:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843366.979567:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set 000000006cc3e4dc going to sleep for 11 seconds 00000100:00100000:2.0:1788843366.979643:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134317184 00000100:00100000:2.0:1788843366.979647:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134317184 00000100:00100000:2.0:1788843366.979675:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788843366.979681:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000061ab30eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+12:6483:x1875738134317184:12345-0@lo:501: 00000100:00100000:2.0:1788843366.979808:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000061ab30eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+12:6483:x1875738134317184:12345-0@lo:501: Request processed in 128us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843366.979816:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788843366.979912:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e40f5f79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:6483:1875738134317184:0@lo:501: 00000100:00100000:3.0:1788843366.979938:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e40f5f79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:6483:1875738134317312:0@lo:503: 00000100:00100000:3.0:1788843366.979976:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843366.979997:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set 000000006cc3e4dc going to sleep for 11 seconds 00000100:00100000:1.0:1788843366.980040:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134317312 00000100:00100000:1.0:1788843366.980045:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134317312 00000100:00100000:1.0:1788843366.980074:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788843366.980080:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b26bdc54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+12:6483:x1875738134317312:12345-0@lo:503: 00000100:00100000:1.0:1788843366.980196:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b26bdc54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+12:6483:x1875738134317312:12345-0@lo:503: Request processed in 116us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843366.980202:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788843366.980386:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e40f5f79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:6483:1875738134317312:0@lo:503: 00000100:00100000:2.0:1788843366.981387:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003fa75b5f pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:6533:1875738134317440:0@lo:502: 00000100:00100000:2.0:1788843366.981631:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843366.981665:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set 000000006955d203 going to sleep for 11 seconds 00000100:00100000:1.0:1788843366.981757:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134317440 00000100:00100000:1.0:1788843366.981776:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134317440 00000100:00100000:1.0:1788843366.981851:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788843366.981860:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003d159b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+12:6533:x1875738134317440:12345-0@lo:502: 00000100:00100000:1.0:1788843366.982012:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003d159b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+12:6533:x1875738134317440:12345-0@lo:502: Request processed in 153us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843366.982020:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788843366.982092:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003fa75b5f pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:6533:1875738134317440:0@lo:502: 00000020:01000004:2.0:1788843366.982311:0:6533:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788843366.982327:0:6533:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000d2b5ad3b) 00000020:00000080:2.0:1788843366.982355:0:6533:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1788843366.982579:0:6533:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000012ebbd79 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788843366.982583:0:6533:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000012ebbd79 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788843366.982586:0:6533:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000012ebbd79 4 00010000:00080000:2.0:1788843366.982621:0:6533:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000094173a70@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.133@tcp at head 00010000:00010000:2.0:1788843366.985991:0:6533:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1788843366.988762:0:6533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788843366.988824:0:6533:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788843366.988839:0:6533:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa762dfcbd58d0bf9 00000100:00080000:2.0:1788843366.988854:0:6533:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788843366.988860:0:6533:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000094173a70 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:2.0:1788843366.988897:0:6533:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003fa75b5f x1875738134317568/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788843366.988926:0:6533:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788843366.989118:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b39d899b pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:6533:1875738134317696:0@lo:502: 00000100:00100000:2.0:1788843366.989225:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843366.989262:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134317696 00000100:00100000:2.0:1788843366.989269:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134317696 00000100:00100000:2.0:1788843366.989305:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788843366.989313:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089d479c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+12:6533:x1875738134317696:12345-0@lo:502: 00000100:00100000:2.0:1788843366.989615:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089d479c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+12:6533:x1875738134317696:12345-0@lo:502: Request processed in 302us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843366.989623:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788843366.989684:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set 000000009a951efe going to sleep for 11 seconds 00000100:00100000:2.0:1788843366.989705:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b39d899b pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:6533:1875738134317696:0@lo:502: 00000040:00080000:2.0:1788843366.989732:0:6533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:3.0:1788843366.990082:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003fa75b5f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875738134317568:0@lo:38: 00000100:00100000:3.0:1788843366.990123:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1788843366.990187:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1788843366.990214:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788843366.990228:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: 0000000027231346/0xa762dfcbd58d0be4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0beb expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843366.990247:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: 0000000027231346/0xa762dfcbd58d0be4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0beb expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788843366.990298:0:6483:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788843366.990300:0:6483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788843366.990301:0:6483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788843366.990302:0:6483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788843366.990303:0:6483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788843366.990305:0:6483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788843366.990306:0:6483:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788843366.990307:0:6483:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788843366.990308:0:6483:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788843366.990310:0:6483:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788843366.990311:0:6483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788843366.990312:0:6483:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788843366.990315:0:6483:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1788843366.990317:0:6483:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788843366.990319:0:6483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788843366.990320:0:6483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788843366.990321:0:6483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788843366.990322:0:6483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788843366.990323:0:6483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788843366.990324:0:6483:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788843366.990325:0:6483:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788843366.990326:0:6483:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788843366.990326:0:6483:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788843366.990327:0:6483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788843366.990328:0:6483:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788843366.990342:0:6483:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788843366.990351:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000980697d pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:6483:1875738134317824:0@lo:253: 00000100:00100000:3.0:1788843366.990382:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843366.990653:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134317568 00000100:00100000:2.0:1788843366.991701:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134317568 00000100:00100000:2.0:1788843366.991754:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788843366.991759:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e40f5f79 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3629:x1875738134317568:12345-0@lo:38: 00000100:00100000:2.0:1788843366.991845:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e40f5f79 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3629:x1875738134317568:12345-0@lo:38: Request processed in 84us (1721us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788843366.991851:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788843366.991896:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788843366.991904:0:3629:0:(import.c:65:import_set_state_nolock()) 0000000094173a70 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788843366.991908:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788843366.991911:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003fa75b5f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875738134317568:0@lo:38: 00000100:00100000:1.0:1788843366.996593:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134317824 00000100:00100000:1.0:1788843366.996607:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134317824 00000100:00100000:3.0:1788843366.996630:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c47e23b7 going to sleep for 11 seconds 00000100:00100000:1.0:1788843366.996709:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788843366.996720:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9a975d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+12:6483:x1875738134317824:12345-0@lo:253: 20000000:01000000:1.0:1788843366.996752:0:6498:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788843366.996774:0:6498:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788843367.006125:0:6498:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788843367.006776:0:6498:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788843367.007235:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9a975d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+12:6483:x1875738134317824:12345-0@lo:253: Request processed in 10514us (16848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843367.007248:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788843367.007423:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000980697d pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:6483:1875738134317824:0@lo:253: 10000000:01000000:0.0:1788843367.007445:0:6483:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788843367.007449:0:6483:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788843367.007451:0:6483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788843367.007452:0:6483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788843367.007454:0:6483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788843367.007455:0:6483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788843367.007456:0:6483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788843367.007458:0:6483:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788843367.007459:0:6483:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788843367.007461:0:6483:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788843367.007462:0:6483:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788843367.007464:0:6483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788843367.007465:0:6483:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788843367.007496:0:6483:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788843367.010568:0:6522:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788843367.010580:0:6522:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00080000:10000000:1.0:1788843367.015009:0:6483:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:1.0:1788843367.016566:0:6483:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788843367.016875:0:6483:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:1.0:1788843367.017028:0:6483:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788843367.017659:0:6483:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:1.0:1788843367.017857:0:6483:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00010000:00010000:2.0:1788843367.018097:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ab43c061/0xa762dfcbd58d0c00 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843367.018117:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000082ca18a7/0xa762dfcbd58d0bcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0bc8 expref: 11 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843367.018124:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ab43c061/0xa762dfcbd58d0c00 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843367.018184:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000082ca18a7/0xa762dfcbd58d0bcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0bc8 expref: 11 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843367.018198:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000082ca18a7/0xa762dfcbd58d0bcf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0bc8 expref: 11 pid: 6500 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843367.018233:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003fa75b5f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6522:1875738134317952:0@lo:104: 00000100:00100000:2.0:1788843367.018295:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843367.018348:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set 00000000acf66e4a going to sleep for 11 seconds 00000100:00100000:3.0:1788843367.018639:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134317952 00000100:00100000:3.0:1788843367.018653:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134317952 00000100:00100000:3.0:1788843367.018706:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788843367.018714:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b39d899b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+3:6522:x1875738134317952:12345-0@lo:104: 00010000:00010000:3.0:1788843367.018725:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: 00000000685f98e5/0xa762dfcbd58d0bc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0bcf expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843367.018788:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788843367.018793:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b39d899b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+3:6522:x1875738134317952:12345-0@lo:104: Request processed in 81us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843367.018799:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788843367.018820:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843367.018825:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: 00000000685f98e5/0xa762dfcbd58d0bc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0bcf expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843367.018831:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000685f98e5 already unused, calling callback (0000000065690e96) 10000000:00010000:3.0:1788843367.018835:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: 00000000685f98e5/0xa762dfcbd58d0bc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0bcf expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843367.018841:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: 00000000685f98e5/0xa762dfcbd58d0bc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0bcf expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843367.018847:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: 00000000685f98e5/0xa762dfcbd58d0bc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0bcf expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843367.018852:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788843367.018876:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: 00000000685f98e5/0xa762dfcbd58d0bc8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0bcf expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843367.018883:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843367.018901:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: 00000000685f98e5/0xa762dfcbd58d0bc8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0bcf expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843367.018912:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: 00000000685f98e5/0xa762dfcbd58d0bc8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0bcf expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843367.018929:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843367.018931:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843367.018932:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843367.018987:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e40c9b7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134318080:0@lo:103: 00000100:00100000:3.0:1788843367.019016:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843367.019357:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134318080 00000100:00100000:0.0:1788843367.019363:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134318080 00010000:00010000:0.0:1788843367.019383:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000082ca18a7/0xa762dfcbd58d0bcf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0bc8 expref: 12 pid: 6500 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843367.019607:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788843367.019616:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c1b7a06 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+12:3631:x1875738134318080:12345-0@lo:103: 00010000:00010000:0.0:1788843367.019628:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843367.019633:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000082ca18a7/0xa762dfcbd58d0bcf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0bc8 expref: 12 pid: 6500 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843367.019642:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000082ca18a7/0xa762dfcbd58d0bcf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0bc8 expref: 12 pid: 6500 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843367.019660:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ab43c061/0xa762dfcbd58d0c00 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843367.019667:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ab43c061/0xa762dfcbd58d0c00 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788843367.019679:0:6491:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009101622s 00010000:00010000:0.0:1788843367.019683:0:6491:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ab43c061/0xa762dfcbd58d0c00 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843367.019689:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ab43c061/0xa762dfcbd58d0c00 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843367.019694:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ab43c061/0xa762dfcbd58d0c00 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843367.019700:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ab43c061/0xa762dfcbd58d0c00 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843367.019714:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ab43c061 already unused, calling callback (00000000f1e7cbc1) 00010000:00010000:0.0:1788843367.019717:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ab43c061/0xa762dfcbd58d0c00 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843367.019724:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ab43c061/0xa762dfcbd58d0c00 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843367.019730:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ab43c061/0xa762dfcbd58d0c00 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843367.019740:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843367.019790:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c1b7a06 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+12:3631:x1875738134318080:12345-0@lo:103: Request processed in 176us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843367.019796:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00080000:10000000:1.0:1788843367.020312:0:6483:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:1.0:1788843367.020567:0:6483:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00010000:00010000:2.0:1788843367.020872:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000082ca18a7/0xa762dfcbd58d0bcf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0bc8 expref: 11 pid: 6500 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843367.020886:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003fa75b5f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6522:1875738134317952:0@lo:104: 00010000:00010000:2.0:1788843367.020907:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ab43c061/0xa762dfcbd58d0c00 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843367.020915:0:6522:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ab43c061/0xa762dfcbd58d0c00 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843367.020921:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ab43c061/0xa762dfcbd58d0c00 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843367.020926:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ab43c061/0xa762dfcbd58d0c00 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843367.021336:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e40c9b7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134318080:0@lo:103: 00080000:10000000:1.0:1788843367.021418:0:6483:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:1.0:1788843367.021659:0:6483:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1788843367.021903:0:6483:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:1.0:1788843367.022059:0:6483:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:1.0:1788843367.026592:0:6483:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1788843367.043648:0:6483:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788843367.044350:0:6539:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:2.0:1788843367.046115:0:6538:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1788843367.046125:0:6538:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788843367.047810:0:6483:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788843367.047929:0:6483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788843367.051645:0:6483:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788843367.052080:0:6483:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788843367.052924:0:6483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788843367.055239:0:6539:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788843367.061743:0:6483:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788843367.065968:0:6483:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788843367.067202:0:6483:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788843367.069555:0:6483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788843367.072819:0:6483:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00000040:00080000:1.0:1788843367.073988:0:6539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788843367.076116:0:6539:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788843367.076127:0:6539:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:2.0:1788843367.082897:0:6483:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788843367.084099:0:6483:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788843367.084643:0:6483:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788843367.084831:0:6483:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788843367.084967:0:6483:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788843367.085834:0:6483:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788843367.085989:0:6483:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788843367.086166:0:6483:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788843367.086386:0:6483:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788843367.086691:0:6483:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788843367.086876:0:6483:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788843367.087031:0:6483:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788843367.087911:0:6483:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788843367.088544:0:6483:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788843367.090018:0:6483:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788843367.090214:0:6483:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788843367.091086:0:6483:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788843367.091283:0:6483:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788843367.091436:0:6483:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788843367.091566:0:6483:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788843367.091704:0:6483:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788843367.091873:0:6483:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788843367.091998:0:6483:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788843367.092302:0:6483:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788843367.092435:0:6483:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788843367.092584:0:6483:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788843367.092739:0:6483:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788843367.094690:0:6483:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788843367.094928:0:6483:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788843367.095965:0:6483:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788843367.096719:0:6483:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788843367.096884:0:6483:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788843367.097275:0:6483:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1788843367.107824:0:6483:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788843367.107873:0:6483:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb2dcc1c87988 00100000:10000000:3.0:1788843367.107882:0:6483:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788843367.116323:0:6483:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788843367.116342:0:6483:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.133@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788843367.116361:0:6483:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788843367.116390:0:6483:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788843367.117179:0:6483:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788843367.117387:0:6483:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1788843367.514746:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843368.542735:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843369.566772:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843370.586376:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843371.610387:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788843372.260217:0:6784:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg333-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788843372.442907:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f57d3bb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134318208:0@lo:400: 00000100:00100000:2.0:1788843372.443062:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843372.443169:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134318208 00000100:00100000:3.0:1788843372.443188:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134318208 00000100:00100000:3.0:1788843372.443236:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788843372.443244:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004258e43f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+11:3632:x1875738134318208:12345-0@lo:400: 00000100:00080000:1.0:1788843372.443446:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788843372.443451:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788843372.443454:0:38:0:(import.c:65:import_set_state_nolock()) 0000000094173a70 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788843372.443461:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000094173a70 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:1.0:1788843372.443488:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003a305548 x1875738134318336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788843372.443532:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003a305548 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875738134318336:0@lo:38: 00000100:00100000:1.0:1788843372.443571:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843372.445770:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004258e43f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+11:3632:x1875738134318208:12345-0@lo:400: Request processed in 2520us (2703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843372.445786:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788843372.445862:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134318336 00000100:00100000:3.0:1788843372.445870:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134318336 00000100:00100000:3.0:1788843372.445913:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788843372.445919:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002824d656 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3629:x1875738134318336:12345-0@lo:38: 00010000:00080000:3.0:1788843372.445946:0:6508:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 150 last 0 00000020:00000080:3.0:1788843372.446000:0:6508:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa762dfcbd58d0c07 00000004:00100000:3.0:1788843372.446050:0:6508:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788843372.446203:0:6508:0:(import.c:65:import_set_state_nolock()) 0000000037fc5fe1 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788843372.446265:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002824d656 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1875738134318336:12345-0@lo:38: Request processed in 346us (2695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843372.446272:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788843372.446537:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003a305548 x1875738134318336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788843382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788843372.446557:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788843372.446566:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788843372.446578:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788843372.446581:0:3629:0:(import.c:65:import_set_state_nolock()) 0000000094173a70 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788843372.446587:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003a305548 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875738134318336:0@lo:38: 00000100:00100000:2.0:1788843372.446831:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f57d3bb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134318208:0@lo:400: 00010000:00010000:3.0:1788843372.634287:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788843373.307639:0:6836:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788843373.307900:0:6836:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788843373.664862:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788843373.978331:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788843373.978341:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd118db4800 from 3 10000000:01000000:2.0:1788843373.978347:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788843373.978474:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: 00000000494f29b7/0xa762dfcbd58d0c0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843373.978486:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: 00000000494f29b7/0xa762dfcbd58d0c0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843373.978497:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: 00000000494f29b7/0xa762dfcbd58d0c0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843373.978522:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003fa75b5f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134318464:0@lo:101: 00000100:00100000:2.0:1788843373.978591:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843373.979401:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set 00000000570f31eb going to sleep for 11 seconds 00000100:00100000:1.0:1788843373.981748:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134318464 00000100:00100000:1.0:1788843373.981763:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134318464 00000100:00100000:1.0:1788843373.981819:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788843373.981828:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b7ae481 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+11:6503:x1875738134318464:12345-0@lo:101: 00010000:00010000:1.0:1788843373.981846:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843373.981867:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ac962e58/0xa762dfcbd58d0c15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0c0e expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843373.981899:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ac962e58/0xa762dfcbd58d0c15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0c0e expref: 12 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843373.981910:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ac962e58/0xa762dfcbd58d0c15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0c0e expref: 12 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843373.981919:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ac962e58, rc 0) 00000100:00100000:1.0:1788843373.981997:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b7ae481 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+12:6503:x1875738134318464:12345-0@lo:101: Request processed in 170us (3407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843373.982005:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788843373.982062:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003fa75b5f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134318464:0@lo:101: 00010000:00010000:1.0:1788843373.982081:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: 00000000494f29b7/0xa762dfcbd58d0c0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0c15 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843373.982090:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: 00000000494f29b7/0xa762dfcbd58d0c0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0c15 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843373.982359:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003a305548 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134318592:0@lo:256: 00000100:00100000:1.0:1788843373.982409:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843373.982446:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b601dbaf going to sleep for 11 seconds 00000100:00100000:2.0:1788843373.982550:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134318592 00000100:00100000:2.0:1788843373.982555:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134318592 00000100:00100000:2.0:1788843373.982590:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788843373.982597:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000baade77e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+12:6503:x1875738134318592:12345-0@lo:256: 20000000:01000000:2.0:1788843373.982612:0:6501:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788843373.982628:0:6501:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788843373.982631:0:6501:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788843373.982705:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000baade77e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+12:6503:x1875738134318592:12345-0@lo:256: Request processed in 108us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843373.982728:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788843373.982864:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003a305548 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134318592:0@lo:256: 10000000:01000000:1.0:1788843373.982906:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788843373.982915:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: 00000000494f29b7/0xa762dfcbd58d0c0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0c15 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843373.982923:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: 00000000494f29b7/0xa762dfcbd58d0c0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0c15 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843374.682348:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843375.706315:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788843376.025647:0:6937:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788843376.025881:0:6937:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788843376.730680:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843377.562377:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788843377.562385:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000096d9179a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134318848:0@lo:400: 00000100:00100000:2.0:1788843377.562406:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003a305548 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134318720:0@lo:400: 00000100:00100000:1.0:1788843377.566899:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843377.567176:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134318848 00000100:00100000:0.0:1788843377.567188:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134318848 00000100:00100000:0.0:1788843377.567255:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788843377.567266:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e92d3317 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134318848:12345-0@lo:400: 00000100:00100000:0.0:1788843377.567367:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e92d3317 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134318848:12345-0@lo:400: Request processed in 103us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843377.567376:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788843377.567470:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000096d9179a x1875738134318848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843377.567488:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000096d9179a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134318848:0@lo:400: 00000100:00100000:2.0:1788843377.567895:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843377.567958:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134318720 00000100:00100000:1.0:1788843377.567964:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134318720 00000100:00100000:1.0:1788843377.568015:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788843377.568024:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e9dd0b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+12:3632:x1875738134318720:12345-0@lo:400: 00000100:00100000:1.0:1788843377.568083:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e9dd0b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+12:3632:x1875738134318720:12345-0@lo:400: Request processed in 61us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843377.568242:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788843377.568341:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003a305548 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134318720:0@lo:400: 00010000:00010000:1.0:1788843377.756743:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843378.778281:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843379.803283:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843380.827489:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843381.850595:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843382.682746:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843382.682779:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000096d9179a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134318976:0@lo:400: 00000100:00100000:1.0:1788843382.682885:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843382.682952:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000baf0993e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134319104:0@lo:400: 00000100:00100000:1.0:1788843382.682985:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843382.683029:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134318976 00000100:00100000:1.0:1788843382.683039:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134318976 00000100:00100000:1.0:1788843382.683091:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788843382.683100:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002fa71b4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+12:3630:x1875738134318976:12345-0@lo:400: 00000100:00100000:1.0:1788843382.683177:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002fa71b4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+12:3630:x1875738134318976:12345-0@lo:400: Request processed in 78us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843382.683185:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788843382.683227:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134319104 00000100:00100000:1.0:1788843382.683231:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134319104 00000100:00100000:1.0:1788843382.683260:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788843382.683266:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000099547b18 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134319104:12345-0@lo:400: 00000100:00100000:1.0:1788843382.683303:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000099547b18 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134319104:12345-0@lo:400: Request processed in 38us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843382.683309:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788843382.683348:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000baf0993e x1875738134319104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843382.683544:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000baf0993e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134319104:0@lo:400: 00000100:00100000:1.0:1788843382.683577:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000096d9179a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134318976:0@lo:400: 00010000:00010000:3.0:1788843382.878533:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843383.898363:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843384.925420:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843385.950062:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788843386.087021:0:7436:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788843386.087028:0:7436:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788843386.087029:0:7436:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788843386.087238:0:7436:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000bc3c4cc9 00000020:01000004:0.0:1788843386.087264:0:7436:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:0.0:1788843386.087276:0:7436:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788843386.087301:0:7436:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000b720ba06) 00000020:00000080:0.0:1788843386.087320:0:7436:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788843386.212182:0:7436:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:0.0:1788843386.212297:0:7436:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:3.0:1788843386.248004:0:7436:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788843386.248335:0:7436:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788843386.248349:0:7436:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788843386.248365:0:7436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa762dfcbd58d0c23 00000020:01000004:3.0:1788843386.248373:0:7436:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788843386.248400:0:7436:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.133@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788843386.248403:0:7436:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.133@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788843386.248410:0:7436:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788843386.248458:0:7436:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788843386.248463:0:7436:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.133@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788843386.266193:0:7436:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.133@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788843386.266240:0:7436:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.133@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1788843386.266245:0:7436:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788843386.266249:0:7436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788843386.266251:0:7436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843386.266253:0:7436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843386.266255:0:7436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843386.266257:0:7436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843386.266260:0:7436:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788843386.266262:0:7436:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788843386.266264:0:7436:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788843386.266266:0:7436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843386.266268:0:7436:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788843386.266272:0:7436:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1788843386.266275:0:7436:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788843386.266277:0:7436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788843386.266279:0:7436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843386.266280:0:7436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843386.266282:0:7436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843386.266283:0:7436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843386.266285:0:7436:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788843386.266287:0:7436:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788843386.266288:0:7436:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788843386.266290:0:7436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843386.266293:0:7436:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788843386.266594:0:7436:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788843386.266615:0:7436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005ae73b7b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134319232:0@lo:253: 00000100:00100000:2.0:1788843386.266718:0:7436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843386.266799:0:7436:0:(client.c:2715:ptlrpc_set_wait()) set 000000002b58baf1 going to sleep for 11 seconds 00000100:00100000:1.0:1788843386.267005:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134319232 00000100:00100000:1.0:1788843386.267015:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134319232 00000100:00100000:1.0:1788843386.267081:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788843386.267090:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008e53177 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+12:7436:x1875738134319232:12345-0@lo:253: 20000000:01000000:1.0:1788843386.267133:0:6500:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788843386.267168:0:6500:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:1.0:1788843386.267175:0:6500:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:1.0:1788843386.267179:0:6500:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:1.0:1788843386.267219:0:6500:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:1.0:1788843386.267474:0:6500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788843386.267608:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788843386.267622:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788843386.267650:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1788843386.267668:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1788843386.267685:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1788843386.267743:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:1.0:1788843386.267752:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:1.0:1788843386.267765:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:1.0:1788843386.267770:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:1.0:1788843386.267782:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:1.0:1788843386.267787:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:1.0:1788843386.267799:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1788843386.267814:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1788843386.267916:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:1.0:1788843386.267924:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.133@tcp (null) (null) (null) 00000040:00080000:1.0:1788843386.267937:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:1.0:1788843386.267943:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788843386.267955:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:1.0:1788843386.267960:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.133@tcp (null) (null) 00000040:00080000:1.0:1788843386.267972:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:1.0:1788843386.267988:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788843386.268004:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1788843386.268020:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1788843386.268031:0:6500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1788843386.268113:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:1.0:1788843386.268122:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:1.0:1788843386.268135:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1788843386.268175:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1788843386.268191:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:1.0:1788843386.268197:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:1.0:1788843386.268210:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1788843386.268227:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1788843386.268232:0:6500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:1.0:1788843386.268251:0:6500:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788843386.268257:0:6500:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:2.0:1788843386.269406:0:7442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1788843386.269663:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1788843386.269689:0:6500:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.133@tcp for mdt 20000000:01000000:1.0:1788843386.269691:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.133@tcp (null) (null) (null) 00000040:00080000:1.0:1788843386.269707:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1788843386.269714:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788843386.269728:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1788843386.269734:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.133@tcp (null) (null) 00000040:00080000:1.0:1788843386.269752:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1788843386.269760:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:1.0:1788843386.269774:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:1.0:1788843386.269789:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:1.0:1788843386.269833:0:6500:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:1.0:1788843386.269841:0:6500:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:2.0:1788843386.270514:0:7443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:1.0:1788843386.270710:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1788843386.270728:0:6500:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.133@tcp for mdt 20000000:01000000:1.0:1788843386.270730:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.133@tcp (null) (null) (null) 00000040:00080000:1.0:1788843386.270756:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1788843386.270763:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788843386.270776:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1788843386.270780:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.133@tcp (null) (null) 00000040:00080000:1.0:1788843386.270791:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1788843386.270796:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:1.0:1788843386.270807:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1788843386.270819:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:1.0:1788843386.270837:0:6500:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788843386.270840:0:6500:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788843386.270843:0:6500:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788843386.270889:0:6500:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788843386.270891:0:6500:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788843386.272071:0:7444:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1788843386.272126:0:7444:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1788843386.272232:0:7444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:1.0:1788843386.272553:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1788843386.272606:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1788843386.272626:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:1.0:1788843386.272648:0:6500:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788843386.272650:0:6500:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788843386.274031:0:7445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1788843386.274093:0:7445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1788843386.274136:0:7445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1788843386.274389:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1788843386.274419:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1788843386.274447:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1788843386.274460:0:6500:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788843386.274462:0:6500:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788843386.274938:0:7446:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1788843386.274964:0:7446:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1788843386.274978:0:7446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1788843386.275238:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:1.0:1788843386.275260:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:1.0:1788843386.275275:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:1.0:1788843386.275290:0:6500:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788843386.275293:0:6500:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788843386.275299:0:6500:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788843386.275307:0:6500:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788843386.275979:0:7447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1788843386.276126:0:6500:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788843386.287203:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788843386.287242:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f9986a52/0xa762dfcbd58d0c2a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843386.287268:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000264e066/0xa762dfcbd58d0b5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0b58 expref: 12 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843386.287277:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000092bcb600/0xa762dfcbd58d0b7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0b74 expref: 12 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843386.287284:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000064774e0e/0xa762dfcbd58d0beb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0be4 expref: 12 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843386.287291:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f9986a52/0xa762dfcbd58d0c2a lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843386.287417:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000064774e0e/0xa762dfcbd58d0beb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0be4 expref: 12 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843386.287438:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000064774e0e/0xa762dfcbd58d0beb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0be4 expref: 12 pid: 6498 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843386.287457:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000096d9179a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6500:1875738134319360:0@lo:104: 00000100:00100000:1.0:1788843386.287622:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788843386.287729:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000092bcb600/0xa762dfcbd58d0b7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0b74 expref: 12 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843386.287739:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000092bcb600/0xa762dfcbd58d0b7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0b74 expref: 12 pid: 6500 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843386.287770:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e41d69f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6500:1875738134319488:0@lo:104: 00000100:00100000:1.0:1788843386.287795:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788843386.287821:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000264e066/0xa762dfcbd58d0b5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0b58 expref: 12 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843386.287830:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000264e066/0xa762dfcbd58d0b5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0b58 expref: 12 pid: 6500 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843386.288103:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c6d81363 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6500:1875738134319616:0@lo:104: 00000100:00100000:1.0:1788843386.288130:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843386.288253:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set 000000009154b2df going to sleep for 11 seconds 00000100:00100000:3.0:1788843386.288266:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134319360 00000100:00100000:3.0:1788843386.288275:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134319360 00000100:00100000:3.0:1788843386.288325:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134319488 00000100:00100000:3.0:1788843386.288328:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134319488 00000100:00100000:3.0:1788843386.288338:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134319616 00000100:00100000:3.0:1788843386.288340:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134319616 00000100:00100000:2.0:1788843386.288438:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788843386.288454:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000baf0993e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+5:6500:x1875738134319360:12345-0@lo:104: 00010000:00010000:2.0:1788843386.288480:0:6490:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: 0000000027231346/0xa762dfcbd58d0be4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0beb expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843386.288558:0:6490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788843386.288563:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000baf0993e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+5:6500:x1875738134319360:12345-0@lo:104: Request processed in 115us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843386.288571:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788843386.288593:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788843386.288598:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dfc9d033 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+4:6500:x1875738134319488:12345-0@lo:104: 00000100:00100000:1.0:1788843386.288602:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000096d9179a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6500:1875738134319360:0@lo:104: 00010000:00010000:2.0:1788843386.288604:0:6490:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: 00000000e28d712a/0xa762dfcbd58d0b74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0b7b expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843386.288655:0:6490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788843386.288660:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dfc9d033 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+4:6500:x1875738134319488:12345-0@lo:104: Request processed in 63us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843386.288666:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788843386.288667:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e41d69f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6500:1875738134319488:0@lo:104: 00000100:00100000:2.0:1788843386.288678:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788843386.288695:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010e89b07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+3:6500:x1875738134319616:12345-0@lo:104: 00010000:00010000:2.0:1788843386.288702:0:6490:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: 00000000239018ee/0xa762dfcbd58d0b58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0b5f expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843386.288739:0:6490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788843386.288743:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010e89b07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+3:6500:x1875738134319616:12345-0@lo:104: Request processed in 51us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843386.288748:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788843386.288829:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c6d81363 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6500:1875738134319616:0@lo:104: 00010000:00010000:1.0:1788843386.288868:0:6500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f9986a52/0xa762dfcbd58d0c2a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.288887:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788843386.288894:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: 0000000027231346/0xa762dfcbd58d0be4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0beb expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.288902:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000027231346 already unused, calling callback (0000000065690e96) 10000000:00010000:3.0:1788843386.288906:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: 0000000027231346/0xa762dfcbd58d0be4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0beb expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.288915:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: 0000000027231346/0xa762dfcbd58d0be4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0beb expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843386.288921:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: 0000000027231346/0xa762dfcbd58d0be4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0beb expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843386.288927:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788843386.288970:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: 0000000027231346/0xa762dfcbd58d0be4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0beb expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.288978:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788843386.289037:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000230b6033 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134319744:0@lo:103: 00000100:00100000:1.0:1788843386.289072:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843386.289168:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134319744 00000100:00100000:0.0:1788843386.289174:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134319744 00010000:00010000:0.0:1788843386.289197:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000064774e0e/0xa762dfcbd58d0beb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0be4 expref: 13 pid: 6498 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843386.289219:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788843386.289225:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6d81363 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+13:3633:x1875738134319744:12345-0@lo:103: 00010000:00010000:0.0:1788843386.289237:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843386.289241:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000064774e0e/0xa762dfcbd58d0beb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0be4 expref: 13 pid: 6498 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843386.289252:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000064774e0e/0xa762dfcbd58d0beb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0be4 expref: 13 pid: 6498 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843386.289266:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000064774e0e/0xa762dfcbd58d0beb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0be4 expref: 13 pid: 6498 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843386.289297:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788843386.289666:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: 0000000027231346/0xa762dfcbd58d0be4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0beb expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.289675:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: 0000000027231346/0xa762dfcbd58d0be4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0beb expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.289701:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788843386.289704:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: 00000000e28d712a/0xa762dfcbd58d0b74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0b7b expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.289709:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e28d712a already unused, calling callback (0000000065690e96) 10000000:00010000:3.0:1788843386.289711:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: 00000000e28d712a/0xa762dfcbd58d0b74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0b7b expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.289717:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: 00000000e28d712a/0xa762dfcbd58d0b74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0b7b expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843386.289723:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: 00000000e28d712a/0xa762dfcbd58d0b74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0b7b expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843386.289727:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788843386.289751:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: 00000000e28d712a/0xa762dfcbd58d0b74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0b7b expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.289757:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843386.289773:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: 00000000e28d712a/0xa762dfcbd58d0b74 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0b7b expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.289779:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: 00000000e28d712a/0xa762dfcbd58d0b74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0b7b expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.289787:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843386.289789:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: 00000000239018ee/0xa762dfcbd58d0b58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0b5f expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.289803:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000239018ee already unused, calling callback (0000000065690e96) 10000000:00010000:3.0:1788843386.289805:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: 00000000239018ee/0xa762dfcbd58d0b58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0b5f expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.289811:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: 00000000239018ee/0xa762dfcbd58d0b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0b5f expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843386.289816:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: 00000000239018ee/0xa762dfcbd58d0b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0b5f expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843386.289821:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788843386.289833:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: 00000000239018ee/0xa762dfcbd58d0b58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0b5f expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.289837:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843386.289841:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: 00000000239018ee/0xa762dfcbd58d0b58 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0b5f expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.289847:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: 00000000239018ee/0xa762dfcbd58d0b58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0b5f expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.289860:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843386.289862:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843386.289863:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843386.289871:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843386.289889:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053c2348e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134320000:0@lo:103: 00000100:00100000:3.0:1788843386.289925:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843386.289959:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788843386.289964:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000457fc75b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134319872:0@lo:103: 00000100:00100000:3.0:1788843386.289993:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843386.290297:0:6493:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788843386.290307:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1788843386.290534:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134320000 00000100:00100000:3.0:1788843386.290541:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134320000 00010000:00010000:3.0:1788843386.290567:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000264e066/0xa762dfcbd58d0b5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0b58 expref: 13 pid: 6500 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843386.290595:0:6493:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788843386.290601:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134319872 00000100:00100000:3.0:1788843386.290603:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134319872 00010000:00010000:3.0:1788843386.290613:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000092bcb600/0xa762dfcbd58d0b7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0b74 expref: 14 pid: 6500 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843386.290623:0:6493:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788843386.290631:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788843386.290649:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a21c237 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e79d9884-ba2e-42e7-accb-b4784b9c1837+14:3631:x1875738134320000:12345-0@lo:103: 00010000:00010000:3.0:1788843386.290663:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843386.290666:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000264e066/0xa762dfcbd58d0b5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0b58 expref: 14 pid: 6500 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.290676:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000264e066/0xa762dfcbd58d0b5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0b58 expref: 14 pid: 6500 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.290690:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000264e066/0xa762dfcbd58d0b5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0b58 expref: 14 pid: 6500 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.290704:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843386.290747:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a21c237 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e79d9884-ba2e-42e7-accb-b4784b9c1837+13:3631:x1875738134320000:12345-0@lo:103: Request processed in 99us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843386.290755:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788843386.290769:0:6493:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788843386.290783:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788843386.290789:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c04a6773 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e79d9884-ba2e-42e7-accb-b4784b9c1837+12:3631:x1875738134319872:12345-0@lo:103: 00010000:00010000:3.0:1788843386.290797:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843386.290800:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000092bcb600/0xa762dfcbd58d0b7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0b74 expref: 12 pid: 6500 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.290810:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000092bcb600/0xa762dfcbd58d0b7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0b74 expref: 12 pid: 6500 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.290819:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000092bcb600/0xa762dfcbd58d0b7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0b74 expref: 12 pid: 6500 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.290829:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f9986a52/0xa762dfcbd58d0c2a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.290838:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f9986a52/0xa762dfcbd58d0c2a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.290853:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f9986a52/0xa762dfcbd58d0c2a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.290860:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f9986a52/0xa762dfcbd58d0c2a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.290866:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f9986a52/0xa762dfcbd58d0c2a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.290872:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f9986a52/0xa762dfcbd58d0c2a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.290878:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f9986a52 already unused, calling callback (00000000f1e7cbc1) 00010000:00010000:3.0:1788843386.290882:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f9986a52/0xa762dfcbd58d0c2a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.290897:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f9986a52/0xa762dfcbd58d0c2a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.290912:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f9986a52/0xa762dfcbd58d0c2a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.290923:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843386.290952:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c04a6773 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e79d9884-ba2e-42e7-accb-b4784b9c1837+11:3631:x1875738134319872:12345-0@lo:103: Request processed in 164us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843386.290958:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788843386.290994:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000457fc75b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134319872:0@lo:103: 00000100:00100000:3.0:1788843386.291004:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053c2348e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134320000:0@lo:103: 00000100:00100000:0.0:1788843386.295454:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6d81363 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+10:3633:x1875738134319744:12345-0@lo:103: Request processed in 6212us (6366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843386.295477:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788843386.295507:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000230b6033 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134319744:0@lo:103: 00010000:00010000:1.0:1788843386.295562:0:6500:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f9986a52/0xa762dfcbd58d0c2a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843386.295575:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f9986a52/0xa762dfcbd58d0c2a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843386.295605:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f9986a52/0xa762dfcbd58d0c2a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788843386.295643:0:6500:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788843386.299055:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008e53177 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+9:7436:x1875738134319232:12345-0@lo:253: Request processed in 31953us (32324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843386.299080:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788843386.299921:0:7436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005ae73b7b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134319232:0@lo:253: 10000000:01000000:2.0:1788843386.300019:0:7436:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788843386.300023:0:7436:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788843386.300025:0:7436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788843386.300027:0:7436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843386.300028:0:7436:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1788843386.300030:0:7436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843386.300031:0:7436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843386.300033:0:7436:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788843386.300034:0:7436:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788843386.300036:0:7436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843386.300037:0:7436:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788843386.300428:0:7436:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000bc3c4cc9 from lustre-MDT0001 10000000:01000000:3.0:1788843386.300487:0:7436:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788843386.300491:0:7436:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788843386.300500:0:7436:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bd13339b370 local copy 10000000:01000000:3.0:1788843386.300505:0:7436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788843386.300560:0:7436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: 000000000264e066/0xa762dfcbd58d0c31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.300573:0:7436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.133@tcp lock: 000000000264e066/0xa762dfcbd58d0c31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.300584:0:7436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: 000000000264e066/0xa762dfcbd58d0c31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843386.300608:0:7436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053c2348e pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134320128:0@lo:101: 00000100:00100000:3.0:1788843386.300686:0:7436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843386.300767:0:7436:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b601dbaf going to sleep for 11 seconds 00000100:00100000:0.0:1788843386.300940:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134320128 00000100:00100000:0.0:1788843386.300951:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134320128 00000100:00100000:0.0:1788843386.301017:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788843386.301029:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000417708b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+9:7436:x1875738134320128:12345-0@lo:101: 00010000:00010000:0.0:1788843386.301048:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843386.301066:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000227f9ebb/0xa762dfcbd58d0c38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0c31 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843386.301096:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000227f9ebb/0xa762dfcbd58d0c38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0c31 expref: 10 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843386.301107:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000227f9ebb/0xa762dfcbd58d0c38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0c31 expref: 10 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843386.301117:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000227f9ebb, rc 0) 00000100:00100000:0.0:1788843386.301205:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000417708b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+10:7436:x1875738134320128:12345-0@lo:101: Request processed in 178us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843386.301212:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788843386.301225:0:7436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053c2348e pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134320128:0@lo:101: 00010000:00010000:3.0:1788843386.301239:0:7436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: 000000000264e066/0xa762dfcbd58d0c31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa762dfcbd58d0c38 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.301248:0:7436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: 000000000264e066/0xa762dfcbd58d0c31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa762dfcbd58d0c38 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843386.301494:0:7436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053c2348e pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134320256:0@lo:501: 00000100:00100000:3.0:1788843386.301525:0:7436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843386.301600:0:7436:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b601dbaf going to sleep for 11 seconds 00000100:00100000:1.0:1788843386.301837:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134320256 00000100:00100000:1.0:1788843386.301845:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134320256 00000100:00100000:1.0:1788843386.301877:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788843386.301884:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b726d483 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+10:7436:x1875738134320256:12345-0@lo:501: 00000100:00100000:1.0:1788843386.302077:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b726d483 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+10:7436:x1875738134320256:12345-0@lo:501: Request processed in 193us (551us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788843386.302085:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788843386.302164:0:7436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053c2348e pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134320256:0@lo:501: 10000000:01000000:3.0:1788843386.302181:0:7436:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.133@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788843386.302202:0:7436:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.133@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788843386.302207:0:7436:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: 000000000264e066/0xa762dfcbd58d0c31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa762dfcbd58d0c38 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.302217:0:7436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: 000000000264e066/0xa762dfcbd58d0c31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa762dfcbd58d0c38 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.302224:0:7436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.133@tcp lock: 000000000264e066/0xa762dfcbd58d0c31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa762dfcbd58d0c38 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.302252:0:7436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788843386.302281:0:7436:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bd12e2b3800 10000000:01000000:3.0:1788843386.302287:0:7436:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788843386.302292:0:7436:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9bd13339b370 10000000:01000000:3.0:1788843386.302294:0:7436:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788843386.302298:0:7436:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9bd13339b370 from 1 10000000:01000000:3.0:1788843386.302431:0:7436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788843386.302454:0:7436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: 000000003ea6c0d6/0xa762dfcbd58d0c3f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.302521:0:7436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: 000000003ea6c0d6/0xa762dfcbd58d0c3f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.302530:0:7436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: 000000003ea6c0d6/0xa762dfcbd58d0c3f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843386.302544:0:7436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053c2348e pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134320384:0@lo:101: 00000100:00100000:3.0:1788843386.302578:0:7436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843386.302669:0:7436:0:(client.c:2715:ptlrpc_set_wait()) set 0000000033ae7d42 going to sleep for 11 seconds 00010000:00010000:0.0:1788843386.302672:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843386.302679:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: 000000000264e066/0xa762dfcbd58d0c31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xa762dfcbd58d0c38 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843386.302687:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000264e066 already unused, calling callback (0000000065690e96) 10000000:00010000:0.0:1788843386.302691:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: 000000000264e066/0xa762dfcbd58d0c31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xa762dfcbd58d0c38 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843386.302707:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: 000000000264e066/0xa762dfcbd58d0c31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xa762dfcbd58d0c38 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843386.302714:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: 000000000264e066/0xa762dfcbd58d0c31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xa762dfcbd58d0c38 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843386.302719:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788843386.302754:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: 000000000264e066/0xa762dfcbd58d0c31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa762dfcbd58d0c38 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843386.302761:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843386.302787:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: 000000000264e066/0xa762dfcbd58d0c31 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa762dfcbd58d0c38 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843386.302794:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: 000000000264e066/0xa762dfcbd58d0c31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa762dfcbd58d0c38 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843386.302806:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b0cc7be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134320512:0@lo:103: 00010000:00010000:0.0:1788843386.302827:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843386.302829:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843386.302830:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843386.302836:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843386.302872:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134320512 00000100:00100000:3.0:1788843386.302879:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134320512 00000100:00100000:3.0:1788843386.302940:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788843386.302949:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000457fc75b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e79d9884-ba2e-42e7-accb-b4784b9c1837+10:3632:x1875738134320512:12345-0@lo:103: 00010000:00010000:3.0:1788843386.302962:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843386.302977:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000227f9ebb/0xa762dfcbd58d0c38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d0c31 expref: 10 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.302991:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843386.303021:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000457fc75b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e79d9884-ba2e-42e7-accb-b4784b9c1837+9:3632:x1875738134320512:12345-0@lo:103: Request processed in 74us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843386.303029:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788843386.303060:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b0cc7be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134320512:0@lo:103: 00000100:00100000:1.0:1788843386.303272:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134320384 00000100:00100000:1.0:1788843386.303278:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134320384 00000100:00100000:1.0:1788843386.303319:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788843386.303326:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a18a83a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+9:7436:x1875738134320384:12345-0@lo:101: 00010000:00010000:1.0:1788843386.303337:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843386.303447:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f9986a52/0xa762dfcbd58d0c46 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0c3f expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843386.303480:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f9986a52/0xa762dfcbd58d0c46 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0c3f expref: 10 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843386.303491:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f9986a52/0xa762dfcbd58d0c46 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0c3f expref: 10 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843386.303515:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f9986a52, rc 0) 00000100:00100000:1.0:1788843386.303600:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a18a83a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+10:7436:x1875738134320384:12345-0@lo:101: Request processed in 274us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843386.303606:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788843386.303883:0:7436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053c2348e pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134320384:0@lo:101: 00010000:00010000:3.0:1788843386.303906:0:7436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: 000000003ea6c0d6/0xa762dfcbd58d0c3f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0c46 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.303916:0:7436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: 000000003ea6c0d6/0xa762dfcbd58d0c3f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0c46 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843386.303936:0:7436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788843386.303984:0:7436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: 000000003ea6c0d6/0xa762dfcbd58d0c3f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0c46 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.303992:0:7436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: 000000003ea6c0d6/0xa762dfcbd58d0c3f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0c46 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843386.304006:0:7436:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9bd12e2b3800 10000000:01000000:3.0:1788843386.304010:0:7436:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788843386.304016:0:7436:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9bd12e2b3800 from 1 10000000:01000000:3.0:1788843386.304018:0:7436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788843386.304038:0:7436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: 00000000d711861d/0xa762dfcbd58d0c4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.304045:0:7436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: 00000000d711861d/0xa762dfcbd58d0c4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.304051:0:7436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: 00000000d711861d/0xa762dfcbd58d0c4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843386.304066:0:7436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053c2348e pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134320640:0@lo:101: 00000100:00100000:3.0:1788843386.304107:0:7436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843386.304169:0:7436:0:(client.c:2715:ptlrpc_set_wait()) set 0000000033ae7d42 going to sleep for 11 seconds 00000100:00100000:1.0:1788843386.304268:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134320640 00000100:00100000:1.0:1788843386.304274:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134320640 00000100:00100000:1.0:1788843386.306369:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788843386.306398:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b4d03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+10:7436:x1875738134320640:12345-0@lo:101: 00010000:00010000:1.0:1788843386.306420:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843386.306443:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000092bcb600/0xa762dfcbd58d0c54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0c4d expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843386.306490:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000092bcb600/0xa762dfcbd58d0c54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0c4d expref: 11 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843386.306502:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000092bcb600/0xa762dfcbd58d0c54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0c4d expref: 11 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843386.306511:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000092bcb600, rc 0) 00000100:00100000:1.0:1788843386.306613:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b4d03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+11:7436:x1875738134320640:12345-0@lo:101: Request processed in 230us (2505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843386.306621:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788843386.306797:0:7436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053c2348e pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134320640:0@lo:101: 00010000:00010000:0.0:1788843386.306816:0:7436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: 00000000d711861d/0xa762dfcbd58d0c4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0c54 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843386.306825:0:7436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: 00000000d711861d/0xa762dfcbd58d0c4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0c54 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843386.306847:0:7436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788843386.307272:0:7436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: 00000000d711861d/0xa762dfcbd58d0c4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0c54 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843386.307296:0:7436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: 00000000d711861d/0xa762dfcbd58d0c4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0c54 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843386.307317:0:7436:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788843386.307323:0:7436:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788843386.307330:0:7436:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9bd12e2b3800 10000000:01000000:0.0:1788843386.307333:0:7436:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788843386.307337:0:7436:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1788843386.307340:0:7436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788843386.307484:0:7436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: 00000000c1313e95/0xa762dfcbd58d0c5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843386.307492:0:7436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: 00000000c1313e95/0xa762dfcbd58d0c5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843386.307500:0:7436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: 00000000c1313e95/0xa762dfcbd58d0c5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843386.307520:0:7436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b347c484 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134320768:0@lo:101: 00000100:00100000:0.0:1788843386.307571:0:7436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843386.307616:0:7436:0:(client.c:2715:ptlrpc_set_wait()) set 000000003438699c going to sleep for 11 seconds 00000100:00100000:3.0:1788843386.307699:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134320768 00000100:00100000:3.0:1788843386.307714:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134320768 00000100:00100000:3.0:1788843386.307771:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788843386.307779:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e43fc9a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+11:7436:x1875738134320768:12345-0@lo:101: 00010000:00010000:3.0:1788843386.307789:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843386.307801:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009b4439f3/0xa762dfcbd58d0c62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0c5b expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.307821:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009b4439f3/0xa762dfcbd58d0c62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0c5b expref: 12 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.307831:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009b4439f3/0xa762dfcbd58d0c62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0c5b expref: 12 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.307838:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009b4439f3, rc 0) 00000100:00100000:3.0:1788843386.307872:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e43fc9a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+12:7436:x1875738134320768:12345-0@lo:101: Request processed in 95us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843386.307879:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788843386.308018:0:7436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b347c484 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134320768:0@lo:101: 00010000:00010000:0.0:1788843386.308031:0:7436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: 00000000c1313e95/0xa762dfcbd58d0c5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0c62 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843386.308040:0:7436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: 00000000c1313e95/0xa762dfcbd58d0c5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0c62 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843386.308219:0:7436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b347c484 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134320896:0@lo:501: 00000100:00100000:0.0:1788843386.308250:0:7436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843386.308268:0:7436:0:(client.c:2715:ptlrpc_set_wait()) set 000000003438699c going to sleep for 11 seconds 00000100:00100000:3.0:1788843386.308329:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134320896 00000100:00100000:3.0:1788843386.308334:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134320896 00000100:00100000:3.0:1788843386.308369:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788843386.308376:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000164ca4a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+12:7436:x1875738134320896:12345-0@lo:501: 00000100:00100000:3.0:1788843386.308490:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000164ca4a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+12:7436:x1875738134320896:12345-0@lo:501: Request processed in 115us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843386.308498:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788843386.308724:0:7436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b347c484 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134320896:0@lo:501: 00000100:00100000:0.0:1788843386.308752:0:7436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b347c484 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134321024:0@lo:503: 00000100:00100000:0.0:1788843386.308791:0:7436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843386.308817:0:7436:0:(client.c:2715:ptlrpc_set_wait()) set 000000003438699c going to sleep for 11 seconds 00000100:00100000:1.0:1788843386.308859:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134321024 00000100:00100000:1.0:1788843386.308864:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134321024 00000100:00100000:1.0:1788843386.308899:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788843386.308907:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1dc6aed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+12:7436:x1875738134321024:12345-0@lo:503: 00000100:00100000:1.0:1788843386.308988:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1dc6aed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+12:7436:x1875738134321024:12345-0@lo:503: Request processed in 81us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843386.309002:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788843386.309042:0:7436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b347c484 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134321024:0@lo:503: 00000040:00080000:1.0:1788843386.309389:0:7436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788843386.309464:0:7436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e41d69f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134321152:0@lo:502: 00000100:00100000:1.0:1788843386.309505:0:7436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843386.309648:0:7436:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b4b18823 going to sleep for 11 seconds 00000100:00100000:1.0:1788843386.309672:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134321152 00000100:00100000:1.0:1788843386.309677:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134321152 00000100:00100000:1.0:1788843386.309711:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788843386.309717:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000667054c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+12:7436:x1875738134321152:12345-0@lo:502: 00000100:00100000:1.0:1788843386.309795:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000667054c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+12:7436:x1875738134321152:12345-0@lo:502: Request processed in 78us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843386.309802:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788843386.309838:0:7436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e41d69f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134321152:0@lo:502: 00000040:00080000:1.0:1788843386.310053:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788843386.310076:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1788843386.310087:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1788843386.310098:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1788843386.310108:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1788843386.310119:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1788843386.310131:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1788843386.310175:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1788843386.310189:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1788843386.310200:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1788843386.310211:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1788843386.310222:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1788843386.310233:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1788843386.310243:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1788843386.310271:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1788843386.310284:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1788843386.310296:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1788843386.310425:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1788843386.310438:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1788843386.310449:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1788843386.310460:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1788843386.310474:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1788843386.310487:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1788843386.310517:0:7436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e41d69f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134321280:0@lo:502: 00000100:00100000:1.0:1788843386.310566:0:7436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843386.310605:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134321280 00000100:00100000:1.0:1788843386.310612:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134321280 00000100:00100000:1.0:1788843386.310647:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788843386.310655:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad3cc21b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+12:7436:x1875738134321280:12345-0@lo:502: 00000100:00100000:1.0:1788843386.310736:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad3cc21b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+12:7436:x1875738134321280:12345-0@lo:502: Request processed in 82us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843386.310743:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788843386.310775:0:7436:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b4b18823 going to sleep for 11 seconds 00000100:00100000:1.0:1788843386.310788:0:7436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e41d69f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134321280:0@lo:502: 00000040:00080000:1.0:1788843386.310822:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:1.0:1788843386.310828:0:7436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:1.0:1788843386.312012:0:7449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843386.312033:0:7449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843386.312036:0:7449:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788843386.312041:0:7449:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788843386.312044:0:7449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788843386.312062:0:7449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000fcfac5e6) 00000020:00000080:1.0:1788843386.312087:0:7449:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1788843386.312093:0:7449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788843386.312540:0:7449:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788843386.312552:0:7449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa762dfcbd58d0c70 00000020:00000080:1.0:1788843386.312810:0:7449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788843386.312815:0:7449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843386.312819:0:7449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843386.312820:0:7449:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788843386.312823:0:7449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843386.312826:0:7449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843386.312828:0:7449:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788843386.312831:0:7449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788843386.312848:0:7449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000621f0ae5) 00000020:00000080:1.0:1788843386.312861:0:7449:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1788843386.312867:0:7449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788843386.312869:0:7449:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788843386.312871:0:7449:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788843386.312878:0:7449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788843386.312929:0:7449:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000bc3c4cc9 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788843386.312943:0:7449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000006aa8b52f) 00000020:00000080:1.0:1788843386.312952:0:7449:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1788843386.313034:0:7449:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788843386.313523:0:7449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa762dfcbd58d0c85 00000020:00000080:1.0:1788843386.313816:0:7449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788843386.313824:0:7449:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788843386.313830:0:7449:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xa762dfcbd58d0c8c 00080000:01000000:1.0:1788843386.313836:0:7449:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788843386.313840:0:7449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa762dfcbd58d0c93 00080000:10000000:1.0:1788843386.314879:0:7449:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1788843386.315046:0:7449:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:0.0:1788843386.458793:0:7449:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:0.0:1788843386.459175:0:7449:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:0.0:1788843386.464038:0:7449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1788843386.464594:0:7449:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788843386.488048:0:7449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788843386.488069:0:7449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843386.488080:0:7449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843386.488083:0:7449:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788843386.488087:0:7449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843386.488110:0:7449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843386.488112:0:7449:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788843386.488116:0:7449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788843386.488122:0:7449:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.133@tcp to nid 0x20000c0a8cb85 (192.168.203.133@tcp) 00000020:00000080:1.0:1788843386.488181:0:7449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788843386.488203:0:7449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000e9a8434a) 00000020:00000080:1.0:1788843386.488236:0:7449:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1788843386.488241:0:7449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788843386.488337:0:7449:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788843386.488344:0:7449:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788843386.488351:0:7449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa762dfcbd58d0ca1 00010000:00080000:1.0:1788843386.488407:0:7449:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000010117950@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.133@tcp at head 00010000:00010000:1.0:1788843386.505134:0:7449:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1788843386.510715:0:7449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788843386.510736:0:7449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788843386.510790:0:7449:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788843386.510817:0:7449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa762dfcbd58d0ca8 00000100:00080000:1.0:1788843386.510831:0:7449:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788843386.510837:0:7449:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 0000000010117950 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:1.0:1788843386.510885:0:7449:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002e41d69f x1875738134321408/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788843386.510928:0:7449:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788843386.511004:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e41d69f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134321408:0@lo:38: 00000020:01000000:1.0:1788843386.511036:0:7449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843386.511040:0:7449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843386.511042:0:7449:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1788843386.511044:0:7449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788843386.511048:0:7449:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788843386.511049:0:7449:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788843386.511051:0:7449:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788843386.511053:0:7449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788843386.511054:0:7449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843386.511061:0:7449:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788843386.511064:0:7449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843386.511069:0:7449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843386.511071:0:7449:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1788843386.511074:0:7449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788843386.511100:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:01000000:1.0:1788843386.511108:0:7449:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788843386.511119:0:7449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843386.511121:0:7449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843386.511123:0:7449:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1788843386.511124:0:7449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843386.511126:0:7449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843386.511127:0:7449:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788843386.511129:0:7449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788843386.511132:0:7449:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788843386.511188:0:7449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843386.511192:0:7449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843386.511193:0:7449:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788843386.511196:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:3.0:1788843386.511307:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134321408 00000100:00100000:3.0:1788843386.511317:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134321408 00000100:00100000:3.0:1788843386.511350:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788843386.511359:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ae73b7b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3629:x1875738134321408:12345-0@lo:38: 00010000:00080000:3.0:1788843386.511385:0:6511:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:3.0:1788843386.511441:0:6511:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa762dfcbd58d0caf 00000004:00100000:3.0:1788843386.511476:0:6511:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788843386.511488:0:6511:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1788843386.511562:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788843386.511572:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000057fae9f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134321536:0@lo:400: 00000100:00100000:3.0:1788843386.511609:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843386.511654:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134321536 00000100:00100000:3.0:1788843386.511658:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134321536 00000100:00100000:3.0:1788843386.511692:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788843386.511710:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f03c15b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134321536:12345-0@lo:400: 00000100:00100000:3.0:1788843386.511761:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f03c15b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134321536:12345-0@lo:400: Request processed in 63us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843386.511768:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788843386.511815:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000057fae9f7 x1875738134321536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843386.511829:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000057fae9f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134321536:0@lo:400: 00000020:01000000:2.0:1788843386.512292:0:7436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:2.0:1788843386.512345:0:7436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788843386.512365:0:7436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: 00000000c1313e95/0xa762dfcbd58d0c5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0c62 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843386.512377:0:7436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: 00000000c1313e95/0xa762dfcbd58d0c5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0c62 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843386.512400:0:7436:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd12e2b3800 from 1 10000000:01000000:2.0:1788843386.512403:0:7436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788843386.512437:0:7436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: 000000008f609f87/0xa762dfcbd58d0cb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843386.512444:0:7436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: 000000008f609f87/0xa762dfcbd58d0cb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843386.512452:0:7436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: 000000008f609f87/0xa762dfcbd58d0cb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843386.512824:0:7436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef04ba14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134321664:0@lo:101: 00000100:00100000:2.0:1788843386.512908:0:7436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843386.512949:0:7436:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a95cb2c4 going to sleep for 11 seconds 00000100:00100000:1.0:1788843386.513396:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134321664 00000100:00100000:1.0:1788843386.513407:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134321664 00000100:00100000:1.0:1788843386.513462:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788843386.513471:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe1b4f8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+12:7436:x1875738134321664:12345-0@lo:101: 00010000:00010000:1.0:1788843386.513488:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843386.513505:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000239018ee/0xa762dfcbd58d0cbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0cb6 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843386.513535:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000239018ee/0xa762dfcbd58d0cbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0cb6 expref: 13 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843386.513545:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000239018ee/0xa762dfcbd58d0cbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0cb6 expref: 13 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843386.513571:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000239018ee, rc 0) 00000100:00100000:1.0:1788843386.513646:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe1b4f8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+13:7436:x1875738134321664:12345-0@lo:101: Request processed in 176us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843386.513653:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788843386.514101:0:7436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef04ba14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134321664:0@lo:101: 00010000:00010000:3.0:1788843386.514121:0:7436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: 000000008f609f87/0xa762dfcbd58d0cb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0cbd expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.514130:0:7436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: 000000008f609f87/0xa762dfcbd58d0cb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0cbd expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843386.515597:0:7436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000057fae9f7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134321792:0@lo:256: 00000100:00100000:3.0:1788843386.515709:0:7436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843386.515760:0:7436:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b601dbaf going to sleep for 11 seconds 00000100:00100000:1.0:1788843386.518203:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134321792 00000100:00100000:1.0:1788843386.518226:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134321792 00000100:00100000:1.0:1788843386.518321:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788843386.518332:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee269c9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+13:7436:x1875738134321792:12345-0@lo:256: 20000000:01000000:1.0:1788843386.518365:0:6498:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788843386.518398:0:6498:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788843386.518401:0:6498:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788843386.518561:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee269c9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+13:7436:x1875738134321792:12345-0@lo:256: Request processed in 231us (2862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843386.518569:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788843386.519649:0:7436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000057fae9f7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134321792:0@lo:256: 10000000:01000000:3.0:1788843386.520689:0:7436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000100:00080000:1.0:1788843386.522394:0:6511:0:(import.c:65:import_set_state_nolock()) 000000006f91f82b : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843386.522534:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ae73b7b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3629:x1875738134321408:12345-0@lo:38: Request processed in 11172us (11431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843386.522551:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788843386.522776:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788843386.522790:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788843386.522801:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788843386.522807:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788843386.522810:0:3629:0:(import.c:65:import_set_state_nolock()) 0000000010117950 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788843386.522831:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e41d69f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134321408:0@lo:38: 00000100:00100000:0.0:1788843386.523107:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000096d9179a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134321920:0@lo:41: 00000100:00100000:0.0:1788843386.523189:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843386.523331:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134321920 00000100:00100000:1.0:1788843386.523340:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134321920 00000100:00100000:1.0:1788843386.523393:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788843386.523404:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000061d970ea pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3630:x1875738134321920:12345-0@lo:41: 00000004:00000024:1.0:1788843386.523440:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1788843386.523487:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000061d970ea pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3630:x1875738134321920:12345-0@lo:41: Request processed in 85us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843386.523494:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788843386.523546:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000096d9179a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134321920:0@lo:41: 00010000:00010000:3.0:1788843386.525113:0:7436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: 000000008f609f87/0xa762dfcbd58d0cb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0cbd expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.525131:0:7436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: 000000008f609f87/0xa762dfcbd58d0cb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0cbd expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843386.525187:0:7436:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd12e2b3800 from 1 10000000:01000000:3.0:1788843386.525191:0:7436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788843386.525242:0:7436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: 000000000264e066/0xa762dfcbd58d0cc4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.525250:0:7436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: 000000000264e066/0xa762dfcbd58d0cc4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.525260:0:7436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: 000000000264e066/0xa762dfcbd58d0cc4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843386.525285:0:7436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000057fae9f7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134322048:0@lo:101: 00000100:00100000:3.0:1788843386.525360:0:7436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843386.525404:0:7436:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b601dbaf going to sleep for 11 seconds 00000100:00100000:1.0:1788843386.525438:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134322048 00000100:00100000:1.0:1788843386.525447:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134322048 00000100:00100000:1.0:1788843386.525501:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788843386.525510:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008433e427 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+13:7436:x1875738134322048:12345-0@lo:101: 00010000:00010000:1.0:1788843386.525527:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843386.525542:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000027231346/0xa762dfcbd58d0ccb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0cc4 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843386.525569:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000027231346/0xa762dfcbd58d0ccb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0cc4 expref: 14 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843386.525578:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000027231346/0xa762dfcbd58d0ccb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0cc4 expref: 14 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843386.525588:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000027231346, rc 0) 00000100:00100000:1.0:1788843386.525628:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008433e427 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+14:7436:x1875738134322048:12345-0@lo:101: Request processed in 119us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843386.525645:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788843386.527391:0:7436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000057fae9f7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134322048:0@lo:101: 00010000:00010000:3.0:1788843386.527425:0:7436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: 000000000264e066/0xa762dfcbd58d0cc4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0ccb expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.527439:0:7436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: 000000000264e066/0xa762dfcbd58d0cc4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0ccb expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843386.527645:0:7436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000057fae9f7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134322176:0@lo:501: 00000100:00100000:3.0:1788843386.528250:0:7436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843386.528303:0:7436:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b601dbaf going to sleep for 11 seconds 00000100:00100000:1.0:1788843386.528318:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134322176 00000100:00100000:1.0:1788843386.528328:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134322176 00000100:00100000:1.0:1788843386.528387:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788843386.528396:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf636529 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+14:7436:x1875738134322176:12345-0@lo:501: 00000100:00100000:1.0:1788843386.528542:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf636529 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+14:7436:x1875738134322176:12345-0@lo:501: Request processed in 147us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843386.528550:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788843386.529654:0:7436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000057fae9f7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134322176:0@lo:501: 00000100:00100000:3.0:1788843386.529732:0:7436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000057fae9f7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134322304:0@lo:503: 00000100:00100000:3.0:1788843386.529801:0:7436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843386.529978:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134322304 00000100:00100000:2.0:1788843386.529986:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134322304 00000100:00100000:2.0:1788843386.530040:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788843386.530050:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028ee39cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+14:7436:x1875738134322304:12345-0@lo:503: 00000040:00080000:2.0:1788843386.530099:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788843386.530185:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028ee39cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+14:7436:x1875738134322304:12345-0@lo:503: Request processed in 136us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843386.530192:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788843386.530337:0:7436:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b601dbaf going to sleep for 11 seconds 00000100:00100000:3.0:1788843386.530356:0:7436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000057fae9f7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134322304:0@lo:503: 00000040:00080000:3.0:1788843386.531827:0:7436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788843386.532100:0:7436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:3.0:1788843386.532252:0:7436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788843386.547282:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:3.0:1788843386.548025:0:7436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788843386.548068:0:7436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788843386.548095:0:7436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: 000000000264e066/0xa762dfcbd58d0cc4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0ccb expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.548111:0:7436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: 000000000264e066/0xa762dfcbd58d0cc4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0ccb expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843386.548200:0:7436:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788843386.548204:0:7436:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bd12e2b3800 10000000:01000000:3.0:1788843386.548208:0:7436:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bd12e2b3800 10000000:01000000:3.0:1788843386.548212:0:7436:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788843386.548219:0:7436:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd12e2b3800 from 1 10000000:01000000:3.0:1788843386.548223:0:7436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788843386.548291:0:7436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: 0000000061736d92/0xa762dfcbd58d0cd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.548305:0:7436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: 0000000061736d92/0xa762dfcbd58d0cd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.548318:0:7436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: 0000000061736d92/0xa762dfcbd58d0cd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843386.548349:0:7436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000057fae9f7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134322432:0@lo:101: 00000100:00100000:3.0:1788843386.548448:0:7436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843386.548526:0:7436:0:(client.c:2715:ptlrpc_set_wait()) set 000000001ed4ca6d going to sleep for 11 seconds 00000100:00100000:2.0:1788843386.548605:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134322432 00000100:00100000:2.0:1788843386.548615:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134322432 00000100:00100000:2.0:1788843386.548685:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788843386.548698:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002b39c75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+14:7436:x1875738134322432:12345-0@lo:101: 00010000:00010000:2.0:1788843386.548717:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843386.548746:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000436b382/0xa762dfcbd58d0cd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0cd2 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843386.548775:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000436b382/0xa762dfcbd58d0cd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0cd2 expref: 15 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843386.548787:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000436b382/0xa762dfcbd58d0cd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0cd2 expref: 15 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843386.548797:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000436b382, rc 0) 00000100:00100000:2.0:1788843386.548857:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002b39c75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:7436:x1875738134322432:12345-0@lo:101: Request processed in 162us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843386.548864:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788843386.553074:0:7436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000057fae9f7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134322432:0@lo:101: 00010000:00010000:3.0:1788843386.553115:0:7436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: 0000000061736d92/0xa762dfcbd58d0cd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0cd9 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.553131:0:7436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: 0000000061736d92/0xa762dfcbd58d0cd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0cd9 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843386.553335:0:7436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000057fae9f7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134322560:0@lo:501: 00000100:00100000:3.0:1788843386.553413:0:7436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843386.553471:0:7436:0:(client.c:2715:ptlrpc_set_wait()) set 000000001ed4ca6d going to sleep for 11 seconds 00000100:00100000:2.0:1788843386.553780:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134322560 00000100:00100000:2.0:1788843386.553789:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134322560 00000100:00100000:2.0:1788843386.553853:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788843386.553863:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d3f2a1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:7436:x1875738134322560:12345-0@lo:501: 00000100:00100000:2.0:1788843386.554022:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d3f2a1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:7436:x1875738134322560:12345-0@lo:501: Request processed in 161us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843386.554031:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788843386.554294:0:7436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000057fae9f7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134322560:0@lo:501: 00000100:00100000:3.0:1788843386.554338:0:7436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000057fae9f7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134322688:0@lo:503: 00000100:00100000:3.0:1788843386.554391:0:7436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843386.554455:0:7436:0:(client.c:2715:ptlrpc_set_wait()) set 000000001ed4ca6d going to sleep for 11 seconds 00000100:00100000:1.0:1788843386.554599:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134322688 00000100:00100000:1.0:1788843386.554611:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134322688 00000100:00100000:1.0:1788843386.554701:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788843386.554709:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3f5b8cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:7436:x1875738134322688:12345-0@lo:503: 00000100:00100000:1.0:1788843386.554815:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3f5b8cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:7436:x1875738134322688:12345-0@lo:503: Request processed in 108us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843386.554822:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788843386.554887:0:7436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000057fae9f7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134322688:0@lo:503: 00000040:00080000:3.0:1788843386.555246:0:7436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788843386.555328:0:7436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000057fae9f7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134322816:0@lo:502: 00000100:00100000:3.0:1788843386.555367:0:7436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843386.562224:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134322816 00000100:00100000:2.0:1788843386.562250:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134322816 00000100:00100000:3.0:1788843386.562266:0:7436:0:(client.c:2715:ptlrpc_set_wait()) set 000000001ed4ca6d going to sleep for 11 seconds 00000100:00100000:2.0:1788843386.562450:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788843386.562466:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f008cc15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:7436:x1875738134322816:12345-0@lo:502: 00000100:00100000:2.0:1788843386.562722:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f008cc15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:7436:x1875738134322816:12345-0@lo:502: Request processed in 259us (7354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843386.562731:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788843386.563732:0:7436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000057fae9f7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134322816:0@lo:502: 00000040:00080000:3.0:1788843386.564046:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788843386.564081:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788843386.564098:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788843386.564113:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788843386.564126:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788843386.564160:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788843386.564180:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788843386.564195:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788843386.564208:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788843386.564221:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788843386.564238:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788843386.564253:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788843386.564286:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788843386.564303:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788843386.564317:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788843386.564332:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788843386.564346:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788843386.564358:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788843386.564372:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788843386.564386:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788843386.564401:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788843386.564415:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788843386.564430:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788843386.564444:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788843386.564458:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788843386.564471:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788843386.564501:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788843386.564529:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1788843386.564589:0:7436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000057fae9f7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134322944:0@lo:502: 00000100:00100000:3.0:1788843386.564687:0:7436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843386.564749:0:7436:0:(client.c:2715:ptlrpc_set_wait()) set 000000001ed4ca6d going to sleep for 11 seconds 00000100:00100000:2.0:1788843386.564768:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134322944 00000100:00100000:2.0:1788843386.564779:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134322944 00000100:00100000:2.0:1788843386.564846:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788843386.564855:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb46c631 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:7436:x1875738134322944:12345-0@lo:502: 00000100:00100000:2.0:1788843386.565004:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb46c631 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:7436:x1875738134322944:12345-0@lo:502: Request processed in 149us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843386.565012:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788843386.568116:0:7436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000057fae9f7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134322944:0@lo:502: 00000040:00080000:3.0:1788843386.568270:0:7436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788843386.568288:0:7436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788843386.569325:0:7455:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1788843386.569344:0:7455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000005edc23cf) 00000020:00000080:3.0:1788843386.569371:0:7455:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788843386.569573:0:7455:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000bc3c4cc9 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788843386.569577:0:7455:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000bc3c4cc9 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788843386.569580:0:7455:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000bc3c4cc9 3 00010000:00080000:3.0:1788843386.569616:0:7455:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000091019393@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.133@tcp at head 00010000:00010000:2.0:1788843386.573680:0:7455:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:2.0:1788843386.574394:0:7455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788843386.574455:0:7455:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788843386.574481:0:7455:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xa762dfcbd58d0ce7 00000100:00080000:2.0:1788843386.574494:0:7455:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788843386.574503:0:7455:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 0000000091019393 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:2.0:1788843386.574552:0:7455:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000950bb93b x1875738134323072/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788843386.574584:0:7455:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788843386.574699:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000950bb93b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875738134323072:0@lo:38: 00000100:00100000:0.0:1788843386.574786:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788843386.574885:0:7455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:2.0:1788843386.575023:0:7456:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:0.0:1788843386.575423:0:7436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788843386.575459:0:7436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:1.0:1788843386.575482:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134323072 00000100:00100000:1.0:1788843386.575493:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134323072 00000100:00100000:1.0:1788843386.575539:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788843386.575547:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fef1254b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3629:x1875738134323072:12345-0@lo:38: 00010000:00080000:1.0:1788843386.575578:0:6507:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:1.0:1788843386.575614:0:6507:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xa762dfcbd58d0cee 00000004:00100000:1.0:1788843386.575641:0:6507:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788843386.575679:0:6507:0:(import.c:65:import_set_state_nolock()) 00000000e8eadb21 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843386.577064:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fef1254b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1875738134323072:12345-0@lo:38: Request processed in 1508us (2269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843386.577078:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788843386.577501:0:7436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: 0000000061736d92/0xa762dfcbd58d0cd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0cd9 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843386.577533:0:7436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: 0000000061736d92/0xa762dfcbd58d0cd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0cd9 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788843386.577604:0:7436:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788843386.577607:0:7436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788843386.577608:0:7436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788843386.577610:0:7436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788843386.577611:0:7436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788843386.577613:0:7436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788843386.577614:0:7436:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788843386.577616:0:7436:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788843386.577617:0:7436:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788843386.577619:0:7436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788843386.577620:0:7436:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788843386.577625:0:7436:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1788843386.577628:0:7436:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788843386.577629:0:7436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788843386.577630:0:7436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788843386.577641:0:7436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788843386.577642:0:7436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788843386.577643:0:7436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788843386.577644:0:7436:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788843386.577645:0:7436:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788843386.577646:0:7436:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788843386.577647:0:7436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788843386.577648:0:7436:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788843386.577680:0:7436:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00010000:00080000:1.0:1788843386.578119:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000950bb93b x1875738134323072/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788843396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843386.578284:0:7436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ecfdd926 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134323200:0@lo:253: 00000100:00100000:0.0:1788843386.578367:0:7436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843386.578427:0:7436:0:(client.c:2715:ptlrpc_set_wait()) set 000000003438699c going to sleep for 11 seconds 00000100:00100000:3.0:1788843386.578504:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134323200 00000100:00100000:3.0:1788843386.578513:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134323200 00000100:00100000:1.0:1788843386.578515:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788843386.578528:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788843386.578537:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788843386.578542:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788843386.578546:0:3629:0:(import.c:65:import_set_state_nolock()) 0000000091019393 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788843386.578554:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000950bb93b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875738134323072:0@lo:38: 00000100:00100000:3.0:1788843386.578562:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788843386.578570:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004e6d13e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:7436:x1875738134323200:12345-0@lo:253: 20000000:01000000:3.0:1788843386.578602:0:6501:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788843386.578644:0:6501:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1788843386.581690:0:6485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788843386.581777:0:6501:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788843386.581801:0:6501:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788843386.582214:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004e6d13e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:7436:x1875738134323200:12345-0@lo:253: Request processed in 3638us (3842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843386.582229:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788843386.582375:0:7436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ecfdd926 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:7436:1875738134323200:0@lo:253: 10000000:01000000:1.0:1788843386.582405:0:7436:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788843386.582409:0:7436:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788843386.582411:0:7436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788843386.582412:0:7436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788843386.582413:0:7436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788843386.582415:0:7436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788843386.582416:0:7436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788843386.582417:0:7436:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788843386.582419:0:7436:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788843386.582420:0:7436:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788843386.582422:0:7436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788843386.582423:0:7436:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788843386.582443:0:7436:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1788843386.583194:0:6522:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788843386.583204:0:6522:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788843386.583230:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000300a913f/0xa762dfcbd58d0cf5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843386.583259:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ac962e58/0xa762dfcbd58d0c15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0c0e expref: 14 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843386.583266:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000239018ee/0xa762dfcbd58d0cbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0cb6 expref: 14 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843386.583274:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000300a913f/0xa762dfcbd58d0cf5 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843386.583331:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000239018ee/0xa762dfcbd58d0cbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0cb6 expref: 14 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843386.583349:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000239018ee/0xa762dfcbd58d0cbd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0cb6 expref: 14 pid: 6501 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843386.583364:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e8201b4 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6522:1875738134323328:0@lo:104: 00000100:00100000:0.0:1788843386.583426:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788843386.588062:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ac962e58/0xa762dfcbd58d0c15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0c0e expref: 14 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843386.588088:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ac962e58/0xa762dfcbd58d0c15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0c0e expref: 14 pid: 6498 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843386.588107:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000025d99345 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6522:1875738134323456:0@lo:104: 00000100:00100000:0.0:1788843386.590661:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843386.590717:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set 000000004981d1f3 going to sleep for 11 seconds 00000100:00100000:3.0:1788843386.590803:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134323328 00000100:00100000:3.0:1788843386.590813:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134323328 00000100:00100000:3.0:1788843386.590870:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134323456 00000100:00100000:3.0:1788843386.590874:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134323456 00000100:00100000:3.0:1788843386.591414:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788843386.591425:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070da4efc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+4:6522:x1875738134323328:12345-0@lo:104: 00010000:00010000:3.0:1788843386.591445:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: 000000008f609f87/0xa762dfcbd58d0cb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0cbd expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.592018:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788843386.592025:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070da4efc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+4:6522:x1875738134323328:12345-0@lo:104: Request processed in 603us (8600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843386.592034:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788843386.592058:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788843386.592065:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9ddd8dc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+3:6522:x1875738134323456:12345-0@lo:104: 00010000:00010000:3.0:1788843386.592072:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: 00000000494f29b7/0xa762dfcbd58d0c0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0c15 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.592103:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788843386.592107:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9ddd8dc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+3:6522:x1875738134323456:12345-0@lo:104: Request processed in 45us (1455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843386.592112:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788843386.592164:0:6495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788843386.592171:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: 000000008f609f87/0xa762dfcbd58d0cb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0cbd expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.592179:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008f609f87 already unused, calling callback (0000000065690e96) 10000000:00010000:3.0:1788843386.592182:0:6495:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: 000000008f609f87/0xa762dfcbd58d0cb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0cbd expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.592192:0:6495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: 000000008f609f87/0xa762dfcbd58d0cb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0cbd expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843386.592212:0:6495:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: 000000008f609f87/0xa762dfcbd58d0cb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0cbd expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843386.592218:0:6495:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788843386.592261:0:6495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: 000000008f609f87/0xa762dfcbd58d0cb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0cbd expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.592268:0:6495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843386.592286:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: 000000008f609f87/0xa762dfcbd58d0cb6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0cbd expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.592292:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: 000000008f609f87/0xa762dfcbd58d0cb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0cbd expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843386.592604:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843386.592622:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000057fae9f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134323584:0@lo:103: 00000100:00100000:1.0:1788843386.592685:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843386.592736:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134323584 00000100:00100000:1.0:1788843386.592744:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134323584 00010000:00010000:1.0:1788843386.592771:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000239018ee/0xa762dfcbd58d0cbd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0cb6 expref: 15 pid: 6501 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843386.592796:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788843386.592801:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096d9179a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:3630:x1875738134323584:12345-0@lo:103: 00010000:00010000:1.0:1788843386.592814:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843386.592818:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000239018ee/0xa762dfcbd58d0cbd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0cb6 expref: 15 pid: 6501 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843386.592828:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000239018ee/0xa762dfcbd58d0cbd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0cb6 expref: 15 pid: 6501 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843386.592849:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843386.592876:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096d9179a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:3630:x1875738134323584:12345-0@lo:103: Request processed in 75us (191us total) trans 0 rc 0/0 00010000:00010000:3.0:1788843386.593664:0:6495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843386.593672:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: 00000000494f29b7/0xa762dfcbd58d0c0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0c15 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.593682:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000494f29b7 already unused, calling callback (0000000065690e96) 10000000:00010000:3.0:1788843386.593686:0:6495:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: 00000000494f29b7/0xa762dfcbd58d0c0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0c15 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.593693:0:6495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: 00000000494f29b7/0xa762dfcbd58d0c0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0c15 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843386.593699:0:6495:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: 00000000494f29b7/0xa762dfcbd58d0c0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0c15 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843386.593706:0:6495:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788843386.593769:0:6495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: 00000000494f29b7/0xa762dfcbd58d0c0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0c15 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.593776:0:6495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843386.593798:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: 00000000494f29b7/0xa762dfcbd58d0c0e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0c15 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.593805:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: 00000000494f29b7/0xa762dfcbd58d0c0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0c15 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843386.593818:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843386.593820:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843386.593821:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843386.593830:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843386.593850:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000339cf5aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134323712:0@lo:103: 00000100:00100000:1.0:1788843386.593996:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788843386.594452:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000057fae9f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134323584:0@lo:103: 00000100:00100000:3.0:1788843386.595022:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788843386.595422:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000239018ee/0xa762dfcbd58d0cbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0cb6 expref: 14 pid: 6501 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843386.595443:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e8201b4 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6522:1875738134323328:0@lo:104: 00000100:00100000:1.0:1788843386.595456:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000025d99345 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6522:1875738134323456:0@lo:104: 00010000:00010000:1.0:1788843386.595480:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000300a913f/0xa762dfcbd58d0cf5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843386.595673:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134323712 00000100:00100000:2.0:1788843386.595682:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134323712 00010000:00010000:2.0:1788843386.595716:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ac962e58/0xa762dfcbd58d0c15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0c0e expref: 14 pid: 6498 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843386.595756:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788843386.595766:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea38eef8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e79d9884-ba2e-42e7-accb-b4784b9c1837+14:3632:x1875738134323712:12345-0@lo:103: 00010000:00010000:2.0:1788843386.595785:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843386.595789:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ac962e58/0xa762dfcbd58d0c15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0c0e expref: 14 pid: 6498 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843386.595801:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ac962e58/0xa762dfcbd58d0c15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0c0e expref: 14 pid: 6498 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843386.595830:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ac962e58/0xa762dfcbd58d0c15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0c0e expref: 14 pid: 6498 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843386.595847:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000300a913f/0xa762dfcbd58d0cf5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843386.595855:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000300a913f/0xa762dfcbd58d0cf5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788843386.595872:0:6493:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012670048s 00010000:00010000:2.0:1788843386.595876:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000300a913f/0xa762dfcbd58d0cf5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843386.595884:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000300a913f/0xa762dfcbd58d0cf5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1788843386.596109:0:7436:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00010000:00010000:2.0:1788843386.596411:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000300a913f/0xa762dfcbd58d0cf5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843386.596417:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000300a913f/0xa762dfcbd58d0cf5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843386.596423:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000300a913f already unused, calling callback (00000000f1e7cbc1) 00010000:00010000:2.0:1788843386.596427:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000300a913f/0xa762dfcbd58d0cf5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843386.596436:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000300a913f/0xa762dfcbd58d0cf5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843386.596453:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000300a913f/0xa762dfcbd58d0cf5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843386.596478:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843386.596647:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea38eef8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e79d9884-ba2e-42e7-accb-b4784b9c1837+13:3632:x1875738134323712:12345-0@lo:103: Request processed in 882us (1627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843386.596658:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788843386.596747:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000339cf5aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134323712:0@lo:103: 00010000:00010000:1.0:1788843386.597002:0:6522:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000300a913f/0xa762dfcbd58d0cf5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843386.597012:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000300a913f/0xa762dfcbd58d0cf5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843386.597017:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000300a913f/0xa762dfcbd58d0cf5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788843386.598565:0:7436:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788843386.599366:0:7436:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1788843386.599587:0:7436:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788843386.599830:0:7436:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1788843386.600012:0:7436:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1788843386.604235:0:7436:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1788843386.604832:0:7436:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1788843386.605077:0:7436:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1788843386.605829:0:7436:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1788843386.606069:0:7436:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:3.0:1788843386.606283:0:7436:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:1.0:1788843386.610724:0:7436:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1788843386.610833:0:7460:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1788843386.610839:0:7460:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788843386.611573:0:7461:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1788843386.611656:0:7461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000071459dfd pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7461:1875738134323840:0@lo:700: 00000100:00100000:3.0:1788843386.611749:0:7461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843386.611810:0:7461:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c6dd258f going to sleep for 11 seconds 00000100:00100000:0.0:1788843386.611873:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134323840 00000100:00100000:0.0:1788843386.611883:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134323840 00000100:00100000:0.0:1788843386.611949:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788843386.611959:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039a0bc27 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7461:x1875738134323840:12345-0@lo:700: 00000040:01000000:1.0:1788843386.612555:0:7436:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1788843386.613077:0:7462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f51c3fc7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7462:1875738134323968:0@lo:1000: 00000100:00100000:2.0:1788843386.613578:0:7462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843386.613681:0:7462:0:(client.c:2715:ptlrpc_set_wait()) set 000000007fb7bb96 going to sleep for 11 seconds 00000040:01000000:1.0:1788843386.614049:0:7436:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788843386.614220:0:7436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788843386.614795:0:7436:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788843386.614805:0:7436:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788843386.614959:0:7436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788843386.617717:0:7436:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 40000000:02000000:0.0:1788843386.618670:0:6513:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:3.0:1788843386.619769:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134323968 00000100:00100000:3.0:1788843386.619787:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134323968 00000100:00100000:3.0:1788843386.619869:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788843386.619880:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b696af05 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7462:x1875738134323968:12345-0@lo:1000: 00000040:00080000:1.0:1788843386.621463:0:7436:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000100:00100000:3.0:1788843386.621643:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b696af05 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7462:x1875738134323968:12345-0@lo:1000: Request processed in 1752us (8053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843386.621655:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788843386.621794:0:7462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f51c3fc7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7462:1875738134323968:0@lo:1000: 00000040:01000000:2.0:1788843386.621842:0:7462:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:2.0:1788843386.621974:0:7462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f51c3fc7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7462:1875738134324096:0@lo:700: 00000100:00100000:2.0:1788843386.622033:0:7462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843386.622081:0:7462:0:(client.c:2715:ptlrpc_set_wait()) set 0000000092ef88c7 going to sleep for 11 seconds 00000100:00100000:3.0:1788843386.622398:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134324096 00000100:00100000:3.0:1788843386.622406:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134324096 00000100:00100000:3.0:1788843386.622461:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788843386.622470:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e5b2246 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7462:x1875738134324096:12345-0@lo:700: 00000040:01000000:1.0:1788843386.622692:0:7436:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:3.0:1788843386.623718:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e5b2246 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7462:x1875738134324096:12345-0@lo:700: Request processed in 1243us (1678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843386.623731:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788843386.623933:0:7462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f51c3fc7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7462:1875738134324096:0@lo:700: 00000100:00100000:2.0:1788843386.624022:0:7462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f51c3fc7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7462:1875738134324224:0@lo:900: 00000100:00100000:2.0:1788843386.624070:0:7462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843386.624106:0:7462:0:(client.c:2715:ptlrpc_set_wait()) set 0000000092ef88c7 going to sleep for 11 seconds 00000100:00100000:1.0:1788843386.624280:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134324224 00000100:00100000:1.0:1788843386.624288:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134324224 00000100:00100000:1.0:1788843386.624344:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788843386.624352:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d41994f pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7462:x1875738134324224:12345-0@lo:900: 00000100:00100000:1.0:1788843386.624401:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d41994f pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7462:x1875738134324224:12345-0@lo:900: Request processed in 50us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843386.624407:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788843386.624712:0:7462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f51c3fc7 x1875738134324224/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788843402 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843386.624724:0:7462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f51c3fc7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7462:1875738134324224:0@lo:900: 00000100:00100000:2.0:1788843386.624811:0:7462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f51c3fc7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7462:1875738134324352:0@lo:1000: 00000100:00100000:2.0:1788843386.624846:0:7462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843386.624880:0:7462:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b3ebe34d going to sleep for 11 seconds 00000100:00100000:3.0:1788843386.625013:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134324352 00000100:00100000:3.0:1788843386.625018:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134324352 00000100:00100000:3.0:1788843386.625058:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788843386.625065:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008dbaaf6a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7462:x1875738134324352:12345-0@lo:1000: 00000100:00100000:3.0:1788843386.625138:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008dbaaf6a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7462:x1875738134324352:12345-0@lo:1000: Request processed in 73us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843386.625169:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:1.0:1788843386.625670:0:7436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788843386.626036:0:7462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f51c3fc7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7462:1875738134324352:0@lo:1000: 00000004:00080000:2.0:1788843386.626099:0:7462:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000092ef88c7 with version 0 00000020:00100000:2.0:1788843386.626120:0:7462:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788843386.626129:0:7462:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000f51c3fc7 x1875738134324608/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788843386.626177:0:7462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f51c3fc7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7462:1875738134324608:0@lo:1000: 00000100:00100000:2.0:1788843386.626223:0:7462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843386.626249:0:7462:0:(client.c:2715:ptlrpc_set_wait()) set 0000000040924c1b going to sleep for 11 seconds 00000100:00100000:3.0:1788843386.626610:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134324608 00000100:00100000:3.0:1788843386.626617:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134324608 00000100:00100000:3.0:1788843386.626669:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788843386.626678:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078ed823c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7462:x1875738134324608:12345-0@lo:1000: 00080000:10000000:1.0:1788843386.628125:0:7436:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1788843386.631795:0:7436:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788843386.633300:0:7436:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788843386.633474:0:7436:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00000001:00080000:2.0:1788843386.638388:0:6485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00100000:10000000:1.0:1788843386.638509:0:7436:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788843386.638823:0:7436:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788843386.639056:0:7436:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788843386.639220:0:7436:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788843386.639365:0:7436:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788843386.639540:0:7436:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788843386.639691:0:7436:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788843386.639842:0:7436:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788843386.639974:0:7436:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788843386.640137:0:7436:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788843386.640327:0:7436:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788843386.640478:0:7436:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788843386.640624:0:7436:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00000100:00100000:0.0:1788843386.641437:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039a0bc27 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7461:x1875738134323840:12345-0@lo:700: Request processed in 29471us (29680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843386.641453:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788843386.644104:0:7461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000071459dfd x1875738134323840/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788843402 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843386.644130:0:7461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000071459dfd pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7461:1875738134323840:0@lo:700: 40000000:02000000:0.0:1788843386.644166:0:7461:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000100:00100000:3.0:1788843386.645865:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078ed823c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7462:x1875738134324608:12345-0@lo:1000: Request processed in 19177us (19630us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788843386.645883:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:2.0:1788843386.647206:0:7462:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1788843386.647214:0:7462:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788843386.647234:0:7462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f51c3fc7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7462:1875738134324608:0@lo:1000: 00000100:00100000:2.0:1788843386.647338:0:7462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f51c3fc7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7462:1875738134324736:0@lo:1000: 00000100:00100000:2.0:1788843386.647401:0:7462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843386.647452:0:7462:0:(client.c:2715:ptlrpc_set_wait()) set 000000007fb7bb96 going to sleep for 11 seconds 00000100:00100000:3.0:1788843386.647584:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134324736 00000100:00100000:3.0:1788843386.647593:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134324736 00000100:00100000:3.0:1788843386.647646:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788843386.647655:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e0e0a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7462:x1875738134324736:12345-0@lo:1000: 00000100:00100000:3.0:1788843386.647747:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e0e0a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7462:x1875738134324736:12345-0@lo:1000: Request processed in 93us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843386.647755:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788843386.648006:0:7462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f51c3fc7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7462:1875738134324736:0@lo:1000: 00000040:00080000:2.0:1788843386.648025:0:7462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1788843386.648055:0:7462:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000092ef88c7 with version 1 00100000:10000000:1.0:1788843386.648686:0:7436:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00000004:00080000:3.0:1788843386.649399:0:7452:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000044a5ad3f version 1 rpc_version 1 00000020:00100000:3.0:1788843386.649438:0:7452:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788843386.649448:0:7452:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000c9135555 x1875738134324992/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788843386.649473:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c9135555 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7452:1875738134324992:0@lo:1000: 00000100:00100000:3.0:1788843386.649647:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843386.649700:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 0000000054272a1d going to sleep for 11 seconds 00000100:00100000:3.0:1788843386.649726:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134324992 00000100:00100000:3.0:1788843386.649735:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134324992 00000100:00100000:3.0:1788843386.649784:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788843386.649792:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000532e2527 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7452:x1875738134324992:12345-0@lo:1000: 00100000:10000000:1.0:1788843386.651029:0:7436:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788843386.653570:0:7436:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788843386.653867:0:7436:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788843386.657272:0:7436:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788843386.661116:0:7436:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788843386.661312:0:7436:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788843386.661472:0:7436:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00000040:00080000:2.0:1788843386.663151:0:7462:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788843386.663259:0:7462:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000001:00080000:3.0:1788843386.666026:0:6485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00100000:10000000:1.0:1788843386.666441:0:7436:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00000100:00100000:2.0:1788843386.667872:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000532e2527 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7452:x1875738134324992:12345-0@lo:1000: Request processed in 18071us (18229us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788843386.667948:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:1.0:1788843386.668109:0:7452:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1788843386.668115:0:7452:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788843386.668134:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c9135555 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7452:1875738134324992:0@lo:1000: 00100000:10000000:1.0:1788843386.671133:0:7436:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788843386.671363:0:7436:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788843386.671524:0:7436:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788843386.671690:0:7436:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788843386.671839:0:7436:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788843386.671960:0:7436:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788843386.672102:0:7436:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788843386.672335:0:7436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1788843386.694864:0:7436:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788843386.695033:0:7436:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb2dcc1ddf988 00100000:10000000:1.0:1788843386.695061:0:7436:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788843386.696275:0:7436:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788843386.696392:0:7436:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.133@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788843386.696427:0:7436:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788843386.696447:0:7436:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788843386.702257:0:7436:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000040:00080000:0.0:1788843386.704227:0:7461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000004:1.0:1788843386.708625:0:7436:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:0.0:1788843386.728152:0:7461:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788843386.728269:0:7461:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788843386.728275:0:7461:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:3.0:1788843386.978905:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843387.994516:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843389.019569:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843390.042302:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843391.068994:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788843391.355591:0:7707:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg333-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788843391.898448:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a417b685 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134325120:0@lo:41: 00000100:00100000:3.0:1788843391.898529:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843391.898666:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134325120 00000100:00100000:1.0:1788843391.898674:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134325120 00000100:00100000:1.0:1788843391.898725:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788843391.898734:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d990691e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134325120:12345-0@lo:41: 00000004:00000024:1.0:1788843391.898770:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1788843391.898814:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d990691e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134325120:12345-0@lo:41: Request processed in 81us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843391.898822:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788843391.899022:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a417b685 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134325120:0@lo:41: 00000100:00100000:0.0:1788843391.899422:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788843391.899474:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788843391.899485:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003bbceefa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134325376:0@lo:400: 00000100:00100000:3.0:1788843391.899520:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843391.899553:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134325376 00000100:00100000:3.0:1788843391.899571:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134325376 00000100:00100000:3.0:1788843391.899619:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788843391.899625:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047f628e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134325376:12345-0@lo:400: 00000100:00100000:3.0:1788843391.899666:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047f628e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134325376:12345-0@lo:400: Request processed in 42us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843391.899673:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788843391.899717:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000003bbceefa x1875738134325376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843391.899728:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003bbceefa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134325376:0@lo:400: 10000000:01000000:1.0:1788843391.900736:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788843391.900743:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd12e2b3800 from 4 10000000:01000000:1.0:1788843391.900747:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788843391.900785:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: 0000000054283b65/0xa762dfcbd58d0cfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843391.900796:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: 0000000054283b65/0xa762dfcbd58d0cfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843391.900806:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: 0000000054283b65/0xa762dfcbd58d0cfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843391.900825:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007867c071 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134325504:0@lo:101: 00000100:00100000:1.0:1788843391.900876:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843391.900935:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c3333e7b going to sleep for 11 seconds 00000100:00100000:3.0:1788843391.901090:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134325504 00000100:00100000:3.0:1788843391.901097:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134325504 00000100:00100000:3.0:1788843391.901169:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788843391.901176:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ea5f0ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+13:6503:x1875738134325504:12345-0@lo:101: 00010000:00010000:3.0:1788843391.901187:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843391.901199:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005cdfebb5/0xa762dfcbd58d0d03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0cfc expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843391.901240:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005cdfebb5/0xa762dfcbd58d0d03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0cfc expref: 14 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843391.901250:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005cdfebb5/0xa762dfcbd58d0d03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0cfc expref: 14 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843391.901258:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005cdfebb5, rc 0) 00000100:00100000:3.0:1788843391.901305:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ea5f0ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+14:6503:x1875738134325504:12345-0@lo:101: Request processed in 130us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843391.901312:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788843391.901351:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007867c071 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134325504:0@lo:101: 00010000:00010000:3.0:1788843391.901371:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: 0000000054283b65/0xa762dfcbd58d0cfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0d03 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843391.901380:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: 0000000054283b65/0xa762dfcbd58d0cfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0d03 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843391.901433:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c9135555 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134325632:0@lo:256: 00000100:00100000:3.0:1788843391.901463:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843391.901476:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ed1cfebe going to sleep for 11 seconds 00000100:00100000:3.0:1788843391.901489:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134325632 00000100:00100000:3.0:1788843391.901492:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134325632 00000100:00100000:3.0:1788843391.901515:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788843391.901520:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005de76ddb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+14:6503:x1875738134325632:12345-0@lo:256: 20000000:01000000:3.0:1788843391.901533:0:6501:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788843391.901550:0:6501:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788843391.901553:0:6501:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788843391.901605:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f51c3fc7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134325248:0@lo:400: 00000100:00100000:3.0:1788843391.901648:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005de76ddb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+14:6503:x1875738134325632:12345-0@lo:256: Request processed in 127us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843391.901655:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788843391.901685:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c9135555 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134325632:0@lo:256: 10000000:01000000:3.0:1788843391.901724:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788843391.901729:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: 0000000054283b65/0xa762dfcbd58d0cfc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0d03 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843391.901738:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: 0000000054283b65/0xa762dfcbd58d0cfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0d03 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843391.901746:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788843391.901753:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd118db4800 from 21 10000000:01000000:3.0:1788843391.901756:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788843391.901771:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: 000000001794e17a/0xa762dfcbd58d0d0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843391.901778:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: 000000001794e17a/0xa762dfcbd58d0d0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843391.901785:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: 000000001794e17a/0xa762dfcbd58d0d0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843391.901795:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c9135555 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134325760:0@lo:101: 00000100:00100000:3.0:1788843391.901818:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843391.901830:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ed1cfebe going to sleep for 11 seconds 00000100:00100000:3.0:1788843391.901840:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134325760 00000100:00100000:3.0:1788843391.901843:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134325760 00000100:00100000:3.0:1788843391.901863:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788843391.901868:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec484791 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+14:6503:x1875738134325760:12345-0@lo:101: 00010000:00010000:3.0:1788843391.901874:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843391.901882:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001596eaa3/0xa762dfcbd58d0d11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0d0a expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843391.901895:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001596eaa3/0xa762dfcbd58d0d11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0d0a expref: 15 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843391.901902:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001596eaa3/0xa762dfcbd58d0d11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0d0a expref: 15 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843391.901908:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001596eaa3, rc 0) 00000100:00100000:3.0:1788843391.901933:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec484791 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:6503:x1875738134325760:12345-0@lo:101: Request processed in 65us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843391.901946:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788843391.901975:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c9135555 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134325760:0@lo:101: 00010000:00010000:3.0:1788843391.901983:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: 000000001794e17a/0xa762dfcbd58d0d0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0d11 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843391.901989:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: 000000001794e17a/0xa762dfcbd58d0d0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0d11 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843391.902039:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c9135555 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134325888:0@lo:501: 00000100:00100000:3.0:1788843391.902062:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843391.902074:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ed1cfebe going to sleep for 11 seconds 00000100:00100000:3.0:1788843391.902084:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134325888 00000100:00100000:3.0:1788843391.902087:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134325888 00000100:00100000:3.0:1788843391.902105:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788843391.902110:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:6503:x1875738134325888:12345-0@lo:501: 00000100:00100000:3.0:1788843391.902239:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:6503:x1875738134325888:12345-0@lo:501: Request processed in 129us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843391.902245:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788843391.902271:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c9135555 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134325888:0@lo:501: 00000100:00100000:3.0:1788843391.902297:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c9135555 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134326016:0@lo:503: 00000100:00100000:3.0:1788843391.902336:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843391.902348:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ed1cfebe going to sleep for 11 seconds 00000100:00100000:3.0:1788843391.902358:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134326016 00000100:00100000:3.0:1788843391.902361:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134326016 00000100:00100000:3.0:1788843391.902379:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788843391.902384:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c15be86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:6503:x1875738134326016:12345-0@lo:503: 00000100:00100000:3.0:1788843391.902462:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c15be86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:6503:x1875738134326016:12345-0@lo:503: Request processed in 77us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843391.902468:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788843391.902507:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c9135555 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134326016:0@lo:503: 00000100:00100000:3.0:1788843391.902707:0:7730:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c9135555 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:7730:1875738134326144:0@lo:502: 00000100:00100000:3.0:1788843391.902740:0:7730:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843391.902757:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134326144 00000100:00100000:3.0:1788843391.902760:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134326144 00000100:00100000:3.0:1788843391.902778:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788843391.902782:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e57ff42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:7730:x1875738134326144:12345-0@lo:502: 00000100:00100000:3.0:1788843391.902846:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e57ff42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:7730:x1875738134326144:12345-0@lo:502: Request processed in 63us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843391.902852:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788843391.902881:0:7730:0:(client.c:2715:ptlrpc_set_wait()) set 00000000983f2212 going to sleep for 11 seconds 00000100:00100000:3.0:1788843391.902892:0:7730:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c9135555 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:7730:1875738134326144:0@lo:502: 00000100:00100000:3.0:1788843391.902927:0:7730:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c9135555 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:7730:1875738134326272:0@lo:502: 00000100:00100000:3.0:1788843391.902957:0:7730:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843391.902973:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134326272 00000100:00100000:3.0:1788843391.902976:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134326272 00000100:00100000:3.0:1788843391.902995:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788843391.903000:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f111f74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:7730:x1875738134326272:12345-0@lo:502: 00000100:00100000:3.0:1788843391.903786:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f111f74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:7730:x1875738134326272:12345-0@lo:502: Request processed in 782us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843391.903796:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788843391.903850:0:7730:0:(client.c:2715:ptlrpc_set_wait()) set 00000000983f2212 going to sleep for 11 seconds 00000100:00100000:3.0:1788843391.903874:0:7730:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c9135555 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:7730:1875738134326272:0@lo:502: 00000040:00080000:3.0:1788843391.903899:0:7730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000100:00100000:2.0:1788843391.904097:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788843391.904109:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000040cb41bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134326400:0@lo:400: 00000100:00100000:2.0:1788843391.904178:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843391.904233:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134326400 00000100:00100000:2.0:1788843391.904239:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134326400 00000100:00100000:2.0:1788843391.904563:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788843391.904572:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004dab7f08 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134326400:12345-0@lo:400: 00000100:00100000:2.0:1788843391.904636:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004dab7f08 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134326400:12345-0@lo:400: Request processed in 66us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843391.904642:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788843391.904973:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000040cb41bb x1875738134326400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843391.904987:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000040cb41bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134326400:0@lo:400: 00000020:01000000:1.0:1788843391.905048:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1788843391.905075:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788843391.905085:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: 000000001794e17a/0xa762dfcbd58d0d0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0d11 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843391.905095:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: 000000001794e17a/0xa762dfcbd58d0d0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0d11 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843391.905105:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788843391.905108:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd118db4800 from 4 10000000:01000000:1.0:1788843391.905111:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788843391.905504:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: 00000000685f98e5/0xa762dfcbd58d0d18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843391.905513:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: 00000000685f98e5/0xa762dfcbd58d0d18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843391.905522:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: 00000000685f98e5/0xa762dfcbd58d0d18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843391.905540:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000112255d9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134326528:0@lo:101: 00000100:00100000:1.0:1788843391.905582:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843391.905662:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set 000000006fbf90e6 going to sleep for 11 seconds 00000100:00100000:2.0:1788843391.905767:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134326528 00000100:00100000:2.0:1788843391.905774:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134326528 00000100:00100000:2.0:1788843391.905848:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788843391.905856:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f478a08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:6503:x1875738134326528:12345-0@lo:101: 00010000:00010000:2.0:1788843391.905876:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843391.905889:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006ad905b7/0xa762dfcbd58d0d1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0d18 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843391.905910:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006ad905b7/0xa762dfcbd58d0d1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0d18 expref: 16 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843391.905920:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006ad905b7/0xa762dfcbd58d0d1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0d18 expref: 16 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843391.905927:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006ad905b7, rc 0) 00000100:00100000:2.0:1788843391.905967:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f478a08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:6503:x1875738134326528:12345-0@lo:101: Request processed in 113us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843391.905973:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788843391.906036:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000112255d9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134326528:0@lo:101: 00010000:00010000:1.0:1788843391.906049:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: 00000000685f98e5/0xa762dfcbd58d0d18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0d1f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843391.906057:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: 00000000685f98e5/0xa762dfcbd58d0d18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0d1f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843391.906115:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000112255d9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134326656:0@lo:256: 00000100:00100000:1.0:1788843391.906177:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843391.906556:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set 000000006fbf90e6 going to sleep for 11 seconds 00000100:00100000:0.0:1788843391.906667:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843391.906670:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134326656 00000100:00100000:3.0:1788843391.906676:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134326656 00000100:00100000:0.0:1788843391.906730:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134325248 00000100:00100000:0.0:1788843391.906735:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134325248 00000100:00100000:0.0:1788843391.907433:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788843391.907445:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0fd5af4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:3631:x1875738134325248:12345-0@lo:400: 00000100:00100000:2.0:1788843391.907452:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788843391.907464:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003427eb4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:6503:x1875738134326656:12345-0@lo:256: 20000000:01000000:2.0:1788843391.907483:0:6498:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788843391.907508:0:6498:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788843391.907512:0:6498:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788843391.907518:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0fd5af4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:3631:x1875738134325248:12345-0@lo:400: Request processed in 77us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843391.907537:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788843391.907626:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003427eb4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:6503:x1875738134326656:12345-0@lo:256: Request processed in 165us (1448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843391.907634:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788843391.907671:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000112255d9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134326656:0@lo:256: 00000100:00100000:3.0:1788843391.907776:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f51c3fc7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134325248:0@lo:400: 10000000:01000000:2.0:1788843391.907884:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788843391.907892:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: 00000000685f98e5/0xa762dfcbd58d0d18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0d1f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843391.907902:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: 00000000685f98e5/0xa762dfcbd58d0d18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0d1f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843391.907910:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788843391.907912:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1788843391.907914:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788843391.907939:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: 0000000035087543/0xa762dfcbd58d0d26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843391.907946:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: 0000000035087543/0xa762dfcbd58d0d26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843391.907954:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: 0000000035087543/0xa762dfcbd58d0d26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843391.907969:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004529c94e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134326784:0@lo:101: 00000100:00100000:2.0:1788843391.907997:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843391.908029:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set 0000000092ef88c7 going to sleep for 11 seconds 00000100:00100000:0.0:1788843391.908091:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134326784 00000100:00100000:0.0:1788843391.908096:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134326784 00000100:00100000:2.0:1788843391.908537:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788843391.908546:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003a4e69c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:6503:x1875738134326784:12345-0@lo:101: 00010000:00010000:2.0:1788843391.908562:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843391.908574:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000013dee11f/0xa762dfcbd58d0d2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0d26 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843391.908605:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000013dee11f/0xa762dfcbd58d0d2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0d26 expref: 17 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843391.908616:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000013dee11f/0xa762dfcbd58d0d2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0d26 expref: 17 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843391.908624:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000013dee11f, rc 0) 00000100:00100000:2.0:1788843391.908667:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003a4e69c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:6503:x1875738134326784:12345-0@lo:101: Request processed in 123us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843391.908674:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788843391.908843:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004529c94e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134326784:0@lo:101: 00010000:00010000:1.0:1788843391.908857:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: 0000000035087543/0xa762dfcbd58d0d26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0d2d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843391.908865:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: 0000000035087543/0xa762dfcbd58d0d26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0d2d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843391.908925:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d726f26f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134326912:0@lo:501: 00000100:00100000:1.0:1788843391.908954:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843391.908987:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set 00000000573d1290 going to sleep for 11 seconds 00000100:00100000:3.0:1788843391.909035:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134326912 00000100:00100000:3.0:1788843391.909040:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134326912 00000100:00100000:3.0:1788843391.909073:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788843391.909080:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000105fcf7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:6503:x1875738134326912:12345-0@lo:501: 00000100:00100000:3.0:1788843391.909459:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000105fcf7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:6503:x1875738134326912:12345-0@lo:501: Request processed in 379us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843391.909466:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788843391.909820:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d726f26f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134326912:0@lo:501: 00000100:00100000:1.0:1788843391.909856:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d726f26f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134327040:0@lo:503: 00000100:00100000:1.0:1788843391.909904:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843391.909933:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set 00000000573d1290 going to sleep for 11 seconds 00000100:00100000:3.0:1788843391.909981:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134327040 00000100:00100000:3.0:1788843391.909986:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134327040 00000100:00100000:3.0:1788843391.910018:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788843391.910025:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007149757a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:6503:x1875738134327040:12345-0@lo:503: 00000100:00100000:3.0:1788843391.910118:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007149757a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:6503:x1875738134327040:12345-0@lo:503: Request processed in 94us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843391.910126:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788843391.910402:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d726f26f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134327040:0@lo:503: 00000100:00100000:2.0:1788843391.911463:0:7731:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004529c94e pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:7731:1875738134327168:0@lo:502: 00000100:00100000:2.0:1788843391.911523:0:7731:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843391.911559:0:7731:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a95cb2c4 going to sleep for 11 seconds 00000100:00100000:0.0:1788843391.911653:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134327168 00000100:00100000:0.0:1788843391.911660:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134327168 00000100:00100000:0.0:1788843391.911765:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788843391.911774:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002bb157e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:7731:x1875738134327168:12345-0@lo:502: 00000100:00100000:0.0:1788843391.911978:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002bb157e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:7731:x1875738134327168:12345-0@lo:502: Request processed in 205us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843391.911985:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788843391.912054:0:7731:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004529c94e pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:7731:1875738134327168:0@lo:502: 00000020:01000000:3.0:1788843391.912081:0:7731:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788843391.912092:0:7731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843391.912094:0:7731:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788843391.912106:0:7731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788843391.912110:0:7731:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.133@tcp to nid 0x20000c0a8cb85 (192.168.203.133@tcp) 00000020:00000080:3.0:1788843391.912367:0:7731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788843391.912392:0:7731:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000d8ad79f9) 00000020:00000080:3.0:1788843391.912414:0:7731:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:3.0:1788843391.912420:0:7731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788843391.912504:0:7731:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788843391.912510:0:7731:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788843391.912517:0:7731:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa762dfcbd58d0d3b 00010000:00080000:3.0:1788843391.912547:0:7731:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005d366a6e@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.133@tcp at head 00010000:00010000:3.0:1788843391.915094:0:7731:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:2.0:1788843391.916509:0:7731:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788843391.916526:0:7731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788843391.916565:0:7731:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788843391.916587:0:7731:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa762dfcbd58d0d42 00000100:00080000:2.0:1788843391.916608:0:7731:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788843391.916613:0:7731:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 000000005d366a6e using connection 192.168.203.133@tcp/0@lo 00000100:00100000:2.0:1788843391.916649:0:7731:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f51c3fc7 x1875738134327296/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788843391.916678:0:7731:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:2.0:1788843391.916733:0:7731:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1788843391.916840:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f51c3fc7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134327296:0@lo:38: 00000100:00100000:0.0:1788843391.916913:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843391.917354:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134327296 00000100:00100000:2.0:1788843391.917368:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134327296 00000100:00100000:2.0:1788843391.917405:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788843391.917411:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065c0d672 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3629:x1875738134327296:12345-0@lo:38: 00010000:00080000:2.0:1788843391.917436:0:6511:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:2.0:1788843391.917472:0:6511:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa762dfcbd58d0d49 00000004:00100000:2.0:1788843391.917487:0:6511:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788843391.917491:0:6511:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1788843391.917716:0:7734:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000b26b2647 x1875738134327424/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843391.917726:0:7734:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a498fd24 going to sleep for 0 seconds 00000020:01000000:2.0:1788843391.917980:0:7731:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843391.917986:0:7731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843391.917988:0:7731:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788843391.917992:0:7731:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788843391.917996:0:7731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843391.917997:0:7731:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788843391.918000:0:7731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788843391.918002:0:7731:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788843391.918023:0:7731:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000040cb41bb pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:7731:1875738134327552:0@lo:502: 00000100:00100000:2.0:1788843391.918081:0:7731:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843391.918114:0:7731:0:(client.c:2715:ptlrpc_set_wait()) set 0000000092ef88c7 going to sleep for 11 seconds 00000100:00100000:3.0:1788843391.918199:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134327552 00000100:00100000:3.0:1788843391.918214:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134327552 00000100:00100000:3.0:1788843391.918255:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788843391.918262:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058f3df24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:7731:x1875738134327552:12345-0@lo:502: 00000100:00100000:3.0:1788843391.918503:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058f3df24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:7731:x1875738134327552:12345-0@lo:502: Request processed in 240us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843391.918511:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788843391.918622:0:7731:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000040cb41bb pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:7731:1875738134327552:0@lo:502: 00000020:01000000:0.0:1788843391.918647:0:7731:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843391.918651:0:7731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843391.918653:0:7731:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788843391.918656:0:7731:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1788843391.918921:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1788843391.918944:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788843391.918952:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: 0000000035087543/0xa762dfcbd58d0d26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0d2d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843391.918962:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: 0000000035087543/0xa762dfcbd58d0d26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0d2d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843391.918973:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788843391.918975:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9bd13339b370 from 1 10000000:01000000:3.0:1788843391.918978:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788843391.919003:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: 00000000ef6d266e/0xa762dfcbd58d0d50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843391.919017:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: 00000000ef6d266e/0xa762dfcbd58d0d50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843391.919026:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: 00000000ef6d266e/0xa762dfcbd58d0d50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843391.919039:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c9135555 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134327680:0@lo:101: 00000100:00100000:3.0:1788843391.919071:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843391.919102:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set 000000008603fd10 going to sleep for 11 seconds 00000100:00100000:0.0:1788843391.919375:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134327680 00000100:00100000:0.0:1788843391.919381:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134327680 00000100:00100000:0.0:1788843391.919419:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788843391.919426:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f451fa8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:6503:x1875738134327680:12345-0@lo:101: 00010000:00010000:0.0:1788843391.919435:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843391.919450:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000300a913f/0xa762dfcbd58d0d57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0d50 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843391.919485:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000300a913f/0xa762dfcbd58d0d57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0d50 expref: 18 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843391.919496:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000300a913f/0xa762dfcbd58d0d57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0d50 expref: 18 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843391.919505:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000300a913f, rc 0) 00000100:00100000:0.0:1788843391.919545:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f451fa8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:6503:x1875738134327680:12345-0@lo:101: Request processed in 119us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843391.919551:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788843391.919583:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c9135555 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134327680:0@lo:101: 00010000:00010000:0.0:1788843391.919594:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: 00000000ef6d266e/0xa762dfcbd58d0d50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0d57 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843391.919614:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: 00000000ef6d266e/0xa762dfcbd58d0d50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0d57 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843391.919667:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c5143f37 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134327808:0@lo:501: 00000100:00100000:0.0:1788843391.919978:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843391.920003:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dae7ba38 going to sleep for 11 seconds 00000100:00100000:2.0:1788843391.920045:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134327808 00000100:00100000:2.0:1788843391.920050:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134327808 00000100:00100000:2.0:1788843391.920082:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788843391.920087:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4045c7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:6503:x1875738134327808:12345-0@lo:501: 00000100:00100000:2.0:1788843391.920193:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4045c7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:6503:x1875738134327808:12345-0@lo:501: Request processed in 106us (216us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788843391.920200:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788843391.920424:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c5143f37 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134327808:0@lo:501: 10000000:01000000:3.0:1788843391.920456:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788843391.920462:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: 00000000ef6d266e/0xa762dfcbd58d0d50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0d57 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843391.920469:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: 00000000ef6d266e/0xa762dfcbd58d0d50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0d57 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788843391.939550:0:6511:0:(import.c:65:import_set_state_nolock()) 00000000b63f4275 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788843391.939678:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065c0d672 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3629:x1875738134327296:12345-0@lo:38: Request processed in 22264us (22764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843391.939704:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788843391.940176:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788843391.940187:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788843391.940197:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788843391.940213:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788843391.940216:0:3629:0:(import.c:65:import_set_state_nolock()) 000000005d366a6e lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788843391.940233:0:3629:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000a498fd24): req@00000000b26b2647 x1875738134327424/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843391.940248:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f51c3fc7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134327296:0@lo:38: 00000100:00100000:0.0:1788843391.941480:0:7734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843391.941536:0:7734:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a498fd24 going to sleep for 11 seconds 00000100:00100000:2.0:1788843391.941647:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea9260a9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134327936:0@lo:41: 00000100:00100000:2.0:1788843391.941696:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843391.941827:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134327424 00000100:00100000:0.0:1788843391.941848:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134327424 00000100:00100000:0.0:1788843391.941882:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134327936 00000100:00100000:0.0:1788843391.941885:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134327936 00000100:00100000:0.0:1788843391.941899:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788843391.941906:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c76f0cbc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7734:x1875738134327424:12345-0@lo:1000: 00000100:00100000:0.0:1788843391.941992:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c76f0cbc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7734:x1875738134327424:12345-0@lo:1000: Request processed in 86us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843391.942000:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788843391.942016:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788843391.942022:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003bbceefa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3633:x1875738134327936:12345-0@lo:41: 00000004:00000024:0.0:1788843391.942044:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788843391.942078:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003bbceefa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3633:x1875738134327936:12345-0@lo:41: Request processed in 57us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843391.942084:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788843391.942811:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea9260a9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134327936:0@lo:41: 00000100:00100000:2.0:1788843391.942858:0:7734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b26b2647 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7734:1875738134327424:0@lo:1000: 00000040:01000000:2.0:1788843391.942891:0:7734:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788843391.942928:0:7734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000950bb93b pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7734:1875738134328064:0@lo:1000: 00000100:00100000:2.0:1788843391.942969:0:7734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843391.942996:0:7734:0:(client.c:2715:ptlrpc_set_wait()) set 000000007fb7bb96 going to sleep for 11 seconds 00000100:00100000:0.0:1788843391.943546:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134328064 00000100:00100000:0.0:1788843391.943554:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134328064 00000100:00100000:0.0:1788843391.943840:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788843391.943849:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef04ba14 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7734:x1875738134328064:12345-0@lo:1000: 00000100:00100000:0.0:1788843391.944549:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef04ba14 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7734:x1875738134328064:12345-0@lo:1000: Request processed in 699us (1576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843391.944559:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788843391.944797:0:7734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000950bb93b pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7734:1875738134328064:0@lo:1000: 00000100:00100000:2.0:1788843391.944857:0:7734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000950bb93b pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7734:1875738134328192:0@lo:700: 00000100:00100000:2.0:1788843391.944891:0:7734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843391.947206:0:7734:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f8ed26bd going to sleep for 11 seconds 00000100:00100000:3.0:1788843391.953619:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134328192 00000100:00100000:3.0:1788843391.953647:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134328192 00000100:00100000:3.0:1788843391.953812:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788843391.953823:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003fa75b5f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7734:x1875738134328192:12345-0@lo:700: 00000100:00100000:3.0:1788843391.954024:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003fa75b5f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7734:x1875738134328192:12345-0@lo:700: Request processed in 203us (9132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843391.954032:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788843391.955444:0:7734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000950bb93b pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7734:1875738134328192:0@lo:700: 00000100:00100000:1.0:1788843391.956372:0:7734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d726f26f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7734:1875738134328320:0@lo:1000: 00000100:00100000:1.0:1788843391.956437:0:7734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843391.957019:0:7734:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e7ec4347 going to sleep for 11 seconds 00000100:00100000:3.0:1788843391.957573:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134328320 00000100:00100000:3.0:1788843391.957583:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134328320 00000100:00100000:3.0:1788843391.957761:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788843391.957772:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1226a7d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7734:x1875738134328320:12345-0@lo:1000: 00000100:00100000:3.0:1788843391.958535:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1226a7d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7734:x1875738134328320:12345-0@lo:1000: Request processed in 763us (2095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843391.958545:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788843391.962302:0:7734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d726f26f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7734:1875738134328320:0@lo:1000: 00000004:00080000:0.0:1788843391.962618:0:7734:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000ed59ce0e with version 0 00000020:00100000:0.0:1788843391.962647:0:7734:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788843391.962655:0:7734:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000a7a092aa x1875738134328576/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788843391.962675:0:7734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a7a092aa pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7734:1875738134328576:0@lo:1000: 00000100:00100000:0.0:1788843391.962753:0:7734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843391.962821:0:7734:0:(client.c:2715:ptlrpc_set_wait()) set 000000002d619e89 going to sleep for 11 seconds 00000100:00100000:1.0:1788843391.962961:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134328576 00000100:00100000:1.0:1788843391.962967:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134328576 00000100:00100000:1.0:1788843391.963002:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788843391.963009:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e61043b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7734:x1875738134328576:12345-0@lo:1000: 00000001:00080000:0.0:1788843391.971669:0:7438:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1788843391.971690:0:7438:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788843391.971851:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e61043b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7734:x1875738134328576:12345-0@lo:1000: Request processed in 8839us (9095us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788843391.971864:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:1.0:1788843391.973637:0:7734:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1788843391.973646:0:7734:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788843391.973667:0:7734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a7a092aa pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7734:1875738134328576:0@lo:1000: 00000100:00100000:1.0:1788843391.973772:0:7734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d726f26f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7734:1875738134328704:0@lo:1000: 00000100:00100000:1.0:1788843391.973840:0:7734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843391.973883:0:7734:0:(client.c:2715:ptlrpc_set_wait()) set 0000000042b18c22 going to sleep for 11 seconds 00000100:00100000:0.0:1788843391.973989:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134328704 00000100:00100000:0.0:1788843391.973996:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134328704 00000100:00100000:0.0:1788843391.974048:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788843391.974058:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000112255d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7734:x1875738134328704:12345-0@lo:1000: 00000100:00100000:0.0:1788843391.974171:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000112255d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7734:x1875738134328704:12345-0@lo:1000: Request processed in 115us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843391.974179:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788843391.974545:0:7734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d726f26f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7734:1875738134328704:0@lo:1000: 00000040:00080000:1.0:1788843391.974565:0:7734:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1788843391.974607:0:7734:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000ed59ce0e with version 1 00000004:00080000:0.0:1788843391.975793:0:7732:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000b601dbaf version 1 rpc_version 1 00000020:00100000:0.0:1788843391.975825:0:7732:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788843391.975833:0:7732:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000937a2dcd x1875738134328960/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788843391.975852:0:7732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000937a2dcd pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7732:1875738134328960:0@lo:1000: 00000100:00100000:0.0:1788843391.975902:0:7732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843391.975928:0:7732:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ae192cb8 going to sleep for 11 seconds 00000100:00100000:0.0:1788843391.975946:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134328960 00000100:00100000:0.0:1788843391.975952:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134328960 00000100:00100000:0.0:1788843391.975996:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788843391.976003:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003bfc67bc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7732:x1875738134328960:12345-0@lo:1000: 00000040:00080000:1.0:1788843391.978716:0:7734:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788843391.979026:0:7734:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788843391.979032:0:7734:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:2.0:1788843391.989988:0:7438:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:3.0:1788843391.990757:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003bfc67bc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7732:x1875738134328960:12345-0@lo:1000: Request processed in 14749us (14850us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788843391.990772:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:1.0:1788843391.991028:0:7732:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1788843391.991033:0:7732:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788843391.991051:0:7732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000937a2dcd pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7732:1875738134328960:0@lo:1000: 00010000:00010000:3.0:1788843392.091740:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788843392.348540:0:7764:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788843392.352355:0:7764:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788843393.115759:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843394.139236:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843395.163537:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788843395.295394:0:7865:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788843395.295603:0:7865:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788843396.193882:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788843396.281125:0:7913:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcfdaeae40 20000000:00000080:3.0:1788843396.281276:0:7913:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bd13fbd7c00 uarg=0000000000000000 20000000:01000000:3.0:1788843396.281334:0:7913:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788843396.281341:0:7913:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788843396.281346:0:7913:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788843396.281424:0:7913:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1788843396.281435:0:7913:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788843396.285026:0:7913:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788843396.288079:0:7913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788843396.288166:0:7913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788843396.288187:0:7913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788843396.288203:0:7913:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788843396.288222:0:7913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003cb2f1eb/0xa762dfcbd58d0d5e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843396.288252:0:7913:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000000507c68/0xa762dfcbd58d0bdd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0bd6 expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843396.288259:0:7913:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000027231346/0xa762dfcbd58d0ccb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0cc4 expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843396.288266:0:7913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003cb2f1eb/0xa762dfcbd58d0d5e lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843396.288303:0:7913:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000027231346/0xa762dfcbd58d0ccb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0cc4 expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843396.288327:0:7913:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000027231346/0xa762dfcbd58d0ccb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0cc4 expref: 17 pid: 6500 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843396.288343:0:7913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000070a1f7cd pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7913:1875738134329088:0@lo:104: 00000100:00100000:2.0:1788843396.288415:0:7913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788843396.288492:0:7913:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000000507c68/0xa762dfcbd58d0bdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0bd6 expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843396.288500:0:7913:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000000507c68/0xa762dfcbd58d0bdd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0bd6 expref: 17 pid: 6500 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843396.288508:0:7913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f2e6a58b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7913:1875738134329216:0@lo:104: 00000100:00100000:2.0:1788843396.288527:0:7913:0:(client.c:2715:ptlrpc_set_wait()) set 000000009f166d56 going to sleep for 11 seconds 00000100:00100000:0.0:1788843396.288633:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788843396.288654:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843396.288813:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134329088 00000100:00100000:0.0:1788843396.288822:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134329088 00000100:00100000:0.0:1788843396.288860:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134329216 00000100:00100000:0.0:1788843396.288862:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134329216 00000100:00100000:0.0:1788843396.288877:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788843396.288891:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002056c62e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+4:7913:x1875738134329088:12345-0@lo:104: 00010000:00010000:0.0:1788843396.288904:0:6490:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: 000000000264e066/0xa762dfcbd58d0cc4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0ccb expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843396.288973:0:6490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788843396.288978:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002056c62e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+4:7913:x1875738134329088:12345-0@lo:104: Request processed in 89us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843396.288985:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788843396.289025:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788843396.289031:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000937a2dcd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+3:7913:x1875738134329216:12345-0@lo:104: 00010000:00010000:0.0:1788843396.289038:0:6490:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: 000000002596e231/0xa762dfcbd58d0bd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0bdd expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843396.289069:0:6490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788843396.289073:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000937a2dcd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+3:7913:x1875738134329216:12345-0@lo:104: Request processed in 43us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843396.289078:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1788843396.289092:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788843396.289097:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: 000000000264e066/0xa762dfcbd58d0cc4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0ccb expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843396.289105:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000264e066 already unused, calling callback (0000000065690e96) 10000000:00010000:0.0:1788843396.289108:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: 000000000264e066/0xa762dfcbd58d0cc4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0ccb expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843396.289115:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: 000000000264e066/0xa762dfcbd58d0cc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0ccb expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843396.289122:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: 000000000264e066/0xa762dfcbd58d0cc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0ccb expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843396.289133:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788843396.289181:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: 000000000264e066/0xa762dfcbd58d0cc4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0ccb expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843396.289188:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843396.289207:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: 000000000264e066/0xa762dfcbd58d0cc4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0ccb expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843396.289212:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: 000000000264e066/0xa762dfcbd58d0cc4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0ccb expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843396.289225:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843396.289227:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: 000000002596e231/0xa762dfcbd58d0bd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0bdd expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843396.289232:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002596e231 already unused, calling callback (0000000065690e96) 10000000:00010000:0.0:1788843396.289234:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: 000000002596e231/0xa762dfcbd58d0bd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0bdd expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843396.289239:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: 000000002596e231/0xa762dfcbd58d0bd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0bdd expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843396.289244:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: 000000002596e231/0xa762dfcbd58d0bd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0bdd expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843396.289249:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788843396.289258:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: 000000002596e231/0xa762dfcbd58d0bd6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0bdd expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843396.289262:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843396.289273:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: 000000002596e231/0xa762dfcbd58d0bd6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0bdd expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843396.289277:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: 000000002596e231/0xa762dfcbd58d0bd6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0bdd expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843396.289290:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843396.289292:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843396.289293:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843396.289307:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000070da4efc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134329344:0@lo:103: 00000100:00100000:0.0:1788843396.289339:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843396.289363:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788843396.289368:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e9ddd8dc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134329472:0@lo:103: 00000100:00100000:0.0:1788843396.289388:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843396.289419:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134329344 00000100:00100000:0.0:1788843396.289424:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134329344 00010000:00010000:0.0:1788843396.289440:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000027231346/0xa762dfcbd58d0ccb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0cc4 expref: 18 pid: 6500 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843396.289461:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134329472 00000100:00100000:0.0:1788843396.289464:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134329472 00010000:00010000:0.0:1788843396.289472:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000000507c68/0xa762dfcbd58d0bdd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0bd6 expref: 19 pid: 6500 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843396.289505:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788843396.289511:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7a092aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+19:3630:x1875738134329344:12345-0@lo:103: 00010000:00010000:0.0:1788843396.289523:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843396.289526:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000027231346/0xa762dfcbd58d0ccb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0cc4 expref: 19 pid: 6500 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843396.289547:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000027231346/0xa762dfcbd58d0ccb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0cc4 expref: 19 pid: 6500 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843396.289564:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843396.289598:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7a092aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+19:3630:x1875738134329344:12345-0@lo:103: Request processed in 88us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843396.289604:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788843396.289615:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788843396.289620:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b26b2647 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:3630:x1875738134329472:12345-0@lo:103: 00010000:00010000:0.0:1788843396.289626:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843396.289629:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000000507c68/0xa762dfcbd58d0bdd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0bd6 expref: 18 pid: 6500 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843396.289636:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000000507c68/0xa762dfcbd58d0bdd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0bd6 expref: 18 pid: 6500 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843396.289645:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003cb2f1eb/0xa762dfcbd58d0d5e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843396.289651:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003cb2f1eb/0xa762dfcbd58d0d5e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843396.289661:0:6491:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003cb2f1eb/0xa762dfcbd58d0d5e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843396.289666:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003cb2f1eb/0xa762dfcbd58d0d5e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843396.289672:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003cb2f1eb/0xa762dfcbd58d0d5e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843396.289918:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843396.290312:0:7913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000027231346/0xa762dfcbd58d0ccb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0cc4 expref: 18 pid: 6500 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843396.290325:0:7913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000070a1f7cd pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7913:1875738134329088:0@lo:104: 00010000:00010000:2.0:1788843396.290334:0:7913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000000507c68/0xa762dfcbd58d0bdd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0bd6 expref: 17 pid: 6500 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843396.290342:0:7913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f2e6a58b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7913:1875738134329216:0@lo:104: 00010000:00010000:0.0:1788843396.290411:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003cb2f1eb/0xa762dfcbd58d0d5e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843396.291069:0:7913:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003cb2f1eb/0xa762dfcbd58d0d5e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843396.291082:0:7913:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: 000000003cb2f1eb/0xa762dfcbd58d0d5e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843396.291089:0:7913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003cb2f1eb/0xa762dfcbd58d0d5e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843396.293995:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003cb2f1eb already unused, calling callback (00000000f1e7cbc1) 00010000:00010000:0.0:1788843396.294009:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003cb2f1eb/0xa762dfcbd58d0d5e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843396.294025:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003cb2f1eb/0xa762dfcbd58d0d5e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843396.294040:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003cb2f1eb/0xa762dfcbd58d0d5e lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843396.294048:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003cb2f1eb/0xa762dfcbd58d0d5e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843396.294069:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843396.294228:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e9ddd8dc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134329472:0@lo:103: 00000100:00100000:1.0:1788843396.294250:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000070da4efc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134329344:0@lo:103: 00000100:00100000:0.0:1788843396.295022:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b26b2647 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:3630:x1875738134329472:12345-0@lo:103: Request processed in 5398us (5629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843396.295034:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788843397.018518:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f2e6a58b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134329600:0@lo:400: 00000100:00100000:2.0:1788843397.018618:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843397.018664:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f51c3fc7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134330112:0@lo:400: 00000100:00100000:2.0:1788843397.018693:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843397.018722:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788843397.018727:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000070a1f7cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134329728:0@lo:400: 00000100:00100000:2.0:1788843397.018752:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843397.018780:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000950bb93b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1875738134329984:0@lo:400: 00000100:00100000:2.0:1788843397.018821:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843397.018843:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788843397.018848:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b39d899b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134329856:0@lo:400: 00000100:00100000:2.0:1788843397.018871:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843397.018897:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134330112 00000100:00100000:2.0:1788843397.018904:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134330112 00000100:00100000:2.0:1788843397.018935:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134329856 00000100:00100000:2.0:1788843397.018937:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134329856 00000100:00100000:2.0:1788843397.018951:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788843397.018958:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040cb41bb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134330112:12345-0@lo:400: 00000100:00100000:2.0:1788843397.019009:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040cb41bb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134330112:12345-0@lo:400: Request processed in 51us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843397.019017:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788843397.019031:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788843397.019167:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134329600 00000100:00100000:3.0:1788843397.019178:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134329600 00000100:00100000:3.0:1788843397.019209:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788843397.019215:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075a77ba9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:3632:x1875738134329600:12345-0@lo:400: 00000100:00100000:3.0:1788843397.019261:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075a77ba9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:3632:x1875738134329600:12345-0@lo:400: Request processed in 47us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843397.019268:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788843397.021465:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062f7797d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134329856:12345-0@lo:400: 00000100:00100000:2.0:1788843397.021555:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062f7797d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134329856:12345-0@lo:400: Request processed in 104us (2683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843397.021966:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d726f26f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134330368:0@lo:41: 00000100:00100000:1.0:1788843397.022012:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843397.026283:0:6512:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788843397.026305:0:6512:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1788843397.026424:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134330368 00000100:00100000:3.0:1788843397.026433:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134330368 00000100:00100000:3.0:1788843397.026559:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788843397.026582:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007867c071 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3630:x1875738134330368:12345-0@lo:41: 00000004:00000024:3.0:1788843397.026618:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788843397.026703:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007867c071 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3630:x1875738134330368:12345-0@lo:41: Request processed in 123us (4691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843397.026711:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788843397.026885:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d726f26f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134330368:0@lo:41: 00000100:00100000:1.0:1788843397.027176:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134329728 00000100:00100000:1.0:1788843397.027182:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134329728 00000100:00100000:1.0:1788843397.027214:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134329984 00000100:00100000:1.0:1788843397.027217:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134329984 00000100:00100000:1.0:1788843397.027243:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788843397.027250:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004529c94e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134329728:12345-0@lo:400: 00000100:00100000:1.0:1788843397.027291:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004529c94e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134329728:12345-0@lo:400: Request processed in 42us (8539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843397.027297:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788843397.027309:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788843397.027314:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac74f659 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1875738134329984:12345-0@lo:400: 00000100:00100000:1.0:1788843397.027339:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac74f659 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1875738134329984:12345-0@lo:400: Request processed in 26us (8518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843397.027345:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788843397.027381:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000070a1f7cd x1875738134329728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843397.027393:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000070a1f7cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134329728:0@lo:400: 00000100:00100000:1.0:1788843397.027404:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f2e6a58b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134329600:0@lo:400: 00000100:00100000:1.0:1788843397.027416:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f51c3fc7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134330112:0@lo:400: 00000100:00100000:1.0:1788843397.027447:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788843397.027458:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000071459dfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134330240:0@lo:41: 00000100:00100000:1.0:1788843397.027494:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843397.027523:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134330240 00000100:00100000:1.0:1788843397.027527:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134330240 00000100:00100000:1.0:1788843397.027546:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788843397.027552:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d726f26f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134330240:12345-0@lo:41: 00000004:00000024:1.0:1788843397.027584:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788843397.027618:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d726f26f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134330240:12345-0@lo:41: Request processed in 66us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843397.027625:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788843397.027650:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000071459dfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134330240:0@lo:41: 00000100:00100000:3.0:1788843397.030918:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b39d899b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134329856:0@lo:400: 00010000:00080000:3.0:1788843397.030945:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000950bb93b x1875738134329984/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843397.030956:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000950bb93b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1875738134329984:0@lo:400: 00000100:00100000:2.0:1788843397.031062:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1788843397.211103:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843398.234807:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788843398.877057:0:6503:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788843398.877065:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd12e2b3800 from 1 10000000:01000000:1.0:1788843398.877070:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788843398.877116:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: 00000000239018ee/0xa762dfcbd58d0d65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843398.877127:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: 00000000239018ee/0xa762dfcbd58d0d65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843398.877137:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: 00000000239018ee/0xa762dfcbd58d0d65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843398.877180:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a417b685 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134330496:0@lo:101: 00000100:00100000:1.0:1788843398.877251:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843398.877321:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set 000000008603fd10 going to sleep for 11 seconds 00000100:00100000:3.0:1788843398.877381:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134330496 00000100:00100000:3.0:1788843398.877391:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134330496 00000100:00100000:3.0:1788843398.877446:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788843398.877455:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e92b502 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:6503:x1875738134330496:12345-0@lo:101: 00010000:00010000:3.0:1788843398.877468:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843398.877481:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002abb15b7/0xa762dfcbd58d0d6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0d65 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843398.877520:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002abb15b7/0xa762dfcbd58d0d6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0d65 expref: 17 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843398.877530:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002abb15b7/0xa762dfcbd58d0d6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0d65 expref: 17 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843398.877539:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002abb15b7, rc 0) 00000100:00100000:3.0:1788843398.877589:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e92b502 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:6503:x1875738134330496:12345-0@lo:101: Request processed in 135us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843398.877596:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788843398.877737:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a417b685 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134330496:0@lo:101: 00010000:00010000:2.0:1788843398.877751:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: 00000000239018ee/0xa762dfcbd58d0d65 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0d6c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843398.877759:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: 00000000239018ee/0xa762dfcbd58d0d65 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0d6c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843398.877818:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066f9cda4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134330624:0@lo:501: 00000100:00100000:2.0:1788843398.877843:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843398.877870:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ceacd3d6 going to sleep for 11 seconds 00000100:00100000:1.0:1788843398.877916:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134330624 00000100:00100000:1.0:1788843398.877926:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134330624 00000100:00100000:1.0:1788843398.877956:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788843398.877963:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000568cbfc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:6503:x1875738134330624:12345-0@lo:501: 00000100:00100000:1.0:1788843398.878086:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000568cbfc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:6503:x1875738134330624:12345-0@lo:501: Request processed in 123us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843398.878093:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788843398.878774:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066f9cda4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134330624:0@lo:501: 00000100:00100000:2.0:1788843398.878817:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066f9cda4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134330752:0@lo:503: 00000100:00100000:2.0:1788843398.878862:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843398.878893:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ceacd3d6 going to sleep for 11 seconds 00000100:00100000:1.0:1788843398.878955:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134330752 00000100:00100000:1.0:1788843398.878961:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134330752 00000100:00100000:1.0:1788843398.878998:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788843398.879005:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c69962e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:6503:x1875738134330752:12345-0@lo:503: 00000100:00100000:1.0:1788843398.879102:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c69962e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:6503:x1875738134330752:12345-0@lo:503: Request processed in 98us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843398.879109:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788843398.879182:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066f9cda4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134330752:0@lo:503: 00000100:00100000:1.0:1788843398.879369:0:8033:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c6d81363 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:8033:1875738134330880:0@lo:502: 00000100:00100000:1.0:1788843398.879403:0:8033:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843398.879420:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134330880 00000100:00100000:1.0:1788843398.879423:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134330880 00000100:00100000:1.0:1788843398.879439:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788843398.879444:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006648beb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:8033:x1875738134330880:12345-0@lo:502: 00000100:00100000:1.0:1788843398.879518:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006648beb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:8033:x1875738134330880:12345-0@lo:502: Request processed in 74us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843398.879525:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788843398.879559:0:8033:0:(client.c:2715:ptlrpc_set_wait()) set 0000000094432892 going to sleep for 11 seconds 00000100:00100000:1.0:1788843398.879571:0:8033:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c6d81363 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:8033:1875738134330880:0@lo:502: 00000020:01000000:1.0:1788843398.879590:0:8033:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843398.879604:0:8033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843398.879607:0:8033:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788843398.879615:0:8033:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd12e2b3800 00000020:00000080:1.0:1788843398.879618:0:8033:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788843398.879657:0:8033:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:8033:1875738134331008:0@lo:502: 00000100:00100000:1.0:1788843398.879691:0:8033:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843398.879710:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134331008 00000100:00100000:1.0:1788843398.879714:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134331008 00000100:00100000:1.0:1788843398.879729:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788843398.879734:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:8033:x1875738134331008:12345-0@lo:502: 00000100:00100000:1.0:1788843398.879790:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:8033:x1875738134331008:12345-0@lo:502: Request processed in 55us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843398.879797:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788843398.879822:0:8033:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10529e840 going to sleep for 11 seconds 00000100:00100000:1.0:1788843398.879834:0:8033:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:8033:1875738134331008:0@lo:502: 00000020:01000000:1.0:1788843398.879857:0:8033:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843398.879861:0:8033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843398.879863:0:8033:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788843398.879866:0:8033:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788843398.879914:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788843398.879935:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788843398.879944:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd118f70200/0xa762dfcbd58d0d65 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0d6c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843398.879954:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd118f70200/0xa762dfcbd58d0d65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0d6c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843398.879964:0:6503:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788843398.879966:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd118db4800 from 1 10000000:01000000:1.0:1788843398.879975:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788843398.879998:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd118f71e00/0xa762dfcbd58d0d73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843398.880006:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd118f71e00/0xa762dfcbd58d0d73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843398.880015:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd118f71e00/0xa762dfcbd58d0d73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843398.880026:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134331136:0@lo:101: 00000100:00100000:1.0:1788843398.880051:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843398.880065:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10529e840 going to sleep for 11 seconds 00000100:00100000:1.0:1788843398.880076:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134331136 00000100:00100000:1.0:1788843398.880079:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134331136 00000100:00100000:1.0:1788843398.880096:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788843398.880101:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:6503:x1875738134331136:12345-0@lo:101: 00010000:00010000:1.0:1788843398.880108:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843398.880119:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd118f71400/0xa762dfcbd58d0d7a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0d73 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843398.880137:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd118f71400/0xa762dfcbd58d0d7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0d73 expref: 18 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843398.880168:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd118f71400/0xa762dfcbd58d0d7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0d73 expref: 18 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843398.880175:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd118f71400, rc 0) 00000100:00100000:1.0:1788843398.880203:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:6503:x1875738134331136:12345-0@lo:101: Request processed in 101us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843398.880217:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788843398.880247:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134331136:0@lo:101: 00010000:00010000:1.0:1788843398.880258:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd118f71e00/0xa762dfcbd58d0d73 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0d7a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843398.880265:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd118f71e00/0xa762dfcbd58d0d73 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0d7a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843398.880304:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134331264:0@lo:501: 00000100:00100000:1.0:1788843398.880328:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843398.880341:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10529e840 going to sleep for 11 seconds 00000100:00100000:1.0:1788843398.880351:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134331264 00000100:00100000:1.0:1788843398.880354:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134331264 00000100:00100000:1.0:1788843398.880371:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788843398.880376:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:6503:x1875738134331264:12345-0@lo:501: 00000100:00100000:1.0:1788843398.880454:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:6503:x1875738134331264:12345-0@lo:501: Request processed in 77us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843398.880460:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788843398.880488:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134331264:0@lo:501: 00000100:00100000:1.0:1788843398.880510:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134331392:0@lo:503: 00000100:00100000:1.0:1788843398.880540:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843398.880567:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10529e840 going to sleep for 11 seconds 00000100:00100000:1.0:1788843398.880579:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134331392 00000100:00100000:1.0:1788843398.880582:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134331392 00000100:00100000:1.0:1788843398.880598:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788843398.880603:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:6503:x1875738134331392:12345-0@lo:503: 00000100:00100000:1.0:1788843398.880670:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:6503:x1875738134331392:12345-0@lo:503: Request processed in 65us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843398.880676:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788843398.880711:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134331392:0@lo:503: 00000100:00100000:1.0:1788843398.882100:0:8034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:8034:1875738134331520:0@lo:502: 00000100:00100000:1.0:1788843398.882182:0:8034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843398.882258:0:8034:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10529eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788843398.882348:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134331520 00000100:00100000:2.0:1788843398.882355:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134331520 00000100:00100000:2.0:1788843398.882433:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788843398.882442:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:8034:x1875738134331520:12345-0@lo:502: 00000100:00100000:2.0:1788843398.882562:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:8034:x1875738134331520:12345-0@lo:502: Request processed in 121us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843398.882570:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788843398.882644:0:8034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:8034:1875738134331520:0@lo:502: 00000020:01000000:1.0:1788843398.882669:0:8034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843398.882679:0:8034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843398.882682:0:8034:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788843398.882690:0:8034:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd118db4800 00000020:00000080:1.0:1788843398.882693:0:8034:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788843398.882717:0:8034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:8034:1875738134331648:0@lo:502: 00000100:00100000:1.0:1788843398.882751:0:8034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843398.882827:0:8034:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10529eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788843398.882885:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134331648 00000100:00100000:3.0:1788843398.882890:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134331648 00000100:00100000:3.0:1788843398.882914:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788843398.882921:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:8034:x1875738134331648:12345-0@lo:502: 00000100:00100000:3.0:1788843398.883006:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:8034:x1875738134331648:12345-0@lo:502: Request processed in 85us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843398.883013:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788843398.883089:0:8034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:8034:1875738134331648:0@lo:502: 00000020:01000000:1.0:1788843398.883108:0:8034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843398.883112:0:8034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843398.883114:0:8034:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788843398.883118:0:8034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788843398.883281:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788843398.883299:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788843398.883309:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd118f71e00/0xa762dfcbd58d0d73 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0d7a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843398.883318:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd118f71e00/0xa762dfcbd58d0d73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0d7a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843399.260485:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843400.286102:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843401.306692:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843402.140011:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134331776:0@lo:41: 00000100:00100000:2.0:1788843402.140089:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843402.140219:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1875738134332288:0@lo:400: 00000100:00100000:2.0:1788843402.140248:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843402.140279:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788843402.140287:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134332160:0@lo:400: 00000100:00100000:2.0:1788843402.140306:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843402.140346:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134331776 00000100:00100000:2.0:1788843402.140355:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134331776 00000100:00100000:2.0:1788843402.140400:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134332160 00000100:00100000:2.0:1788843402.140403:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134332160 00000100:00100000:2.0:1788843402.140418:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788843402.140427:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3631:x1875738134331776:12345-0@lo:41: 00000004:00000024:2.0:1788843402.140460:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1788843402.140507:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3631:x1875738134331776:12345-0@lo:41: Request processed in 80us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843402.140514:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788843402.140545:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788843402.140551:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134332160:12345-0@lo:400: 00000100:00100000:2.0:1788843402.140577:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134332160:12345-0@lo:400: Request processed in 27us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843402.140582:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788843402.140718:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134332160:0@lo:400: 00000100:00100000:2.0:1788843402.140734:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134331776:0@lo:41: 00000100:00100000:2.0:1788843402.141249:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134332032:0@lo:400: 00000100:00100000:2.0:1788843402.141286:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843402.141309:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788843402.141315:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134331904:0@lo:400: 00000100:00100000:2.0:1788843402.141351:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843402.141379:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134332416:0@lo:400: 00000100:00100000:2.0:1788843402.141404:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843402.141460:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134331904 00000100:00100000:2.0:1788843402.141465:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134331904 00000100:00100000:2.0:1788843402.141499:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788843402.141507:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:3633:x1875738134331904:12345-0@lo:400: 00000100:00100000:2.0:1788843402.141560:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:3633:x1875738134331904:12345-0@lo:400: Request processed in 54us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843402.141568:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788843402.141606:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134331904:0@lo:400: 00000100:00100000:2.0:1788843402.141625:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134332416 00000100:00100000:2.0:1788843402.141628:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134332416 00000100:00100000:2.0:1788843402.141650:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788843402.141656:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134332416:12345-0@lo:400: 00000100:00100000:2.0:1788843402.141689:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134332416:12345-0@lo:400: Request processed in 34us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843402.141695:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788843402.141720:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134332416:0@lo:400: 00000100:00100000:1.0:1788843402.141810:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134332288 00000100:00100000:1.0:1788843402.141815:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134332288 00000100:00100000:1.0:1788843402.141849:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134332032 00000100:00100000:1.0:1788843402.141852:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134332032 00000100:00100000:1.0:1788843402.141874:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788843402.141879:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1875738134332288:12345-0@lo:400: 00000100:00100000:1.0:1788843402.141918:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1875738134332288:12345-0@lo:400: Request processed in 38us (1668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843402.141923:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788843402.141934:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788843402.141939:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134332032:12345-0@lo:400: 00000100:00100000:1.0:1788843402.141963:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134332032:12345-0@lo:400: Request processed in 24us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843402.141969:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788843402.141996:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd13e874700 x1875738134332288/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843402.142080:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1875738134332288:0@lo:400: 00010000:00080000:2.0:1788843402.143169:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd13e875c00 x1875738134332032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843402.143183:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134332032:0@lo:400: 00000100:00100000:2.0:1788843402.146369:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788843402.146392:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134332544:0@lo:41: 00000100:00100000:2.0:1788843402.146486:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843402.146652:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134332544 00000100:00100000:3.0:1788843402.146661:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134332544 00000100:00100000:3.0:1788843402.146708:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788843402.146724:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134332544:12345-0@lo:41: 00000004:00000024:3.0:1788843402.146755:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788843402.146800:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134332544:12345-0@lo:41: Request processed in 78us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843402.146806:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788843402.146884:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134332544:0@lo:41: 00010000:00010000:0.0:1788843402.330919:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843403.354408:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843404.379285:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843405.402342:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788843405.989991:0:8415:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788843405.989995:0:8415:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788843405.989996:0:8415:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788843405.990163:0:8415:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bd10c0f0000 00000020:01000004:2.0:1788843405.992399:0:8415:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788843405.992415:0:8415:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788843405.992431:0:8415:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9bd136c519b8) 00000020:00000080:2.0:1788843405.992448:0:8415:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788843406.048342:0:8415:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788843406.048448:0:8415:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1788843406.082102:0:8415:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788843406.082628:0:8415:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788843406.082641:0:8415:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788843406.082652:0:8415:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa762dfcbd58d0d88 00000020:01000004:2.0:1788843406.082659:0:8415:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788843406.082681:0:8415:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.133@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788843406.082684:0:8415:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.133@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788843406.082689:0:8415:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788843406.082694:0:8415:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788843406.082715:0:8415:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9bd10fbb0000) 00000020:00000080:2.0:1788843406.082727:0:8415:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1788843406.084074:0:8415:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788843406.084299:0:8415:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788843406.084306:0:8415:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788843406.087562:0:8415:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788843406.087575:0:8415:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788843406.090300:0:8415:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788843406.090313:0:8415:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788843406.098065:0:8415:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788843406.098491:0:8415:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788843406.098675:0:8415:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788843406.099598:0:8415:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788843406.099608:0:8415:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788843406.131893:0:8415:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788843406.132640:0:8415:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788843406.132649:0:8415:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788843406.135454:0:8415:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788843406.135469:0:8415:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788843406.136458:0:8415:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788843406.136473:0:8415:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788843406.141601:0:8415:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788843406.141845:0:8415:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788843406.141858:0:8415:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788843406.142708:0:8415:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788843406.142717:0:8415:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788843406.182028:0:8415:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788843406.182356:0:8415:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788843406.182363:0:8415:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788843406.183428:0:8415:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788843406.183437:0:8415:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788843406.183853:0:8415:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788843406.183885:0:8415:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788843406.183892:0:8415:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.133@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788843406.235687:0:8415:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.133@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788843406.235738:0:8415:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.133@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1788843406.235743:0:8415:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788843406.235745:0:8415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788843406.235747:0:8415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788843406.235748:0:8415:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788843406.235749:0:8415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788843406.235751:0:8415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788843406.235752:0:8415:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788843406.235754:0:8415:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788843406.235756:0:8415:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788843406.235757:0:8415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788843406.235759:0:8415:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788843406.235763:0:8415:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1788843406.235766:0:8415:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788843406.235767:0:8415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788843406.235768:0:8415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788843406.235769:0:8415:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788843406.235770:0:8415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788843406.235771:0:8415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788843406.235772:0:8415:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788843406.235773:0:8415:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788843406.235774:0:8415:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788843406.235775:0:8415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788843406.235781:0:8415:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788843406.235821:0:8415:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788843406.235845:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134332672:0@lo:253: 00000100:00100000:3.0:1788843406.236356:0:8415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843406.236471:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd107bae9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843406.236550:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134332672 00000100:00100000:0.0:1788843406.236561:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134332672 00000100:00100000:0.0:1788843406.236686:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788843406.236698:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:8415:x1875738134332672:12345-0@lo:253: 20000000:01000000:0.0:1788843406.236741:0:6498:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788843406.236747:0:6498:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788843406.236754:0:6498:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788843406.236758:0:6498:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788843406.237121:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788843406.237444:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788843406.237462:0:6498:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788843406.237481:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788843406.237487:0:6498:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788843406.237510:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788843406.237527:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788843406.237621:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788843406.237640:0:6498:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.133@tcp 20000000:01000000:0.0:1788843406.237642:0:6498:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.133@tcp (null) (null) (null) 00000040:00080000:0.0:1788843406.237656:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788843406.237664:0:6498:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788843406.237679:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788843406.237701:0:6498:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.133@tcp (null) (null) 00000040:00080000:0.0:1788843406.237718:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788843406.237726:0:6498:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788843406.237739:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788843406.237754:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788843406.237822:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1788843406.237832:0:6498:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.133@tcp 20000000:01000000:0.0:1788843406.237834:0:6498:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.133@tcp (null) (null) (null) 00000040:00080000:0.0:1788843406.237848:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1788843406.237856:0:6498:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788843406.237869:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1788843406.237874:0:6498:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.133@tcp (null) (null) 00000040:00080000:0.0:1788843406.237886:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1788843406.237891:0:6498:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788843406.240085:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1788843406.240357:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1788843406.240850:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1788843406.240873:0:6498:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.133@tcp 20000000:01000000:0.0:1788843406.240877:0:6498:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.133@tcp (null) (null) (null) 00000040:00080000:0.0:1788843406.240894:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1788843406.241367:0:6498:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788843406.241397:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1788843406.241406:0:6498:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.133@tcp (null) (null) 00000040:00080000:0.0:1788843406.241421:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1788843406.241430:0:6498:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788843406.241443:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1788843406.241459:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1788843406.241477:0:6498:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788843406.241481:0:6498:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788843406.241485:0:6498:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788843406.241553:0:6498:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788843406.241570:0:6498:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788843406.242436:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1788843406.242771:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1788843406.242801:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1788843406.242818:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1788843406.242835:0:6498:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1788843406.242838:0:6498:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788843406.243742:0:8435:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1788843406.243781:0:8435:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1788843406.243796:0:8435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1788843406.244340:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1788843406.244372:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1788843406.244390:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:2.0:1788843406.244417:0:6498:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788843406.244420:0:6498:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788843406.244989:0:8436:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:0.0:1788843406.245021:0:8436:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:0.0:1788843406.245041:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788843406.245552:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788843406.245578:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788843406.245591:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1788843406.245600:0:6498:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788843406.245602:0:6498:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788843406.245984:0:8437:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1788843406.246007:0:8437:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1788843406.246023:0:8437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788843406.246486:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1788843406.246519:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1788843406.246536:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 10000000:01000000:2.0:1788843406.246567:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788843406.246593:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d0d96 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843406.246613:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd1420e4800/0xa762dfcbd58d0c62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0c5b expref: 18 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843406.246621:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd1153e7000/0xa762dfcbd58d0cd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0cd2 expref: 18 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843406.246628:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd10f7ae000/0xa762dfcbd58d0d11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0d0a expref: 18 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843406.246635:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd1153e6c00/0xa762dfcbd58d0d2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0d26 expref: 18 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843406.246641:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0d57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0d50 expref: 18 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843406.246649:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d0d96 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843406.246701:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0d57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0d50 expref: 18 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843406.246729:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0d57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0d50 expref: 18 pid: 6501 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843406.246748:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e877100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6498:1875738134332800:0@lo:104: 00000100:00100000:2.0:1788843406.246834:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788843406.247021:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd1153e6c00/0xa762dfcbd58d0d2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0d26 expref: 18 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843406.247030:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd1153e6c00/0xa762dfcbd58d0d2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0d26 expref: 18 pid: 6498 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843406.247038:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e874e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6498:1875738134332928:0@lo:104: 00000100:00100000:2.0:1788843406.247075:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788843406.247481:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd10f7ae000/0xa762dfcbd58d0d11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0d0a expref: 18 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843406.247491:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd10f7ae000/0xa762dfcbd58d0d11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0d0a expref: 18 pid: 6501 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843406.247511:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e875f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6498:1875738134333056:0@lo:104: 00000100:00100000:2.0:1788843406.247539:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843406.247597:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134332800 00000100:00100000:3.0:1788843406.247607:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134332800 00000100:00100000:3.0:1788843406.247659:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134332928 00000100:00100000:3.0:1788843406.247663:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134332928 00000100:00100000:3.0:1788843406.247681:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788843406.247691:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e877b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+4:6498:x1875738134332800:12345-0@lo:104: 00010000:00010000:3.0:1788843406.247706:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afa00/0xa762dfcbd58d0d50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0d57 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.247774:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788843406.247780:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e877b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+4:6498:x1875738134332800:12345-0@lo:104: Request processed in 91us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843406.247788:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788843406.247809:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788843406.247816:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e875500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+3:6498:x1875738134332928:12345-0@lo:104: 00010000:00010000:3.0:1788843406.247823:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0d26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0d2d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.247863:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788843406.247868:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e875500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+3:6498:x1875738134332928:12345-0@lo:104: Request processed in 54us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843406.247874:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1788843406.248023:0:6495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788843406.248032:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afa00/0xa762dfcbd58d0d50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0d57 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.248040:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7afa00 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:1.0:1788843406.248045:0:6495:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afa00/0xa762dfcbd58d0d50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0d57 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.248054:0:6495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afa00/0xa762dfcbd58d0d50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0d57 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788843406.248073:0:6495:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afa00/0xa762dfcbd58d0d50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0d57 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843406.248101:0:6495:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788843406.248165:0:6495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afa00/0xa762dfcbd58d0d50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0d57 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.248173:0:6495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788843406.248194:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afa00/0xa762dfcbd58d0d50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0d57 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.248203:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afa00/0xa762dfcbd58d0d50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0d57 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.248221:0:6495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843406.248224:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0d26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0d2d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.248230:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e6200 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:1.0:1788843406.248233:0:6495:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0d26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0d2d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.248240:0:6495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0d26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0d2d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788843406.248247:0:6495:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0d26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0d2d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843406.248252:0:6495:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788843406.248264:0:6495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0d26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0d2d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.248269:0:6495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788843406.248280:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0d26 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0d2d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.248286:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0d26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0d2d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.248295:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843406.248297:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843406.248299:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843406.248314:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134333184:0@lo:103: 00000100:00100000:1.0:1788843406.248346:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843406.248380:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843406.248385:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134333312:0@lo:103: 00000100:00100000:1.0:1788843406.248404:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843406.248435:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134333184 00000100:00100000:1.0:1788843406.248439:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134333184 00010000:00010000:1.0:1788843406.248461:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0d57 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0d50 expref: 19 pid: 6501 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843406.248482:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134333312 00000100:00100000:1.0:1788843406.248485:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134333312 00010000:00010000:1.0:1788843406.248495:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd1153e6c00/0xa762dfcbd58d0d2d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0d26 expref: 20 pid: 6498 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843406.248528:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788843406.248534:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12036b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:3630:x1875738134333184:12345-0@lo:103: 00010000:00010000:1.0:1788843406.248545:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843406.248551:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0d57 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0d50 expref: 20 pid: 6501 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.248572:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0d57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0d50 expref: 20 pid: 6501 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.248592:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843406.248619:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12036b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:3630:x1875738134333184:12345-0@lo:103: Request processed in 85us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843406.248625:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788843406.248639:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788843406.248645:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120369500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e79d9884-ba2e-42e7-accb-b4784b9c1837+19:3630:x1875738134333312:12345-0@lo:103: 00010000:00010000:1.0:1788843406.248652:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843406.248656:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd1153e6c00/0xa762dfcbd58d0d2d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0d26 expref: 19 pid: 6498 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.248665:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd1153e6c00/0xa762dfcbd58d0d2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0d26 expref: 19 pid: 6498 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.248674:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843406.248692:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120369500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e79d9884-ba2e-42e7-accb-b4784b9c1837+19:3630:x1875738134333312:12345-0@lo:103: Request processed in 48us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843406.248697:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788843406.248743:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134333312:0@lo:103: 00000100:00100000:1.0:1788843406.248752:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134333184:0@lo:103: 00010000:00010000:3.0:1788843406.249265:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843406.249404:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd1153e7000/0xa762dfcbd58d0cd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0cd2 expref: 18 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843406.249418:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd1153e7000/0xa762dfcbd58d0cd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0cd2 expref: 18 pid: 6500 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843406.249429:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e876680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6498:1875738134333440:0@lo:104: 00000100:00100000:2.0:1788843406.249476:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788843406.249497:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd1420e4800/0xa762dfcbd58d0c62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0c5b expref: 18 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843406.249518:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd1420e4800/0xa762dfcbd58d0c62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0c5b expref: 18 pid: 6498 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843406.249528:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e874700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6498:1875738134333568:0@lo:104: 00000100:00100000:2.0:1788843406.249550:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843406.249561:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e9c43c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788843406.249577:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0d57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0d50 expref: 18 pid: 6501 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843406.249591:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e877100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6498:1875738134332800:0@lo:104: 00010000:00010000:2.0:1788843406.249602:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1153e6c00/0xa762dfcbd58d0d2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0d26 expref: 17 pid: 6498 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843406.249610:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e874e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6498:1875738134332928:0@lo:104: 00000100:00100000:3.0:1788843406.249667:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134333056 00000100:00100000:3.0:1788843406.249678:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134333056 00000100:00100000:3.0:1788843406.249707:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134333440 00000100:00100000:3.0:1788843406.249709:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134333440 00000100:00100000:3.0:1788843406.249718:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134333568 00000100:00100000:3.0:1788843406.249721:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134333568 00000100:00100000:3.0:1788843406.249733:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788843406.249740:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e874a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+5:6498:x1875738134333056:12345-0@lo:104: 00010000:00010000:3.0:1788843406.249750:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d0d0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0d11 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.249808:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788843406.249814:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e874a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+5:6498:x1875738134333056:12345-0@lo:104: Request processed in 76us (2275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843406.249820:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788843406.249835:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788843406.249840:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e874380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+4:6498:x1875738134333440:12345-0@lo:104: 00010000:00010000:3.0:1788843406.249848:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af400/0xa762dfcbd58d0cd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0cd9 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.249876:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788843406.249881:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e874380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+4:6498:x1875738134333440:12345-0@lo:104: Request processed in 41us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843406.249886:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788843406.249896:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788843406.249902:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e875880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+3:6498:x1875738134333568:12345-0@lo:104: 00010000:00010000:3.0:1788843406.249909:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd100030200/0xa762dfcbd58d0c5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0c62 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.249960:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788843406.249970:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e875880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+3:6498:x1875738134333568:12345-0@lo:104: Request processed in 68us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843406.249975:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788843406.249989:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788843406.249994:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d0d0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0d11 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.250001:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7afe00 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:3.0:1788843406.250006:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d0d0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0d11 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.250014:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d0d0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0d11 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843406.250023:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d0d0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0d11 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843406.250028:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788843406.250054:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d0d0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0d11 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.250060:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788843406.250307:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134333696:0@lo:103: 00000100:00100000:2.0:1788843406.250350:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843406.250401:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e875f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6498:1875738134333056:0@lo:104: 00000100:00100000:2.0:1788843406.250410:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e876680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6498:1875738134333440:0@lo:104: 00000100:00100000:2.0:1788843406.250417:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e874700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6498:1875738134333568:0@lo:104: 00010000:00010000:2.0:1788843406.250445:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d0d96 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.250522:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d0d0a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0d11 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.250531:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d0d0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0d11 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.250545:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788843406.250548:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af400/0xa762dfcbd58d0cd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0cd9 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.250563:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7af400 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:3.0:1788843406.250567:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af400/0xa762dfcbd58d0cd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0cd9 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.250573:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af400/0xa762dfcbd58d0cd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0cd9 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843406.250579:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af400/0xa762dfcbd58d0cd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0cd9 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843406.250585:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788843406.250602:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af400/0xa762dfcbd58d0cd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0cd9 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.250608:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843406.250616:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af400/0xa762dfcbd58d0cd2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0cd9 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.250623:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af400/0xa762dfcbd58d0cd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0cd9 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.250631:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843406.250635:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd100030200/0xa762dfcbd58d0c5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0c62 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.250641:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd100030200 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:3.0:1788843406.250644:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd100030200/0xa762dfcbd58d0c5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0c62 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.250661:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd100030200/0xa762dfcbd58d0c5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0c62 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843406.250667:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd100030200/0xa762dfcbd58d0c5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0c62 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843406.250672:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788843406.250685:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd100030200/0xa762dfcbd58d0c5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0c62 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.250691:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843406.250702:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd100030200/0xa762dfcbd58d0c5b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0c62 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.250708:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd100030200/0xa762dfcbd58d0c5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0c62 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.250721:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843406.250723:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843406.250724:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843406.250773:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134333824:0@lo:103: 00000100:00100000:2.0:1788843406.250808:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843406.250945:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788843406.250957:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134333952:0@lo:103: 00000100:00100000:1.0:1788843406.250988:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788843406.251034:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843406.251053:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134333696 00000100:00100000:1.0:1788843406.251060:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134333696 00000100:00100000:2.0:1788843406.251324:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134333824 00000100:00100000:2.0:1788843406.251329:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134333824 00010000:00010000:2.0:1788843406.251360:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd1153e7000/0xa762dfcbd58d0cd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0cd2 expref: 17 pid: 6500 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843406.251388:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134333952 00000100:00100000:2.0:1788843406.251391:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134333952 00010000:00010000:2.0:1788843406.251404:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd1420e4800/0xa762dfcbd58d0c62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0c5b expref: 18 pid: 6498 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843406.251417:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788843406.251425:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:3633:x1875738134333824:12345-0@lo:103: 00010000:00010000:2.0:1788843406.251439:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843406.251445:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd1153e7000/0xa762dfcbd58d0cd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0cd2 expref: 18 pid: 6500 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843406.251456:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd1153e7000/0xa762dfcbd58d0cd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0cd2 expref: 18 pid: 6500 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843406.251471:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1153e7000/0xa762dfcbd58d0cd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0cd2 expref: 18 pid: 6500 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843406.251485:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843406.251549:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:3633:x1875738134333824:12345-0@lo:103: Request processed in 124us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843406.251556:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788843406.251572:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788843406.251579:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13332c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:3631:x1875738134333952:12345-0@lo:103: 00010000:00010000:2.0:1788843406.251587:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843406.251599:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd1420e4800/0xa762dfcbd58d0c62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0c5b expref: 16 pid: 6498 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843406.251608:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd1420e4800/0xa762dfcbd58d0c62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0c5b expref: 16 pid: 6498 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843406.251619:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1420e4800/0xa762dfcbd58d0c62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0c5b expref: 16 pid: 6498 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843406.251629:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843406.251657:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13332c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:3631:x1875738134333952:12345-0@lo:103: Request processed in 78us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843406.251663:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788843406.251695:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134333824:0@lo:103: 00010000:00010000:1.0:1788843406.251782:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd10f7ae000/0xa762dfcbd58d0d11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0d0a expref: 15 pid: 6501 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843406.251810:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788843406.251818:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:3632:x1875738134333696:12345-0@lo:103: 00010000:00010000:1.0:1788843406.251841:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843406.251847:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd10f7ae000/0xa762dfcbd58d0d11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0d0a expref: 15 pid: 6501 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.251856:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd10f7ae000/0xa762dfcbd58d0d11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0d0a expref: 15 pid: 6501 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.251868:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd10f7ae000/0xa762dfcbd58d0d11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0d0a expref: 15 pid: 6501 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.251881:0:7448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d0d96 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.251891:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d0d96 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.251907:0:7448:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d0d96 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.251927:0:7448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d0d96 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.251934:0:7448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d0d96 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.251952:0:7448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d0d96 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.251959:0:7448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e7e00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843406.251964:0:7448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d0d96 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.251972:0:7448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d0d96 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.251990:0:7448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d0d96 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.251999:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843406.252028:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e79d9884-ba2e-42e7-accb-b4784b9c1837+14:3632:x1875738134333696:12345-0@lo:103: Request processed in 212us (1679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843406.252035:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788843406.252231:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134333696:0@lo:103: 00000100:00100000:1.0:1788843406.252260:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134333952:0@lo:103: 00010000:00010000:1.0:1788843406.252276:0:6498:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d0d96 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.252285:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d0d96 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.252292:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d0d96 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788843406.252306:0:6498:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788843406.254613:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+13:8415:x1875738134332672:12345-0@lo:253: Request processed in 17904us (18245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843406.254629:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788843406.254746:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134332672:0@lo:253: 10000000:01000000:3.0:1788843406.254764:0:8415:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788843406.254768:0:8415:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788843406.254770:0:8415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788843406.254772:0:8415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788843406.254773:0:8415:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788843406.254775:0:8415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788843406.254776:0:8415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788843406.254779:0:8415:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788843406.254781:0:8415:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788843406.254783:0:8415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788843406.254797:0:8415:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788843406.254820:0:8415:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bd10c0f0000 from lustre-OST0000 10000000:01000000:3.0:1788843406.254871:0:8415:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788843406.254875:0:8415:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788843406.254886:0:8415:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bd13339b370 local copy 10000000:01000000:3.0:1788843406.254891:0:8415:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788843406.254946:0:8415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d0d9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.254959:0:8415:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d0d9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.254971:0:8415:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d0d9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843406.254992:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134334080:0@lo:101: 00000100:00100000:3.0:1788843406.255032:0:8415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843406.255300:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd133117480 going to sleep for 11 seconds 00000100:00100000:2.0:1788843406.255365:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134334080 00000100:00100000:2.0:1788843406.255372:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134334080 00000100:00100000:2.0:1788843406.255426:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788843406.255437:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+13:8415:x1875738134334080:12345-0@lo:101: 00010000:00010000:2.0:1788843406.255451:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843406.255467:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1153e6600/0xa762dfcbd58d0da4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0d9d expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843406.255493:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1153e6600/0xa762dfcbd58d0da4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0d9d expref: 14 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843406.255517:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1153e6600/0xa762dfcbd58d0da4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0d9d expref: 14 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843406.255541:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e6600, rc 0) 00000100:00100000:2.0:1788843406.255584:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+14:8415:x1875738134334080:12345-0@lo:101: Request processed in 149us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843406.255590:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788843406.255689:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134334080:0@lo:101: 00010000:00010000:1.0:1788843406.255704:0:8415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d0d9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa762dfcbd58d0da4 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.255714:0:8415:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d0d9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa762dfcbd58d0da4 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843406.255831:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd12036b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134334208:0@lo:501: 00000100:00100000:1.0:1788843406.255861:0:8415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843406.255893:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10652b900 going to sleep for 11 seconds 00000100:00100000:2.0:1788843406.255996:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134334208 00000100:00100000:2.0:1788843406.256001:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134334208 00000100:00100000:2.0:1788843406.256031:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788843406.256038:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+14:8415:x1875738134334208:12345-0@lo:501: 00000100:00100000:2.0:1788843406.256214:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+14:8415:x1875738134334208:12345-0@lo:501: Request processed in 176us (351us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788843406.256222:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788843406.257089:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd12036b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134334208:0@lo:501: 10000000:01000000:1.0:1788843406.257114:0:8415:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.133@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788843406.257181:0:8415:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.133@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788843406.257190:0:8415:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d0d9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa762dfcbd58d0da4 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.257202:0:8415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d0d9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa762dfcbd58d0da4 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.257211:0:8415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d0d9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa762dfcbd58d0da4 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.257232:0:8415:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788843406.257263:0:8415:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bd10c0f0000 10000000:01000000:1.0:1788843406.257268:0:8415:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788843406.257275:0:8415:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788843406.257278:0:8415:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788843406.257283:0:8415:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788843406.257298:0:8415:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788843406.257326:0:8415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d0dab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.257334:0:8415:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d0dab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.257344:0:8415:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d0dab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843406.257362:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd12036b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134334336:0@lo:101: 00000100:00100000:1.0:1788843406.257409:0:8415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843406.257443:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10652b000 going to sleep for 11 seconds 00010000:00010000:3.0:1788843406.257685:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843406.257693:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d0d9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa762dfcbd58d0da4 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.257702:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7ae600 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:3.0:1788843406.257705:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d0d9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa762dfcbd58d0da4 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.257715:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d0d9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xa762dfcbd58d0da4 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843406.257722:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d0d9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xa762dfcbd58d0da4 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843406.257740:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788843406.257764:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d0d9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa762dfcbd58d0da4 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.257771:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843406.257798:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d0d9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa762dfcbd58d0da4 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.257805:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d0d9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa762dfcbd58d0da4 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.257817:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843406.257819:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843406.257821:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843406.258236:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134334464:0@lo:103: 00000100:00100000:1.0:1788843406.258278:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843406.258378:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134334464 00000100:00100000:3.0:1788843406.258387:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134334464 00000100:00100000:3.0:1788843406.258444:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788843406.258453:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120369500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e79d9884-ba2e-42e7-accb-b4784b9c1837+14:3631:x1875738134334464:12345-0@lo:103: 00010000:00010000:3.0:1788843406.258468:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843406.258482:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1153e6600/0xa762dfcbd58d0da4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d0d9d expref: 14 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.258513:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843406.258550:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120369500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e79d9884-ba2e-42e7-accb-b4784b9c1837+13:3631:x1875738134334464:12345-0@lo:103: Request processed in 98us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843406.258557:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788843406.258651:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134334336 00000100:00100000:2.0:1788843406.258656:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134334336 00000100:00100000:2.0:1788843406.258684:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788843406.258691:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+13:8415:x1875738134334336:12345-0@lo:101: 00010000:00010000:2.0:1788843406.258706:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843406.258722:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1153e7c00/0xa762dfcbd58d0db2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0dab expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843406.258744:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1153e7c00/0xa762dfcbd58d0db2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0dab expref: 14 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843406.258757:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1153e7c00/0xa762dfcbd58d0db2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0dab expref: 14 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843406.258764:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e7c00, rc 0) 00000100:00100000:2.0:1788843406.258799:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+14:8415:x1875738134334336:12345-0@lo:101: Request processed in 108us (1389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843406.258814:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788843406.259287:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134334464:0@lo:103: 00000100:00100000:1.0:1788843406.259326:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd12036b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134334336:0@lo:101: 00010000:00010000:1.0:1788843406.259340:0:8415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d0dab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0db2 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.259351:0:8415:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d0dab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0db2 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843406.259455:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd12036b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134334592:0@lo:501: 00000100:00100000:1.0:1788843406.259493:0:8415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843406.259535:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10652b000 going to sleep for 11 seconds 00000100:00100000:2.0:1788843406.260025:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134334592 00000100:00100000:2.0:1788843406.260033:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134334592 00000100:00100000:2.0:1788843406.260369:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788843406.260383:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+14:8415:x1875738134334592:12345-0@lo:501: 00000100:00100000:2.0:1788843406.260543:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+14:8415:x1875738134334592:12345-0@lo:501: Request processed in 164us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843406.260551:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788843406.261026:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd12036b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134334592:0@lo:501: 00000100:00100000:1.0:1788843406.261093:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd12036b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134334720:0@lo:503: 00000100:00100000:1.0:1788843406.261198:0:8415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843406.261229:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10652b000 going to sleep for 11 seconds 00000100:00100000:2.0:1788843406.261292:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134334720 00000100:00100000:2.0:1788843406.261297:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134334720 00000100:00100000:2.0:1788843406.261336:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788843406.261343:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+14:8415:x1875738134334720:12345-0@lo:503: 00000100:00100000:2.0:1788843406.261440:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+14:8415:x1875738134334720:12345-0@lo:503: Request processed in 96us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843406.261446:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788843406.261761:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd12036b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134334720:0@lo:503: 00000040:00080000:1.0:1788843406.262093:0:8415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788843406.262228:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd12036b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134334848:0@lo:502: 00000100:00100000:1.0:1788843406.262281:0:8415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843406.262317:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10652b000 going to sleep for 11 seconds 00000100:00100000:2.0:1788843406.262621:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134334848 00000100:00100000:2.0:1788843406.262628:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134334848 00000100:00100000:2.0:1788843406.262678:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788843406.262688:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+14:8415:x1875738134334848:12345-0@lo:502: 00000100:00100000:2.0:1788843406.262810:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+14:8415:x1875738134334848:12345-0@lo:502: Request processed in 123us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843406.262818:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788843406.263544:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd12036b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134334848:0@lo:502: 00000040:00080000:1.0:1788843406.263895:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788843406.263942:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788843406.263959:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788843406.263974:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788843406.263989:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788843406.264003:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788843406.264041:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd12036b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134334976:0@lo:502: 00000100:00100000:1.0:1788843406.264440:0:8415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843406.264524:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10652b000 going to sleep for 11 seconds 00000100:00100000:3.0:1788843406.264752:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134334976 00000100:00100000:3.0:1788843406.264762:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134334976 00000100:00100000:3.0:1788843406.264879:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788843406.264898:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+14:8415:x1875738134334976:12345-0@lo:502: 00000100:00100000:3.0:1788843406.265052:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+14:8415:x1875738134334976:12345-0@lo:502: Request processed in 155us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843406.265060:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788843406.265765:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd12036b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134334976:0@lo:502: 00000040:00080000:0.0:1788843406.265990:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788843406.266005:0:8415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1788843406.266822:0:8438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788843406.266834:0:8438:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1788843406.267586:0:8438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843406.267591:0:8438:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788843406.267600:0:8438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788843406.267622:0:8438:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9bd10fbb3370) 00000020:00000080:2.0:1788843406.267652:0:8438:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788843406.267668:0:8438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788843406.267755:0:8438:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd10c0f0000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788843406.267765:0:8438:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788843406.267779:0:8438:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa762dfcbd58d0dc0 00010000:00010000:2.0:1788843406.283896:0:8438:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:2.0:1788843406.284310:0:8438:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788843406.293084:0:8438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788843406.294622:0:8438:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1788843406.303059:0:8438:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1788843406.303544:0:8438:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1788843406.312037:0:8438:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1788843406.314455:0:8438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788843406.314471:0:8438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843406.314479:0:8438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843406.314481:0:8438:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788843406.314485:0:8438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843406.314490:0:8438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843406.314491:0:8438:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788843406.314494:0:8438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788843406.314496:0:8438:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788843406.314534:0:8438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843406.314538:0:8438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843406.314545:0:8438:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788843406.314549:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788843406.314878:0:8415:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1788843406.314921:0:8415:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788843406.314947:0:8415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d0dab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0db2 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843406.314961:0:8415:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d0dab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0db2 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843406.314970:0:8415:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd10c0f0000 from 1 10000000:01000000:0.0:1788843406.314973:0:8415:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788843406.315017:0:8415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd100030200/0xa762dfcbd58d0dc7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843406.315031:0:8415:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd100030200/0xa762dfcbd58d0dc7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843406.315044:0:8415:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd100030200/0xa762dfcbd58d0dc7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843406.315256:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e87bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134335104:0@lo:101: 00000100:00100000:0.0:1788843406.315339:0:8415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843406.315404:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1116c19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843406.315539:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134335104 00000100:00100000:2.0:1788843406.315548:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134335104 00000100:00100000:2.0:1788843406.315607:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788843406.315618:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+14:8415:x1875738134335104:12345-0@lo:101: 00010000:00010000:2.0:1788843406.315634:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843406.315649:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1153e7000/0xa762dfcbd58d0dce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0dc7 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843406.315678:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1153e7000/0xa762dfcbd58d0dce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0dc7 expref: 15 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843406.315691:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1153e7000/0xa762dfcbd58d0dce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0dc7 expref: 15 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843406.315701:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e7000, rc 0) 00000100:00100000:2.0:1788843406.315744:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:8415:x1875738134335104:12345-0@lo:101: Request processed in 128us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843406.315751:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788843406.315883:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e87bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134335104:0@lo:101: 00010000:00010000:0.0:1788843406.315898:0:8415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd100030200/0xa762dfcbd58d0dc7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0dce expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843406.315917:0:8415:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd100030200/0xa762dfcbd58d0dc7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0dce expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843406.316007:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e87bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134335232:0@lo:501: 00000100:00100000:0.0:1788843406.316032:0:8415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843406.316093:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1116c19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843406.318567:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134335232 00000100:00100000:2.0:1788843406.318585:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134335232 00000100:00100000:2.0:1788843406.318662:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788843406.318675:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:8415:x1875738134335232:12345-0@lo:501: 00000100:00100000:2.0:1788843406.318892:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:8415:x1875738134335232:12345-0@lo:501: Request processed in 219us (2858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843406.318901:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788843406.322535:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e87bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134335232:0@lo:501: 00000100:00100000:0.0:1788843406.322622:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e87bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134335360:0@lo:503: 00000100:00100000:0.0:1788843406.322719:0:8415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843406.322777:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1116c19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843406.322850:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134335360 00000100:00100000:2.0:1788843406.322859:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134335360 00000100:00100000:2.0:1788843406.322925:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788843406.322937:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:8415:x1875738134335360:12345-0@lo:503: 00000100:00100000:2.0:1788843406.323111:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:8415:x1875738134335360:12345-0@lo:503: Request processed in 175us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843406.323120:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788843406.323341:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e87bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134335360:0@lo:503: 00000040:00080000:0.0:1788843406.323650:0:8415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788843406.323747:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e87bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134335488:0@lo:502: 00000100:00100000:0.0:1788843406.323795:0:8415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843406.323832:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1116c19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843406.323855:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134335488 00000100:00100000:0.0:1788843406.323861:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134335488 00000100:00100000:0.0:1788843406.323887:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788843406.323894:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:8415:x1875738134335488:12345-0@lo:502: 00000100:00100000:0.0:1788843406.323991:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:8415:x1875738134335488:12345-0@lo:502: Request processed in 96us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843406.323998:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788843406.324035:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e87bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134335488:0@lo:502: 00000040:00080000:0.0:1788843406.324491:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788843406.324532:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788843406.324559:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e87bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134335616:0@lo:502: 00000100:00100000:0.0:1788843406.324599:0:8415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843406.324611:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1116c19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843406.324638:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134335616 00000100:00100000:0.0:1788843406.324642:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134335616 00000100:00100000:0.0:1788843406.324663:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788843406.324669:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:8415:x1875738134335616:12345-0@lo:502: 00000100:00100000:0.0:1788843406.324745:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:8415:x1875738134335616:12345-0@lo:502: Request processed in 75us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843406.324753:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788843406.324789:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e87bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134335616:0@lo:502: 00000040:00080000:0.0:1788843406.324826:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788843406.324834:0:8415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788843406.327480:0:8442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843406.327517:0:8442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843406.327521:0:8442:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788843406.327531:0:8442:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd10c0f0000 00000020:00000080:0.0:1788843406.327534:0:8442:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788843406.327549:0:8442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843406.327552:0:8442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843406.327554:0:8442:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788843406.327557:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788843406.329286:0:8415:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788843406.329334:0:8415:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788843406.329358:0:8415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd100030200/0xa762dfcbd58d0dc7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0dce expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.329375:0:8415:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd100030200/0xa762dfcbd58d0dc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0dce expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843406.329449:0:8415:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788843406.329453:0:8415:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bd10c0f0000 10000000:01000000:3.0:1788843406.329457:0:8415:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bd10c0f0000 10000000:01000000:3.0:1788843406.329463:0:8415:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788843406.329470:0:8415:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd10c0f0000 from 1 10000000:01000000:3.0:1788843406.329473:0:8415:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788843406.329533:0:8415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d0dd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.329542:0:8415:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d0dd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.329555:0:8415:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d0dd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843406.329584:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134335744:0@lo:101: 00000100:00100000:3.0:1788843406.329693:0:8415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843406.329740:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd133117cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843406.329846:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134335744 00000100:00100000:0.0:1788843406.329854:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134335744 00000100:00100000:0.0:1788843406.329918:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788843406.329929:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:8415:x1875738134335744:12345-0@lo:101: 00010000:00010000:0.0:1788843406.329945:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843406.329961:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0ddc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0dd5 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843406.329989:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0ddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0dd5 expref: 16 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843406.330002:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0ddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0dd5 expref: 16 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843406.330011:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd100030e00, rc 0) 00000100:00100000:0.0:1788843406.330059:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:8415:x1875738134335744:12345-0@lo:101: Request processed in 132us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843406.330325:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788843406.330387:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134335744:0@lo:101: 00010000:00010000:0.0:1788843406.330405:0:8415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d0dd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0ddc expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843406.330430:0:8415:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d0dd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0ddc expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843406.330557:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e87bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134335872:0@lo:501: 00000100:00100000:0.0:1788843406.330588:0:8415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843406.330615:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10938c900 going to sleep for 11 seconds 00000100:00100000:3.0:1788843406.330706:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134335872 00000100:00100000:3.0:1788843406.330713:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134335872 00000100:00100000:3.0:1788843406.330749:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788843406.330757:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:8415:x1875738134335872:12345-0@lo:501: 00000100:00100000:3.0:1788843406.330880:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:8415:x1875738134335872:12345-0@lo:501: Request processed in 123us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843406.330887:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788843406.332014:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e87bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134335872:0@lo:501: 00000100:00100000:0.0:1788843406.332235:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e87bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134336000:0@lo:503: 00000100:00100000:0.0:1788843406.332312:0:8415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843406.332361:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10938c900 going to sleep for 11 seconds 00000100:00100000:2.0:1788843406.332475:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134336000 00000100:00100000:2.0:1788843406.332483:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134336000 00000100:00100000:2.0:1788843406.332549:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788843406.332559:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:8415:x1875738134336000:12345-0@lo:503: 00000100:00100000:2.0:1788843406.332715:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:8415:x1875738134336000:12345-0@lo:503: Request processed in 157us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843406.332723:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788843406.333681:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e87bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134336000:0@lo:503: 00000040:00080000:1.0:1788843406.334030:0:8415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788843406.334655:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134336128:0@lo:502: 00000100:00100000:1.0:1788843406.334734:0:8415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843406.336318:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10652bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788843406.336431:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134336128 00000100:00100000:0.0:1788843406.336441:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134336128 00000100:00100000:0.0:1788843406.336511:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788843406.336523:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:8415:x1875738134336128:12345-0@lo:502: 00000100:00100000:0.0:1788843406.336718:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:8415:x1875738134336128:12345-0@lo:502: Request processed in 197us (1984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843406.336727:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788843406.337281:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134336128:0@lo:502: 00000040:00080000:1.0:1788843406.337566:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788843406.337602:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788843406.337636:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788843406.337653:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788843406.337664:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788843406.337674:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788843406.337684:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788843406.337695:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788843406.337707:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788843406.337719:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788843406.337732:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788843406.337747:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788843406.337761:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788843406.337773:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788843406.337787:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788843406.337800:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788843406.337812:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788843406.337823:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788843406.337849:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788843406.337866:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788843406.337881:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788843406.337895:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788843406.337909:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788843406.337937:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788843406.337951:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1788843406.337965:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1788843406.337978:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1788843406.337992:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1788843406.338006:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1788843406.338021:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1788843406.338034:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1788843406.338047:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1788843406.338078:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1788843406.338096:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1788843406.338124:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1788843406.339896:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1788843406.339972:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1788843406.340040:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134336256:0@lo:502: 00000100:00100000:1.0:1788843406.340475:0:8415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843406.340542:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10652bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788843406.340652:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134336256 00000100:00100000:2.0:1788843406.340662:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134336256 00000100:00100000:2.0:1788843406.340726:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788843406.340737:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:8415:x1875738134336256:12345-0@lo:502: 00000100:00100000:2.0:1788843406.340905:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:8415:x1875738134336256:12345-0@lo:502: Request processed in 169us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843406.340914:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788843406.341102:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134336256:0@lo:502: 00000040:00080000:3.0:1788843406.341366:0:8415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1788843406.341380:0:8415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788843406.342011:0:8443:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788843406.342031:0:8443:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9bd13df319b8) 00000020:00000080:3.0:1788843406.342074:0:8443:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788843406.342422:0:8443:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd10c0f0000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788843406.342427:0:8443:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd10c0f0000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788843406.342430:0:8443:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd10c0f0000 3 00010000:00080000:3.0:1788843406.342468:0:8443:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd006461800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.133@tcp at head 00010000:00010000:3.0:1788843406.345470:0:8443:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1788843406.345929:0:8443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788843406.345985:0:8443:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788843406.346001:0:8443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa762dfcbd58d0dea 00000100:00080000:3.0:1788843406.346015:0:8443:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788843406.346022:0:8443:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bd006461800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:3.0:1788843406.346081:0:8443:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd1203d2680 x1875738134336384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788843406.347648:0:8443:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788843406.347763:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3629:1875738134336384:0@lo:38: 00000100:00100000:0.0:1788843406.347861:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843406.348023:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e87a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134336512:0@lo:400: 00000100:00100000:0.0:1788843406.348057:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843406.348104:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788843406.348111:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134336640:0@lo:400: 00000100:00100000:0.0:1788843406.348163:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843406.348320:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e879500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134336768:0@lo:400: 00000100:00100000:0.0:1788843406.348345:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843406.348363:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788843406.348369:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e879180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134336896:0@lo:400: 00000100:00100000:0.0:1788843406.348387:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843406.348422:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134336384 00000100:00100000:0.0:1788843406.348431:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134336384 00000100:00100000:0.0:1788843406.348459:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134336512 00000100:00100000:0.0:1788843406.348462:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134336512 00000100:00100000:0.0:1788843406.348489:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134336768 00000100:00100000:0.0:1788843406.348492:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134336768 00000100:00100000:0.0:1788843406.348522:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788843406.348543:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e87a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134336512:12345-0@lo:400: 00000100:00100000:0.0:1788843406.348608:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e87a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134336512:12345-0@lo:400: Request processed in 66us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843406.348615:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788843406.348633:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788843406.348640:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e879c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134336768:12345-0@lo:400: 00000100:00100000:0.0:1788843406.348673:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e879c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134336768:12345-0@lo:400: Request processed in 34us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843406.348679:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788843406.348691:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788843406.348696:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3629:x1875738134336384:12345-0@lo:38: 00010000:00080000:0.0:1788843406.348724:0:6508:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 184 last 0 00000020:00000080:0.0:1788843406.348765:0:6508:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa762dfcbd58d0df1 00000004:00100000:0.0:1788843406.348786:0:6508:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788843406.348825:0:6508:0:(import.c:65:import_set_state_nolock()) ffff9bd13fbc3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788843406.348881:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1875738134336384:12345-0@lo:38: Request processed in 184us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843406.348888:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788843406.348912:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134336640 00000100:00100000:0.0:1788843406.348918:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134336640 00000100:00100000:0.0:1788843406.348946:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134336896 00000100:00100000:0.0:1788843406.348949:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134336896 00000100:00100000:0.0:1788843406.348963:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788843406.348969:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e87bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134336640:12345-0@lo:400: 00000100:00100000:0.0:1788843406.349005:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e87bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134336640:12345-0@lo:400: Request processed in 35us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843406.349010:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788843406.349023:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788843406.349030:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e87b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134336896:12345-0@lo:400: 00000100:00100000:0.0:1788843406.349058:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e87b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134336896:12345-0@lo:400: Request processed in 29us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843406.349064:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788843406.350462:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e879180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134336896:0@lo:400: 00010000:00080000:0.0:1788843406.350486:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd13e879500 x1875738134336768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843406.350508:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e879500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134336768:0@lo:400: 00000100:00100000:0.0:1788843406.350802:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134336640:0@lo:400: 00010000:00080000:0.0:1788843406.350817:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd13e87a680 x1875738134336512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843406.350827:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e87a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134336512:0@lo:400: 00010000:00080000:0.0:1788843406.350882:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd1203d2680 x1875738134336384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788843416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843406.350891:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788843406.350902:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788843406.350912:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788843406.350918:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788843406.350923:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd006461800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788843406.350930:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3629:1875738134336384:0@lo:38: 00000020:01000004:2.0:1788843406.351838:0:8443:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788843406.351860:0:8443:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9bd10fbb19b8) 00000020:00000080:2.0:1788843406.351892:0:8443:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1788843406.351998:0:8443:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd10c0f0000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788843406.352002:0:8443:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd10c0f0000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788843406.352005:0:8443:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd10c0f0000 3 00010000:00080000:2.0:1788843406.352040:0:8443:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd0059c6000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.133@tcp at head 00010000:00010000:2.0:1788843406.355974:0:8443:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:2.0:1788843406.356290:0:8443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788843406.356349:0:8443:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788843406.356369:0:8443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xa762dfcbd58d0dff 00000100:00080000:2.0:1788843406.356383:0:8443:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788843406.356391:0:8443:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9bd0059c6000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:2.0:1788843406.356438:0:8443:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd0059dc380 x1875738134337024/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788843406.356470:0:8443:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788843406.359943:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3629:1875738134337024:0@lo:38: 00000100:00100000:3.0:1788843406.360049:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843406.366721:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134337024 00000100:00100000:0.0:1788843406.366741:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134337024 00000100:00100000:0.0:1788843406.366799:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788843406.366810:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3629:x1875738134337024:12345-0@lo:38: 00010000:00080000:0.0:1788843406.366849:0:6508:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 184 last 0 00000020:00000080:0.0:1788843406.366895:0:6508:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xa762dfcbd58d0e06 00000004:00100000:0.0:1788843406.366916:0:6508:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788843406.366956:0:6508:0:(import.c:65:import_set_state_nolock()) ffff9bd13fbc5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788843406.367056:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875738134337024:12345-0@lo:38: Request processed in 246us (7007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843406.367772:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788843406.367843:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd0059dc380 x1875738134337024/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788843416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843406.367859:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788843406.367870:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788843406.367879:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788843406.367884:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788843406.367900:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd0059c6000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788843406.367908:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3629:1875738134337024:0@lo:38: 00000040:00080000:3.0:1788843406.371381:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1788843406.372284:0:8415:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788843406.372332:0:8415:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788843406.372362:0:8415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d0dd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0ddc expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.372379:0:8415:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d0dd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0ddc expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788843406.372451:0:8415:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788843406.372454:0:8415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788843406.372455:0:8415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788843406.372457:0:8415:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788843406.372458:0:8415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788843406.372460:0:8415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788843406.372462:0:8415:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788843406.372463:0:8415:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788843406.372472:0:8415:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788843406.372473:0:8415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788843406.372475:0:8415:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788843406.372479:0:8415:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1788843406.372482:0:8415:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788843406.372483:0:8415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788843406.372484:0:8415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788843406.372485:0:8415:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788843406.372486:0:8415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788843406.372487:0:8415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788843406.372488:0:8415:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788843406.372489:0:8415:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788843406.372490:0:8415:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788843406.372491:0:8415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788843406.372491:0:8415:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788843406.372549:0:8415:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788843406.372576:0:8415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134337152:0@lo:253: 00000100:00100000:1.0:1788843406.372674:0:8415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843406.372735:0:8415:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10938c900 going to sleep for 11 seconds 00000100:00100000:3.0:1788843406.373386:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134337152 00000100:00100000:3.0:1788843406.373399:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134337152 00000100:00100000:3.0:1788843406.373476:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788843406.373488:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:8415:x1875738134337152:12345-0@lo:253: 20000000:01000000:3.0:1788843406.373546:0:6500:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788843406.373566:0:6500:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788843406.381268:0:6500:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788843406.381294:0:6500:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788843406.381351:0:6522:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788843406.381362:0:6522:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788843406.381392:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd100031600/0xa762dfcbd58d0e0d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843406.381421:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd10f7af600/0xa762dfcbd58d0d03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0cfc expref: 16 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843406.381432:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd1153e7a00/0xa762dfcbd58d0d1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0d18 expref: 16 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843406.381440:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd100031600/0xa762dfcbd58d0e0d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843406.381486:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd1153e7a00/0xa762dfcbd58d0d1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0d18 expref: 16 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843406.381517:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd1153e7a00/0xa762dfcbd58d0d1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0d18 expref: 16 pid: 6498 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843406.381532:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e87a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6522:1875738134337280:0@lo:104: 00000100:00100000:0.0:1788843406.381602:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788843406.381661:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd10f7af600/0xa762dfcbd58d0d03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0cfc expref: 16 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843406.381669:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd10f7af600/0xa762dfcbd58d0d03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0cfc expref: 16 pid: 6500 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843406.381677:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e879f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6522:1875738134337408:0@lo:104: 00000100:00100000:0.0:1788843406.381708:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1102b8300 going to sleep for 11 seconds 00000100:00100000:2.0:1788843406.381984:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788843406.382029:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843406.382407:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134337280 00000100:00100000:2.0:1788843406.382417:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134337280 00000100:00100000:2.0:1788843406.382463:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134337408 00000100:00100000:2.0:1788843406.382466:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134337408 00000100:00100000:2.0:1788843406.382482:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788843406.382492:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13f937450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+4:6522:x1875738134337280:12345-0@lo:104: 00010000:00010000:2.0:1788843406.383383:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd118f71c00/0xa762dfcbd58d0d18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0d1f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843406.386416:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:8415:x1875738134337152:12345-0@lo:253: Request processed in 12919us (13731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843406.386433:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788843406.386587:0:8415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:8415:1875738134337152:0@lo:253: 10000000:01000000:1.0:1788843406.386614:0:8415:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788843406.386618:0:8415:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788843406.386620:0:8415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788843406.386621:0:8415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788843406.386623:0:8415:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788843406.386624:0:8415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788843406.386625:0:8415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788843406.386627:0:8415:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788843406.386628:0:8415:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788843406.386630:0:8415:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788843406.386631:0:8415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788843406.386634:0:8415:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788843406.386651:0:8415:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1788843406.391362:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788843406.391386:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13f937450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+4:6522:x1875738134337280:12345-0@lo:104: Request processed in 8888us (9775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843406.391398:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e87a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6522:1875738134337280:0@lo:104: 00000100:00100000:3.0:1788843406.391410:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788843406.391492:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788843406.391721:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+3:6522:x1875738134337408:12345-0@lo:104: 00010000:00010000:3.0:1788843406.391745:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd118f70000/0xa762dfcbd58d0cfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0d03 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.391824:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788843406.391830:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+3:6522:x1875738134337408:12345-0@lo:104: Request processed in 317us (9804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843406.391838:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788843406.391875:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e879f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6522:1875738134337408:0@lo:104: 00010000:00010000:0.0:1788843406.391977:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd100031600/0xa762dfcbd58d0e0d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.392409:0:6495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788843406.392419:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd118f71c00/0xa762dfcbd58d0d18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0d1f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.392450:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd118f71c00 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:1.0:1788843406.392455:0:6495:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd118f71c00/0xa762dfcbd58d0d18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0d1f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.392464:0:6495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd118f71c00/0xa762dfcbd58d0d18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0d1f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788843406.392471:0:6495:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd118f71c00/0xa762dfcbd58d0d18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0d1f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843406.392478:0:6495:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788843406.392824:0:6495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd118f71c00/0xa762dfcbd58d0d18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0d1f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.392833:0:6495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788843406.392866:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd118f71c00/0xa762dfcbd58d0d18 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0d1f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.392874:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd118f71c00/0xa762dfcbd58d0d18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0d1f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.392892:0:6495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843406.392896:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd118f70000/0xa762dfcbd58d0cfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0d03 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843406.392905:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134337536:0@lo:103: 00010000:00010000:1.0:1788843406.392907:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd118f70000 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:1.0:1788843406.392912:0:6495:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd118f70000/0xa762dfcbd58d0cfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0d03 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.392929:0:6495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd118f70000/0xa762dfcbd58d0cfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0d03 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788843406.392935:0:6495:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd118f70000/0xa762dfcbd58d0cfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0d03 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843406.392941:0:6495:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788843406.392962:0:6495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd118f70000/0xa762dfcbd58d0cfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0d03 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.392968:0:6495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788843406.392973:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd118f70000/0xa762dfcbd58d0cfc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0d03 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.392987:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd118f70000/0xa762dfcbd58d0cfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0d03 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843406.393005:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843406.393006:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843406.393009:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843406.393071:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843406.393180:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134337664:0@lo:103: 00000100:00100000:0.0:1788843406.393197:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134337536 00000100:00100000:0.0:1788843406.393206:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134337536 00000100:00100000:3.0:1788843406.393242:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788843406.393250:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd1153e7a00/0xa762dfcbd58d0d1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0d18 expref: 16 pid: 6498 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843406.393292:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134337664 00000100:00100000:0.0:1788843406.393297:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134337664 00010000:00010000:0.0:1788843406.393314:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd10f7af600/0xa762dfcbd58d0d03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0cfc expref: 17 pid: 6500 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843406.393327:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788843406.393350:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e879f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:3632:x1875738134337536:12345-0@lo:103: 00010000:00010000:3.0:1788843406.393367:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843406.393381:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd1153e7a00/0xa762dfcbd58d0d1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0d18 expref: 17 pid: 6498 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.393394:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd1153e7a00/0xa762dfcbd58d0d1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0d18 expref: 17 pid: 6498 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.393411:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1153e7a00/0xa762dfcbd58d0d1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0d18 expref: 17 pid: 6498 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843406.393426:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843406.393466:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e879f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:3632:x1875738134337536:12345-0@lo:103: Request processed in 128us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843406.394018:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788843406.394033:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:3633:x1875738134337664:12345-0@lo:103: 00010000:00010000:0.0:1788843406.394052:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843406.394060:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd10f7af600/0xa762dfcbd58d0d03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0cfc expref: 16 pid: 6500 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843406.394073:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd10f7af600/0xa762dfcbd58d0d03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0cfc expref: 16 pid: 6500 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843406.394107:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd10f7af600/0xa762dfcbd58d0d03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0cfc expref: 16 pid: 6500 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843406.394125:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd100031600/0xa762dfcbd58d0e0d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843406.394135:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd100031600/0xa762dfcbd58d0e0d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788843406.394177:0:6491:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012816127s 00010000:00010000:0.0:1788843406.394182:0:6491:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd100031600/0xa762dfcbd58d0e0d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843406.394189:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd100031600/0xa762dfcbd58d0e0d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843406.394196:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd100031600/0xa762dfcbd58d0e0d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843406.394202:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd100031600/0xa762dfcbd58d0e0d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843406.394208:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd100031600 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843406.394212:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd100031600/0xa762dfcbd58d0e0d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843406.394220:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd100031600/0xa762dfcbd58d0e0d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843406.394235:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd100031600/0xa762dfcbd58d0e0d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843406.394259:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843406.394320:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:3633:x1875738134337664:12345-0@lo:103: Request processed in 291us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843406.394328:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788843406.394403:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134337664:0@lo:103: 00000100:00100000:0.0:1788843406.394443:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134337536:0@lo:103: 00010000:00010000:0.0:1788843406.394460:0:6522:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd100031600/0xa762dfcbd58d0e0d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843406.394468:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd100031600/0xa762dfcbd58d0e0d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843406.394474:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd100031600/0xa762dfcbd58d0e0d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788843406.394880:0:8415:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1788843406.395042:0:8415:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00010000:00010000:2.0:1788843406.395250:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1788843406.395973:0:8415:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00000100:00100000:3.0:1788843406.396419:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00080000:10000000:1.0:1788843406.397515:0:8415:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788843406.398928:0:8415:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1788843406.399658:0:8415:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1788843406.401622:0:8415:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788843406.420493:0:8415:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788843406.420510:0:8415:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788843406.420570:0:8415:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788843406.420620:0:8415:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.133@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788843406.420652:0:8415:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788843406.422373:0:8415:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788843406.423472:0:8415:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788843406.423678:0:8415:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1788843406.481488:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843407.260195:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134337792:0@lo:41: 00000100:00100000:2.0:1788843407.260299:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843407.260436:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134337792 00000100:00100000:2.0:1788843407.260447:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134337792 00000100:00100000:2.0:1788843407.260522:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788843407.260544:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134337792:12345-0@lo:41: 00000004:00000024:2.0:1788843407.260587:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:2.0:1788843407.260641:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134337792:12345-0@lo:41: Request processed in 98us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843407.260649:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788843407.260770:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134337792:0@lo:41: 00000100:00100000:1.0:1788843407.261081:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843407.261094:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134337920:0@lo:41: 00000100:00100000:1.0:1788843407.261131:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843407.261245:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134337920 00000100:00100000:3.0:1788843407.261251:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134337920 00000100:00100000:3.0:1788843407.261289:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788843407.261297:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12036aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134337920:12345-0@lo:41: 00000004:00000024:3.0:1788843407.261321:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788843407.261360:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12036aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134337920:12345-0@lo:41: Request processed in 65us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843407.261367:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788843407.261444:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134337920:0@lo:41: 00000020:00000004:3.0:1788843407.438061:0:8499:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788843407.439910:0:8499:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788843407.526826:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843408.541355:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843409.562488:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843410.599068:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843411.614983:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843411.868483:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134338048:0@lo:400: 00000100:00100000:3.0:1788843411.868568:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843411.868624:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd12036b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134338560:0@lo:400: 00000100:00100000:3.0:1788843411.868654:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843411.868682:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788843411.868688:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134338176:0@lo:400: 00000100:00100000:3.0:1788843411.868732:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843411.868749:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134338688:0@lo:400: 00000100:00100000:3.0:1788843411.868772:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843411.868806:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134338560 00000100:00100000:3.0:1788843411.868814:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134338560 00000100:00100000:3.0:1788843411.868859:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788843411.868868:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134338560:12345-0@lo:400: 00000100:00100000:3.0:1788843411.868922:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134338560:12345-0@lo:400: Request processed in 56us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843411.868929:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788843411.868954:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134338176 00000100:00100000:3.0:1788843411.868957:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134338176 00000100:00100000:3.0:1788843411.868981:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134338688 00000100:00100000:3.0:1788843411.868984:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134338688 00000100:00100000:3.0:1788843411.869007:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788843411.869014:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134338176:12345-0@lo:400: 00000100:00100000:3.0:1788843411.869044:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134338176:12345-0@lo:400: Request processed in 31us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843411.869051:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788843411.869064:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788843411.869070:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134338688:12345-0@lo:400: 00000100:00100000:3.0:1788843411.869096:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134338688:12345-0@lo:400: Request processed in 27us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843411.869103:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788843411.869173:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd120368a80 x1875738134338176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843411.869187:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134338176:0@lo:400: 00010000:00080000:3.0:1788843411.869208:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd120369c00 x1875738134338688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843411.869216:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134338688:0@lo:400: 00000100:00100000:3.0:1788843411.869224:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd12036b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134338560:0@lo:400: 00000100:00100000:1.0:1788843411.870544:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134338304:0@lo:400: 00000100:00100000:1.0:1788843411.870606:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843411.870643:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134338816:0@lo:400: 00000100:00100000:1.0:1788843411.870669:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843411.870690:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843411.870697:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134338432:0@lo:400: 00000100:00100000:1.0:1788843411.870719:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843411.870752:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134338048 00000100:00100000:1.0:1788843411.870759:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134338048 00000100:00100000:1.0:1788843411.870795:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788843411.870803:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+14:3632:x1875738134338048:12345-0@lo:400: 00000100:00100000:1.0:1788843411.870846:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+14:3632:x1875738134338048:12345-0@lo:400: Request processed in 43us (2278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843411.870852:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788843411.870940:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134338304 00000100:00100000:3.0:1788843411.870945:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134338304 00000100:00100000:3.0:1788843411.870980:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788843411.870986:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134338304:12345-0@lo:400: 00000100:00100000:3.0:1788843411.871022:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134338304:12345-0@lo:400: Request processed in 37us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843411.871028:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788843411.871050:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134338816 00000100:00100000:3.0:1788843411.871053:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134338816 00000100:00100000:3.0:1788843411.871077:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134338432 00000100:00100000:3.0:1788843411.871079:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134338432 00000100:00100000:3.0:1788843411.871091:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788843411.871096:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12036bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134338816:12345-0@lo:400: 00000100:00100000:3.0:1788843411.871122:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12036bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134338816:12345-0@lo:400: Request processed in 25us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843411.871127:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788843411.871138:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788843411.871164:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12036b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134338432:12345-0@lo:400: 00000100:00100000:3.0:1788843411.871189:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12036b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134338432:12345-0@lo:400: Request processed in 27us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843411.871195:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788843411.871230:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134338048:0@lo:400: 00000100:00080000:2.0:1788843411.871335:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788843411.871340:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788843411.873648:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd120368000 x1875738134338432/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843411.873671:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134338432:0@lo:400: 00000100:00100000:1.0:1788843411.873686:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134338304:0@lo:400: 00010000:00080000:1.0:1788843411.873698:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd120368380 x1875738134338816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843411.873706:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134338816:0@lo:400: 00000100:00100000:1.0:1788843412.379049:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843412.379073:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134338944:0@lo:41: 00000100:00100000:1.0:1788843412.379163:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843412.380657:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134339072:0@lo:41: 00000100:00100000:3.0:1788843412.380672:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134338944 00000100:00100000:3.0:1788843412.380681:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134338944 00000100:00100000:1.0:1788843412.380725:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843412.380731:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788843412.380743:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134338944:12345-0@lo:41: 00000004:00000024:3.0:1788843412.380790:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:1.0:1788843412.380798:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134339072 00000100:00100000:1.0:1788843412.380804:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134339072 00000100:00100000:1.0:1788843412.380829:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788843412.380838:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134339072:12345-0@lo:41: 00000100:00100000:3.0:1788843412.380848:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134338944:12345-0@lo:41: Request processed in 107us (1683us total) trans 0 rc 0/0 00000004:00000024:1.0:1788843412.380858:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788843412.380904:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134339072:12345-0@lo:41: Request processed in 56us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843412.380912:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788843412.380961:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134338944:0@lo:41: 00000100:00100000:1.0:1788843412.380993:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134339072:0@lo:41: 00000100:00100000:3.0:1788843412.381087:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:1.0:1788843412.639510:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788843413.440984:0:8789:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg333-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788843413.661287:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788843414.404126:0:8841:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788843414.404452:0:8841:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788843414.682578:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843415.706341:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788843415.962334:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788843415.962342:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd12e2b3800 from 30 10000000:01000000:0.0:1788843415.962347:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788843415.962398:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd100031400/0xa762dfcbd58d0e14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843415.962411:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd100031400/0xa762dfcbd58d0e14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843415.962423:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd100031400/0xa762dfcbd58d0e14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843415.962514:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e87a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134339200:0@lo:101: 00000100:00100000:0.0:1788843415.962594:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843415.962676:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd115125780 going to sleep for 11 seconds 00000100:00100000:2.0:1788843415.962926:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134339200 00000100:00100000:2.0:1788843415.962935:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134339200 00000100:00100000:2.0:1788843415.962996:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788843415.963007:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+14:6503:x1875738134339200:12345-0@lo:101: 00010000:00010000:2.0:1788843415.963021:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843415.963034:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1153e6c00/0xa762dfcbd58d0e1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0e14 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843415.963060:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1153e6c00/0xa762dfcbd58d0e1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0e14 expref: 15 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843415.963071:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1153e6c00/0xa762dfcbd58d0e1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0e14 expref: 15 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843415.963080:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e6c00, rc 0) 00000100:00100000:2.0:1788843415.963176:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:6503:x1875738134339200:12345-0@lo:101: Request processed in 136us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843415.963183:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788843415.963383:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e87a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134339200:0@lo:101: 00010000:00010000:0.0:1788843415.963400:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd100031400/0xa762dfcbd58d0e14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0e1b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843415.963410:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd100031400/0xa762dfcbd58d0e14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0e1b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843415.963504:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e87a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134339328:0@lo:501: 00000100:00100000:0.0:1788843415.963535:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843415.963567:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd115125780 going to sleep for 11 seconds 00000100:00100000:3.0:1788843415.963624:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134339328 00000100:00100000:3.0:1788843415.963629:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134339328 00000100:00100000:3.0:1788843415.963666:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788843415.963673:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:6503:x1875738134339328:12345-0@lo:501: 00000100:00100000:3.0:1788843415.963816:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:6503:x1875738134339328:12345-0@lo:501: Request processed in 143us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843415.963824:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788843415.963958:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e87a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134339328:0@lo:501: 00000100:00100000:0.0:1788843415.963994:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e87a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134339456:0@lo:503: 00000100:00100000:0.0:1788843415.964037:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843415.964060:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd115125780 going to sleep for 11 seconds 00000100:00100000:1.0:1788843415.964117:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134339456 00000100:00100000:1.0:1788843415.964122:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134339456 00000100:00100000:1.0:1788843415.964185:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788843415.964192:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:6503:x1875738134339456:12345-0@lo:503: 00000100:00100000:1.0:1788843415.964285:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:6503:x1875738134339456:12345-0@lo:503: Request processed in 94us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843415.964292:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788843415.964374:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e87a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134339456:0@lo:503: 00000100:00100000:0.0:1788843415.965412:0:8893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e87a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:8893:1875738134339584:0@lo:502: 00000100:00100000:0.0:1788843415.965489:0:8893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843415.965531:0:8893:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd115125cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843415.965601:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134339584 00000100:00100000:1.0:1788843415.965609:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134339584 00000100:00100000:1.0:1788843415.965651:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788843415.965660:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:8893:x1875738134339584:12345-0@lo:502: 00000100:00100000:1.0:1788843415.965790:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:8893:x1875738134339584:12345-0@lo:502: Request processed in 131us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843415.965796:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788843415.965993:0:8893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e87a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:8893:1875738134339584:0@lo:502: 00000100:00100000:0.0:1788843415.966056:0:8893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e87a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:8893:1875738134339712:0@lo:502: 00000100:00100000:0.0:1788843415.966098:0:8893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843415.966123:0:8893:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e936240 going to sleep for 11 seconds 00000100:00100000:2.0:1788843415.966185:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134339712 00000100:00100000:2.0:1788843415.966190:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134339712 00000100:00100000:2.0:1788843415.966226:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788843415.966234:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:8893:x1875738134339712:12345-0@lo:502: 00000100:00100000:2.0:1788843415.966334:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:8893:x1875738134339712:12345-0@lo:502: Request processed in 101us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843415.966341:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788843415.966460:0:8893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e87a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:8893:1875738134339712:0@lo:502: 00000040:00080000:0.0:1788843415.966481:0:8893:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788843415.966833:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788843415.966858:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788843415.966869:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd100031400/0xa762dfcbd58d0e14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0e1b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843415.966881:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd100031400/0xa762dfcbd58d0e14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0e1b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843415.966890:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788843415.966893:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd12e2b3800 from 5 10000000:01000000:2.0:1788843415.966896:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788843415.966926:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d0e22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843415.966934:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d0e22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843415.966943:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d0e22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843415.966967:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134339840:0@lo:101: 00000100:00100000:2.0:1788843415.966997:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843415.967031:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10652b900 going to sleep for 11 seconds 00000100:00100000:0.0:1788843415.967081:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134339840 00000100:00100000:0.0:1788843415.967087:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134339840 00000100:00100000:0.0:1788843415.967120:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788843415.967127:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:6503:x1875738134339840:12345-0@lo:101: 00010000:00010000:0.0:1788843415.967137:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843415.967193:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd100030a00/0xa762dfcbd58d0e29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0e22 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843415.967216:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd100030a00/0xa762dfcbd58d0e29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0e22 expref: 16 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843415.967227:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd100030a00/0xa762dfcbd58d0e29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0e22 expref: 16 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843415.967237:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd100030a00, rc 0) 00000100:00100000:0.0:1788843415.967277:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:6503:x1875738134339840:12345-0@lo:101: Request processed in 150us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843415.967284:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788843415.967837:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134339840:0@lo:101: 00010000:00010000:2.0:1788843415.967853:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d0e22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0e29 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843415.967864:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d0e22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0e29 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843415.967912:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134339968:0@lo:256: 00000100:00100000:2.0:1788843415.967947:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843415.968020:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10652b900 going to sleep for 11 seconds 00000100:00100000:1.0:1788843415.981015:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134339968 00000100:00100000:1.0:1788843415.981032:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134339968 00000100:00100000:1.0:1788843415.981109:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788843415.981121:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:6503:x1875738134339968:12345-0@lo:256: 20000000:01000000:1.0:1788843415.981161:0:6498:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788843415.981189:0:6498:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788843415.981192:0:6498:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788843415.981340:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:6503:x1875738134339968:12345-0@lo:256: Request processed in 221us (13391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843415.981348:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788843415.981481:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134339968:0@lo:256: 10000000:01000000:3.0:1788843415.981545:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788843415.981556:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d0e22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0e29 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843415.981565:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d0e22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0e29 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843415.981575:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788843415.981577:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:3.0:1788843415.981580:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788843415.981612:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d0e30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843415.981627:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d0e30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843415.981637:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d0e30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843415.981656:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134340096:0@lo:101: 00000100:00100000:3.0:1788843415.981695:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843415.981748:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd111699c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788843415.981974:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134340096 00000100:00100000:2.0:1788843415.981981:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134340096 00000100:00100000:2.0:1788843415.982024:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788843415.982033:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:6503:x1875738134340096:12345-0@lo:101: 00010000:00010000:2.0:1788843415.982042:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843415.982055:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d0e37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0e30 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843415.982080:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d0e37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0e30 expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843415.982090:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d0e37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0e30 expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843415.982112:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e7e00, rc 0) 00000100:00100000:2.0:1788843415.982172:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:6503:x1875738134340096:12345-0@lo:101: Request processed in 140us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843415.982178:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788843415.982308:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134340096:0@lo:101: 00010000:00010000:3.0:1788843415.982322:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d0e30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0e37 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843415.982331:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d0e30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0e37 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843415.982390:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134340224:0@lo:501: 00000100:00100000:3.0:1788843415.982416:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843415.982823:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134340224 00000100:00100000:2.0:1788843415.982829:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134340224 00000100:00100000:2.0:1788843415.982864:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788843415.982872:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:6503:x1875738134340224:12345-0@lo:501: 00000100:00100000:2.0:1788843415.982989:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:6503:x1875738134340224:12345-0@lo:501: Request processed in 118us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843415.982996:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788843415.983114:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd111699c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788843415.983128:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134340224:0@lo:501: 00000100:00100000:3.0:1788843415.983185:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134340352:0@lo:503: 00000100:00100000:3.0:1788843415.983230:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843415.983253:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd111699c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788843415.983307:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134340352 00000100:00100000:1.0:1788843415.983312:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134340352 00000100:00100000:1.0:1788843415.983346:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788843415.983354:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:6503:x1875738134340352:12345-0@lo:503: 00000100:00100000:1.0:1788843415.983455:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:6503:x1875738134340352:12345-0@lo:503: Request processed in 102us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843415.983462:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788843415.984927:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134340352:0@lo:503: 00000100:00100000:3.0:1788843415.987134:0:8894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:8894:1875738134340480:0@lo:502: 00000100:00100000:3.0:1788843415.987273:0:8894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843415.987324:0:8894:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd111699b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788843415.987458:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134340480 00000100:00100000:1.0:1788843415.987466:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134340480 00000100:00100000:1.0:1788843415.987515:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788843415.987525:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:8894:x1875738134340480:12345-0@lo:502: 00000100:00100000:0.0:1788843415.987964:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:8894:x1875738134340480:12345-0@lo:502: Request processed in 439us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843415.987974:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788843415.988428:0:8894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:8894:1875738134340480:0@lo:502: 00000020:01000000:3.0:1788843415.989830:0:8894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788843415.989841:0:8894:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788843415.989852:0:8894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843415.989855:0:8894:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788843415.989866:0:8894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788843415.989871:0:8894:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.133@tcp to nid 0x20000c0a8cb85 (192.168.203.133@tcp) 00000020:01000000:3.0:1788843415.989898:0:8894:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788843415.989902:0:8894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788843415.989922:0:8894:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9bd13df34d28) 00000020:00000080:3.0:1788843415.989946:0:8894:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1788843415.989952:0:8894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788843415.990075:0:8894:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788843415.990082:0:8894:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788843415.990089:0:8894:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa762dfcbd58d0e45 00010000:00080000:3.0:1788843415.990123:0:8894:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd13e958800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.133@tcp at head 00010000:00010000:3.0:1788843415.990394:0:8894:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1788843416.003626:0:8894:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788843416.003654:0:8894:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788843416.003892:0:8894:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788843416.004111:0:8894:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788843416.004396:0:8894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788843416.004512:0:8894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788843416.005660:0:8895:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788843416.005666:0:8895:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788843416.012374:0:8894:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788843416.012389:0:8894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788843416.012457:0:8894:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788843416.012486:0:8894:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa762dfcbd58d0e4c 00000100:00080000:2.0:1788843416.012497:0:8894:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788843416.012503:0:8894:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9bd13e958800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:2.0:1788843416.012539:0:8894:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd0059dc000 x1875738134340608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788843416.012565:0:8894:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1788843416.012663:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134340608:0@lo:8: 00000100:00100000:0.0:1788843416.012743:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843416.012877:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134340608 00000100:00100000:1.0:1788843416.012883:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134340608 00000100:00100000:1.0:1788843416.012921:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788843416.012929:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e87a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3629:x1875738134340608:12345-0@lo:8: 00010000:00080000:1.0:1788843416.012953:0:8421:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:1.0:1788843416.012991:0:8421:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa762dfcbd58d0e53 00002000:00100000:1.0:1788843416.013026:0:8421:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9bd00644b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396f ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788843416.013031:0:8421:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:1.0:1788843416.013035:0:8421:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788843416.013107:0:8421:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788843416.013369:0:8421:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1788843416.013395:0:8421:0:(import.c:65:import_set_state_nolock()) ffff9bd00644a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843416.013467:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e87a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3629:x1875738134340608:12345-0@lo:8: Request processed in 537us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843416.013475:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788843416.013519:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd0059dc000 x1875738134340608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788843426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843416.013529:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788843416.013546:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788843416.013553:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788843416.013557:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788843416.013561:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd13e958800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788843416.019202:0:8896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8896:1875738134340736:0@lo:700: 00000100:00100000:3.0:1788843416.019286:0:8896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843416.019338:0:8896:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd111699240 going to sleep for 11 seconds 00000100:00100000:0.0:1788843416.019542:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134340736 00000100:00100000:0.0:1788843416.019565:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134340736 00000100:00100000:0.0:1788843416.019639:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788843416.019649:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8896:x1875738134340736:12345-0@lo:700: 00000100:00100000:0.0:1788843416.019689:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e879500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8430:1875738134340864:0@lo:700: 00000100:00100000:0.0:1788843416.019736:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843416.019758:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e936b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788843416.019774:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134340864 00000100:00100000:0.0:1788843416.019777:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134340864 00000100:00100000:0.0:1788843416.019811:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788843416.019818:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8430:x1875738134340864:12345-0@lo:700: 00000020:01000000:2.0:1788843416.020402:0:8894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843416.020410:0:8894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843416.020413:0:8894:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788843416.020416:0:8894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788843416.020420:0:8894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843416.020422:0:8894:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788843416.020424:0:8894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788843416.020447:0:8894:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788843416.020474:0:8894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059dfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:8894:1875738134340992:0@lo:502: 00000100:00100000:2.0:1788843416.020532:0:8894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843416.020560:0:8894:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10652b3c0 going to sleep for 11 seconds 00000100:00080000:3.0:1788843416.021064:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788843416.021078:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788843416.021236:0:3629:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788843416.021247:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134340608:0@lo:8: 00000100:00100000:1.0:1788843416.021355:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134341504:0@lo:400: 00000100:00100000:1.0:1788843416.021394:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843416.021430:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788843416.021447:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134341120:0@lo:400: 00000100:00100000:1.0:1788843416.021474:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843416.021492:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd136c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134341632:0@lo:400: 00000100:00100000:1.0:1788843416.021514:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843416.021537:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134341248:0@lo:400: 00000100:00100000:1.0:1788843416.021560:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843416.021578:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843416.021583:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134341376:0@lo:400: 00000100:00100000:1.0:1788843416.021617:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843416.021652:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134341504 00000100:00100000:1.0:1788843416.021658:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134341504 00000100:00100000:1.0:1788843416.021691:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134341248 00000100:00100000:1.0:1788843416.021694:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134341248 00000004:00080000:3.0:1788843416.022131:0:8895:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788843416.022237:0:8895:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 194075095014ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788843416.022244:0:8895:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788843416.022869:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134340992 00000100:00100000:0.0:1788843416.022877:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134340992 00000100:00100000:0.0:1788843416.022929:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788843416.022940:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:8894:x1875738134340992:12345-0@lo:502: 00000100:00100000:0.0:1788843416.023368:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:8894:x1875738134340992:12345-0@lo:502: Request processed in 428us (2833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843416.023377:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788843416.023509:0:8894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059dfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:8894:1875738134340992:0@lo:502: 00000020:01000000:2.0:1788843416.023564:0:8894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843416.023574:0:8894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843416.023577:0:8894:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788843416.023582:0:8894:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:0.0:1788843416.023831:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:0.0:1788843416.023861:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788843416.023873:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d0e30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0e37 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843416.023883:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d0e30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0e37 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843416.023893:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788843416.023896:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd118db4800 from 30 10000000:01000000:0.0:1788843416.023899:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788843416.023948:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd100031200/0xa762dfcbd58d0e5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843416.023956:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd100031200/0xa762dfcbd58d0e5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843416.024073:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788843416.024091:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd136c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134341504:12345-0@lo:400: 00000100:00100000:1.0:1788843416.024942:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd136c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134341504:12345-0@lo:400: Request processed in 856us (3544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843416.024952:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1788843416.025079:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd100031200/0xa762dfcbd58d0e5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843416.025090:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134341504:0@lo:400: 00000100:00100000:0.0:1788843416.025113:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e878a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134341760:0@lo:101: 00000004:00080000:2.0:1788843416.025469:0:7438:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1788843416.026079:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788843416.026094:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd136c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134341248:12345-0@lo:400: 00000100:00100000:0.0:1788843416.026262:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843416.026464:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134341760 00000100:00100000:3.0:1788843416.026472:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134341760 00000100:00100000:3.0:1788843416.026513:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788843416.026520:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:6503:x1875738134341760:12345-0@lo:101: 00010000:00010000:3.0:1788843416.026531:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843416.026550:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd10f7af400/0xa762dfcbd58d0e61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0e5a expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843416.026577:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd10f7af400/0xa762dfcbd58d0e61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0e5a expref: 18 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843416.026588:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd10f7af400/0xa762dfcbd58d0e61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0e5a expref: 18 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843416.026597:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10f7af400, rc 0) 00000100:00100000:3.0:1788843416.026627:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:6503:x1875738134341760:12345-0@lo:101: Request processed in 108us (1439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843416.026633:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788843416.026780:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134341248:0@lo:400: 00000100:00100000:2.0:1788843416.026831:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e936780 going to sleep for 11 seconds 00000100:00100000:2.0:1788843416.026859:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e878a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134341760:0@lo:101: 00010000:00010000:2.0:1788843416.026884:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd100031200/0xa762dfcbd58d0e5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0e61 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843416.026896:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd100031200/0xa762dfcbd58d0e5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0e61 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843416.027002:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134341888:0@lo:501: 00000100:00100000:2.0:1788843416.027065:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843416.027111:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd105a65900 going to sleep for 11 seconds 00000100:00100000:1.0:1788843416.027125:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd136c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134341248:12345-0@lo:400: Request processed in 1031us (5558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843416.027135:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788843416.027465:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134341888 00000100:00100000:0.0:1788843416.027471:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134341888 00000100:00100000:0.0:1788843416.027516:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788843416.027525:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:6503:x1875738134341888:12345-0@lo:501: 00000100:00100000:0.0:1788843416.027780:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:6503:x1875738134341888:12345-0@lo:501: Request processed in 256us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843416.027788:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788843416.027827:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134341888:0@lo:501: 00000100:00100000:2.0:1788843416.027902:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134342016:0@lo:503: 00000100:00100000:2.0:1788843416.027960:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843416.028008:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd105a65900 going to sleep for 11 seconds 00000100:00100000:1.0:1788843416.028289:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134341120 00000100:00100000:1.0:1788843416.028296:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134341120 00000100:00100000:1.0:1788843416.028326:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134341632 00000100:00100000:1.0:1788843416.028329:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134341632 00000100:00100000:1.0:1788843416.028359:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134341376 00000100:00100000:1.0:1788843416.028362:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134341376 00000100:00100000:1.0:1788843416.028375:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788843416.028381:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd136c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134341120:12345-0@lo:400: 00000100:00100000:1.0:1788843416.028455:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd136c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134341120:12345-0@lo:400: Request processed in 74us (6980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843416.028461:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788843416.028474:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788843416.028480:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd136c46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134341632:12345-0@lo:400: 00000100:00100000:1.0:1788843416.028507:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd136c46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134341632:12345-0@lo:400: Request processed in 29us (6993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843416.028512:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788843416.028522:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788843416.028527:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134341376:12345-0@lo:400: 00000100:00100000:1.0:1788843416.028557:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134341376:12345-0@lo:400: Request processed in 30us (6940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843416.028562:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788843416.028627:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd120368a80 x1875738134341376/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843416.028657:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134341376:0@lo:400: 00010000:00080000:1.0:1788843416.028702:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd120368380 x1875738134341120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843416.028712:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134341120:0@lo:400: 00010000:00080000:1.0:1788843416.028724:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd136c44e00 x1875738134341632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843416.028732:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd136c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134341632:0@lo:400: 00000100:00080000:2.0:1788843416.028873:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788843416.029341:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134342016 00000100:00100000:3.0:1788843416.029350:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134342016 00000100:00100000:3.0:1788843416.029386:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788843416.029394:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:6503:x1875738134342016:12345-0@lo:503: 00000100:00100000:3.0:1788843416.029530:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:6503:x1875738134342016:12345-0@lo:503: Request processed in 137us (1570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843416.029538:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788843416.030010:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134342016:0@lo:503: 40000000:02000000:3.0:1788843416.032292:0:6513:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:1.0:1788843416.034582:0:8897:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe0c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:8897:1875738134342144:0@lo:502: 00000100:00100000:1.0:1788843416.034692:0:8897:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843416.037553:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134342144 00000100:00100000:2.0:1788843416.037578:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134342144 00000100:00100000:1.0:1788843416.037606:0:8897:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1102c1900 going to sleep for 11 seconds 00000100:00100000:2.0:1788843416.037753:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788843416.037766:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:8897:x1875738134342144:12345-0@lo:502: 00000100:00100000:2.0:1788843416.038784:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:8897:x1875738134342144:12345-0@lo:502: Request processed in 1014us (4086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843416.038796:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788843416.041599:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8430:x1875738134340864:12345-0@lo:700: Request processed in 21770us (21851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843416.041621:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788843416.041983:0:8430:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd13e879500 x1875738134340864/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788843432 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843416.042006:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e879500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8430:1875738134340864:0@lo:700: 40000000:02000000:0.0:1788843416.042024:0:8430:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:1.0:1788843416.044087:0:8897:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe0c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:8897:1875738134342144:0@lo:502: 00000100:00100000:1.0:1788843416.044349:0:8897:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe0c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:8897:1875738134342272:0@lo:502: 00000100:00100000:1.0:1788843416.044446:0:8897:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843416.044499:0:8897:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1090f3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788843416.045989:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134342272 00000100:00100000:1.0:1788843416.046000:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134342272 00000100:00100000:1.0:1788843416.046079:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788843416.046090:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:8897:x1875738134342272:12345-0@lo:502: 00000100:00100000:1.0:1788843416.046313:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:8897:x1875738134342272:12345-0@lo:502: Request processed in 222us (1877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843416.046321:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788843416.046858:0:8897:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe0c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:8897:1875738134342272:0@lo:502: 00000040:00080000:3.0:1788843416.046899:0:8897:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788843416.047069:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788843416.047093:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788843416.047105:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd100031200/0xa762dfcbd58d0e5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0e61 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843416.047118:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd100031200/0xa762dfcbd58d0e5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0e61 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843416.047128:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788843416.047344:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd118db4800 from 5 10000000:01000000:2.0:1788843416.047348:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788843416.047385:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6600/0xa762dfcbd58d0e68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843416.047394:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6600/0xa762dfcbd58d0e68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843416.047404:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6600/0xa762dfcbd58d0e68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843416.047449:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134342400:0@lo:101: 00000100:00100000:2.0:1788843416.047499:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843416.047537:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd105a656c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843416.048016:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134342400 00000100:00100000:3.0:1788843416.048026:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134342400 00000100:00100000:3.0:1788843416.048070:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788843416.048078:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:6503:x1875738134342400:12345-0@lo:101: 00010000:00010000:3.0:1788843416.048091:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843416.048104:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd10f7afc00/0xa762dfcbd58d0e6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0e68 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843416.048129:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd10f7afc00/0xa762dfcbd58d0e6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0e68 expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843416.048166:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd10f7afc00/0xa762dfcbd58d0e6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0e68 expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843416.048174:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10f7afc00, rc 0) 00000100:00100000:3.0:1788843416.048402:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+19:6503:x1875738134342400:12345-0@lo:101: Request processed in 324us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843416.048409:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788843416.048482:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134342400:0@lo:101: 00010000:00010000:2.0:1788843416.048498:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6600/0xa762dfcbd58d0e68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0e6f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843416.048508:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6600/0xa762dfcbd58d0e68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0e6f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843416.048564:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134342528:0@lo:256: 00000100:00100000:2.0:1788843416.048599:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843416.048665:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd105a656c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843416.048699:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134342528 00000100:00100000:3.0:1788843416.048703:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134342528 00000100:00100000:3.0:1788843416.048847:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788843416.048856:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+19:6503:x1875738134342528:12345-0@lo:256: 20000000:01000000:3.0:1788843416.048881:0:6501:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788843416.048896:0:6501:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788843416.048899:0:6501:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788843416.048985:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+19:6503:x1875738134342528:12345-0@lo:256: Request processed in 130us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843416.048992:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788843416.049045:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134342528:0@lo:256: 10000000:01000000:2.0:1788843416.049093:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788843416.049101:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6600/0xa762dfcbd58d0e68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0e6f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843416.049110:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6600/0xa762dfcbd58d0e68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0e6f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843416.049119:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788843416.049122:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1788843416.049124:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788843416.049179:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0e76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843416.049207:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0e76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843416.049215:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0e76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843416.049228:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134342656:0@lo:101: 00000100:00100000:2.0:1788843416.049253:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843416.049524:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd105a656c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843416.049551:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134342656 00000100:00100000:1.0:1788843416.049556:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134342656 00000100:00100000:1.0:1788843416.049587:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788843416.049594:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+19:6503:x1875738134342656:12345-0@lo:101: 00010000:00010000:1.0:1788843416.049601:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843416.049613:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd13fb34800/0xa762dfcbd58d0e7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0e76 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843416.049631:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd13fb34800/0xa762dfcbd58d0e7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0e76 expref: 20 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843416.049641:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd13fb34800/0xa762dfcbd58d0e7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0e76 expref: 20 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843416.049649:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fb34800, rc 0) 00000100:00100000:1.0:1788843416.049686:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:6503:x1875738134342656:12345-0@lo:101: Request processed in 93us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843416.049691:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788843416.049854:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134342656:0@lo:101: 00010000:00010000:2.0:1788843416.049867:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0e76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0e7d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843416.049875:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0e76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0e7d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843416.049927:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134342784:0@lo:501: 00000100:00100000:2.0:1788843416.049952:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843416.050007:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd105a656c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843416.050036:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134342784 00000100:00100000:3.0:1788843416.050041:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134342784 00000100:00100000:3.0:1788843416.050098:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788843416.050106:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:6503:x1875738134342784:12345-0@lo:501: 00000100:00100000:3.0:1788843416.050453:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:6503:x1875738134342784:12345-0@lo:501: Request processed in 347us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843416.050461:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788843416.050592:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134342784:0@lo:501: 00000100:00100000:2.0:1788843416.050621:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134342912:0@lo:503: 00000100:00100000:2.0:1788843416.050668:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843416.050810:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd105a656c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843416.050844:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134342912 00000100:00100000:3.0:1788843416.050849:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134342912 00000100:00100000:3.0:1788843416.050883:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788843416.050890:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:6503:x1875738134342912:12345-0@lo:503: 00000100:00100000:3.0:1788843416.050977:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:6503:x1875738134342912:12345-0@lo:503: Request processed in 88us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843416.050984:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788843416.051058:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134342912:0@lo:503: 00000100:00100000:2.0:1788843416.051678:0:8898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059dfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:8898:1875738134343040:0@lo:502: 00000100:00100000:2.0:1788843416.051817:0:8898:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843416.051883:0:8898:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd105a65000 going to sleep for 11 seconds 00000100:00100000:3.0:1788843416.051918:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134343040 00000100:00100000:3.0:1788843416.051924:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134343040 00000100:00100000:3.0:1788843416.051993:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788843416.052002:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:8898:x1875738134343040:12345-0@lo:502: 00000100:00100000:3.0:1788843416.052116:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:8898:x1875738134343040:12345-0@lo:502: Request processed in 116us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843416.052123:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788843416.052243:0:8898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059dfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:8898:1875738134343040:0@lo:502: 00000020:01000000:1.0:1788843416.052273:0:8898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788843416.052281:0:8898:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788843416.052288:0:8898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843416.052291:0:8898:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788843416.052298:0:8898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788843416.052302:0:8898:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.133@tcp to nid 0x20000c0a8cb85 (192.168.203.133@tcp) 00000020:01000000:1.0:1788843416.052323:0:8898:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788843416.052326:0:8898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788843416.052342:0:8898:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9bd13eb10000) 00000020:00000080:1.0:1788843416.052366:0:8898:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1788843416.052373:0:8898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788843416.052502:0:8898:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788843416.052515:0:8898:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788843416.052524:0:8898:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa762dfcbd58d0e8b 00010000:00080000:1.0:1788843416.052564:0:8898:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd006449000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.133@tcp at head 00010000:00010000:1.0:1788843416.052840:0:8898:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000001:00100000:0.0:1788843416.061184:0:8417:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788843416.061823:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8896:x1875738134340736:12345-0@lo:700: Request processed in 42167us (42527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843416.061845:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788843416.062895:0:8896:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd1203d1880 x1875738134340736/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788843432 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843416.062930:0:8896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8896:1875738134340736:0@lo:700: 00000040:01000000:2.0:1788843416.063457:0:8898:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788843416.063481:0:8898:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788843416.064316:0:8898:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788843416.064557:0:8898:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788843416.064678:0:8898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788843416.064772:0:8898:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788843416.067220:0:8899:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788843416.067230:0:8899:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000100:00100000:1.0:1788843416.071131:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134343168:0@lo:13: 00000100:00100000:1.0:1788843416.071256:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843416.071361:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134343168 00000100:00100000:0.0:1788843416.071373:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134343168 00000100:00100000:0.0:1788843416.071442:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788843416.071454:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134343168:12345-0@lo:13: 00002000:00000024:0.0:1788843416.071489:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000020:00000080:2.0:1788843416.071554:0:8898:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788843416.071572:0:8898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:00080000:3.0:1788843416.071585:0:8896:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788843416.071626:0:8896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8896:1875738134343296:0@lo:7: 00000004:01000000:2.0:1788843416.071632:0:8898:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788843416.071660:0:8898:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa762dfcbd58d0e92 00000100:00100000:3.0:1788843416.071663:0:8896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788843416.071668:0:8898:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788843416.071674:0:8898:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bd006449000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:3.0:1788843416.071681:0:8896:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd136c60300 going to sleep for 11 seconds 00000100:00100000:2.0:1788843416.071702:0:8898:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd0059ddc00 x1875738134343424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788843416.071728:0:8898:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788843416.071813:0:8898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843416.071818:0:8898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843416.071820:0:8898:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788843416.071824:0:8898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788843416.071828:0:8898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843416.071829:0:8898:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788843416.071833:0:8898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788843416.071834:0:8898:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788843416.071859:0:8898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059ded80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:8898:1875738134343552:0@lo:502: 00000100:00100000:3.0:1788843416.071891:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134343424:0@lo:8: 00000100:00100000:2.0:1788843416.071906:0:8898:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843416.071934:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843416.071939:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134343552 00000100:00100000:2.0:1788843416.071943:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134343552 00000100:00100000:2.0:1788843416.071971:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788843416.071972:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134343296 00000100:00100000:3.0:1788843416.071975:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134343296 00000100:00100000:2.0:1788843416.071977:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:8898:x1875738134343552:12345-0@lo:502: 00000100:00100000:3.0:1788843416.071998:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134343424 00000100:00100000:3.0:1788843416.072001:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134343424 00000100:00100000:3.0:1788843416.072012:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788843416.072017:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:8896:x1875738134343296:12345-0@lo:7: 00000100:00100000:2.0:1788843416.072894:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:8898:x1875738134343552:12345-0@lo:502: Request processed in 911us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843416.072906:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788843416.072984:0:8898:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd104bedd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788843416.073014:0:8898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059ded80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:8898:1875738134343552:0@lo:502: 00000020:01000000:2.0:1788843416.074213:0:8898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843416.074225:0:8898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843416.074227:0:8898:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788843416.074233:0:8898:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1788843416.074343:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1788843416.074366:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788843416.074380:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0e76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0e7d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843416.074392:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0e76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0e7d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843416.074404:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788843416.074407:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9bd13339b370 from 1 10000000:01000000:2.0:1788843416.074411:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788843416.074466:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6000/0xa762dfcbd58d0e99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843416.074476:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6000/0xa762dfcbd58d0e99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843416.074501:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6000/0xa762dfcbd58d0e99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843416.074530:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134343680:0@lo:101: 00000100:00100000:2.0:1788843416.074595:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843416.074635:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12e1183c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843416.074656:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134343680 00000100:00100000:2.0:1788843416.074663:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134343680 00000100:00100000:2.0:1788843416.074711:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788843416.074720:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:6503:x1875738134343680:12345-0@lo:101: 00010000:00010000:2.0:1788843416.074735:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843416.074751:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1153e6e00/0xa762dfcbd58d0ea0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0e99 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843416.074780:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1153e6e00/0xa762dfcbd58d0ea0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0e99 expref: 21 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843416.074791:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1153e6e00/0xa762dfcbd58d0ea0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0e99 expref: 21 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843416.074801:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e6e00, rc 0) 00000100:00100000:2.0:1788843416.074841:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:6503:x1875738134343680:12345-0@lo:101: Request processed in 121us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843416.074847:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788843416.074893:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134343680:0@lo:101: 00010000:00010000:2.0:1788843416.074906:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6000/0xa762dfcbd58d0e99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0ea0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843416.074925:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6000/0xa762dfcbd58d0e99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0ea0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843416.074984:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134343808:0@lo:501: 00000100:00100000:2.0:1788843416.075011:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843416.076897:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3630:x1875738134343168:12345-0@lo:13: Request processed in 5433us (5629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843416.076925:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788843416.077557:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134343808 00000100:00100000:2.0:1788843416.077569:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134343808 00000100:00100000:2.0:1788843416.077638:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788843416.077649:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:6503:x1875738134343808:12345-0@lo:501: 00000100:00100000:2.0:1788843416.077786:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:6503:x1875738134343808:12345-0@lo:501: Request processed in 139us (2774us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788843416.077793:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788843416.077848:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12e1183c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843416.077876:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134343808:0@lo:501: 00002000:00080000:3.0:1788843416.077920:0:8421:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 10000000:01000000:2.0:1788843416.077921:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00002000:00080000:3.0:1788843416.077927:0:8421:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00010000:00010000:2.0:1788843416.077933:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6000/0xa762dfcbd58d0e99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0ea0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843416.077944:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6000/0xa762dfcbd58d0e99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0ea0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843416.077978:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8896:x1875738134343296:12345-0@lo:7: Request processed in 5959us (6313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843416.077985:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788843416.078022:0:8896:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd1203d2d80 x1875738134343296/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788843432 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843416.078035:0:8896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8896:1875738134343296:0@lo:7: 00000004:00080000:3.0:1788843416.078046:0:8896:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788843416.078083:0:8896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8896:1875738134343936:0@lo:5: 00000100:00100000:2.0:1788843416.078205:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788843416.078211:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3629:x1875738134343424:12345-0@lo:8: 00010000:00080000:2.0:1788843416.078240:0:8421:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 194 last 0 00000100:00100000:3.0:1788843416.078271:0:8896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1788843416.078271:0:8421:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa762dfcbd58d0ea7 00002000:00100000:2.0:1788843416.078294:0:8421:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9bd006463800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788843416.078299:0:8421:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000100:00100000:3.0:1788843416.078301:0:8896:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd104bb9480 going to sleep for 11 seconds 00002000:00100000:2.0:1788843416.078302:0:8421:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788843416.078350:0:8421:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:0.0:1788843416.078369:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788843416.078377:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:2.0:1788843416.078381:0:8421:0:(import.c:65:import_set_state_nolock()) ffff9bd006465000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788843416.078448:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3629:x1875738134343424:12345-0@lo:8: Request processed in 235us (6512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843416.078455:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788843416.078466:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134343936 00000100:00100000:2.0:1788843416.078471:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134343936 00000100:00100000:2.0:1788843416.078493:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788843416.078499:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8896:x1875738134343936:12345-0@lo:5: 00002000:00080000:2.0:1788843416.078518:0:8421:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1788843416.078547:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8896:x1875738134343936:12345-0@lo:5: Request processed in 49us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843416.078553:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788843416.078578:0:8896:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd1203d2d80 x1875738134343936/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788843432 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843416.078589:0:8896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8896:1875738134343936:0@lo:5: 00000004:00080000:3.0:1788843416.078599:0:8896:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00010000:00080000:1.0:1788843416.078638:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd1203d1880 x1875738134343168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843416.078657:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134343168:0@lo:13: 00010000:00080000:0.0:1788843416.078739:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd0059ddc00 x1875738134343424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788843426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843416.078749:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788843416.078757:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788843416.078765:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788843416.078769:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788843416.078771:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd006449000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788843416.078793:0:3629:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788843416.078800:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134343424:0@lo:8: 00000004:00080000:2.0:1788843416.079885:0:8899:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788843416.080392:0:8899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 194133250369ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788843416.080402:0:8899:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1788843416.088500:0:8900:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788843416.088550:0:8900:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe0d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8900:1875738134344192:0@lo:7: 00000100:00100000:2.0:1788843416.088638:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788843416.088658:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134344064:0@lo:13: 00000100:00100000:2.0:1788843416.088720:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843416.088778:0:8900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843416.088813:0:8900:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd104963300 going to sleep for 11 seconds 00000100:00100000:2.0:1788843416.088865:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134344192 00000100:00100000:2.0:1788843416.088884:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134344192 00000100:00100000:0.0:1788843416.088894:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134344064 00000100:00100000:0.0:1788843416.088898:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134344064 00000100:00100000:2.0:1788843416.088965:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788843416.088976:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8900:x1875738134344192:12345-0@lo:7: 00000100:00080000:3.0:1788843416.088999:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843416.089127:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788843416.089136:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3630:x1875738134344064:12345-0@lo:13: 00002000:00000024:0.0:1788843416.089176:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1788843416.089235:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3630:x1875738134344064:12345-0@lo:13: Request processed in 101us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843416.089243:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788843416.089353:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd10fe0e300 x1875738134344064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843416.089376:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134344064:0@lo:13: 00002000:00080000:2.0:1788843416.095364:0:8421:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788843416.095380:0:8421:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788843416.096248:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8900:x1875738134344192:12345-0@lo:7: Request processed in 7263us (7459us total) trans 0 rc 0/0 00010000:00080000:1.0:1788843416.096682:0:8900:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd10fe0d180 x1875738134344192/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788843432 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843416.096700:0:8900:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe0d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8900:1875738134344192:0@lo:7: 00000004:00080000:1.0:1788843416.096720:0:8900:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788843416.096776:0:8900:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe0d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8900:1875738134344320:0@lo:5: 00000100:00100000:1.0:1788843416.096823:0:8900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843416.096871:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134344320 00000100:00100000:1.0:1788843416.096879:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134344320 00000100:00100000:2.0:1788843416.097099:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788843416.100716:0:8900:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd104963300 going to sleep for 11 seconds 00000100:00100000:1.0:1788843416.100863:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788843416.100894:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8900:x1875738134344320:12345-0@lo:5: 00002000:00080000:1.0:1788843416.100939:0:8423:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788843416.100958:0:8423:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000004:00080000:3.0:1788843416.101074:0:6485:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000001:00080000:3.0:1788843416.107394:0:8417:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1788843416.107421:0:8417:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788843416.107676:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8900:x1875738134344320:12345-0@lo:5: Request processed in 6784us (10844us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788843416.107688:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788843416.107814:0:8900:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd10fe0d180 x1875738134344320/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788843432 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843416.107827:0:8900:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788843416.107837:0:8900:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe0d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8900:1875738134344320:0@lo:5: 00000004:00080000:0.0:1788843416.107874:0:8900:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788843416.107944:0:8900:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e879500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8900:1875738134344448:0@lo:700: 00000100:00100000:0.0:1788843416.107991:0:8900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843416.108054:0:8900:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e936b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788843416.108345:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134344448 00000100:00100000:3.0:1788843416.108353:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134344448 00000100:00100000:3.0:1788843416.108398:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788843416.108406:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e878380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8900:x1875738134344448:12345-0@lo:700: 00000100:00100000:1.0:1788843416.136248:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e878380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8900:x1875738134344448:12345-0@lo:700: Request processed in 27826us (28241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843416.136278:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788843416.136978:0:8900:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd13e879500 x1875738134344448/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788843432 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843416.136999:0:8900:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e879500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8900:1875738134344448:0@lo:700: 00000004:02000040:0.0:1788843416.140531:0:8900:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:0.0:1788843416.150495:0:8900:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e879500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8900:1875738134344576:0@lo:5: 00000100:00100000:0.0:1788843416.150595:0:8900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843416.151179:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134344576 00000100:00100000:1.0:1788843416.151193:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134344576 00000100:00100000:1.0:1788843416.151325:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788843416.151339:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8900:x1875738134344576:12345-0@lo:5: 00000100:00100000:0.0:1788843416.155593:0:8900:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e936b40 going to sleep for 11 seconds 00002000:00080000:1.0:1788843416.178315:0:8424:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788843416.178349:0:8424:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:1.0:1788843416.185445:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8900:x1875738134344576:12345-0@lo:5: Request processed in 34086us (34827us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788843416.185462:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788843416.185680:0:8900:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd13e879500 x1875738134344576/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788843432 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843416.185703:0:8900:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e879500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8900:1875738134344576:0@lo:5: 00000004:00080000:0.0:1788843416.185722:0:8900:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000001:00080000:3.0:1788843416.475716:0:8417:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1788843416.730351:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788843417.314763:0:8951:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788843417.315064:0:8951:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788843417.499124:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788843417.499222:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134344704:0@lo:41: 00000100:00100000:0.0:1788843417.499338:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843417.499419:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134344704 00000100:00100000:0.0:1788843417.499443:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134344704 00000100:00100000:0.0:1788843417.499495:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788843417.499505:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134344704:12345-0@lo:41: 00000004:00000024:0.0:1788843417.499555:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788843417.499608:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134344704:12345-0@lo:41: Request processed in 102us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843417.499621:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788843417.499715:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134344704:0@lo:41: 00000100:00100000:0.0:1788843417.500039:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134344832:0@lo:41: 00000100:00100000:0.0:1788843417.500070:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843417.500613:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134344832 00000100:00100000:1.0:1788843417.500621:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134344832 00000100:00100000:1.0:1788843417.500665:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788843417.500675:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134344832:12345-0@lo:41: 00000004:00000024:1.0:1788843417.500706:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788843417.515294:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134344832:12345-0@lo:41: Request processed in 14605us (15207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843417.515313:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788843417.515837:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134344832:0@lo:41: 00010000:00010000:1.0:1788843417.759765:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788843418.282750:0:8999:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788843418.282763:0:8999:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1788843418.778452:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843419.802344:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843420.826449:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843421.084435:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134344960:0@lo:400: 00000100:00100000:0.0:1788843421.084528:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843421.084626:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134344960 00000100:00100000:0.0:1788843421.084636:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134344960 00000100:00100000:0.0:1788843421.084705:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788843421.084716:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:3630:x1875738134344960:12345-0@lo:400: 00000100:00100000:0.0:1788843421.084768:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:3630:x1875738134344960:12345-0@lo:400: Request processed in 54us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843421.084776:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788843421.084900:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134344960:0@lo:400: 00000100:00100000:3.0:1788843421.087156:0:8896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8896:1875738134345216:0@lo:5: 00000100:00100000:3.0:1788843421.087580:0:8896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843421.087623:0:8896:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd111699900 going to sleep for 11 seconds 00000100:00100000:3.0:1788843421.087654:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134345216 00000100:00100000:3.0:1788843421.087670:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134345216 00000100:00100000:3.0:1788843421.087740:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788843421.087948:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8896:x1875738134345216:12345-0@lo:5: 00002000:00080000:3.0:1788843421.088077:0:8901:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1788843421.088964:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788843421.088986:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134345088:0@lo:13: 00000100:00100000:0.0:1788843421.089066:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843421.089123:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134345088 00000100:00100000:0.0:1788843421.089129:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134345088 00000100:00100000:0.0:1788843421.089200:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788843421.089208:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3630:x1875738134345088:12345-0@lo:13: 00002000:00000024:0.0:1788843421.089228:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 896 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843421.089275:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3630:x1875738134345088:12345-0@lo:13: Request processed in 67us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843421.089293:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788843421.089338:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd1203d2680 x1875738134345088/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843421.089358:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134345088:0@lo:13: 00000100:00100000:2.0:1788843421.089883:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134345728:0@lo:400: 00000100:00100000:2.0:1788843421.089925:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843421.089953:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788843421.089959:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1875738134345600:0@lo:400: 00000100:00100000:2.0:1788843421.089987:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843421.090026:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134346112:0@lo:400: 00000100:00100000:2.0:1788843421.090053:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843421.090083:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134346112 00000100:00100000:2.0:1788843421.090088:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134346112 00000100:00100000:2.0:1788843421.090129:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788843421.090138:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134346112:12345-0@lo:400: 00000100:00100000:2.0:1788843421.090205:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134346112:12345-0@lo:400: Request processed in 69us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843421.090213:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788843421.090250:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd0059ddf80 x1875738134346112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843421.090259:0:3631:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788843421.090284:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134346112:0@lo:400: 00000100:00100000:1.0:1788843421.090431:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134345600 00000100:00100000:1.0:1788843421.090436:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134345600 00000100:00100000:1.0:1788843421.090482:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788843421.090490:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1875738134345600:12345-0@lo:400: 00000100:00100000:1.0:1788843421.090535:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1875738134345600:12345-0@lo:400: Request processed in 46us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843421.090542:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1788843421.090573:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd0059dd180 x1875738134345600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843421.090583:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1875738134345600:0@lo:400: 00000100:00100000:0.0:1788843421.090784:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134345344:0@lo:400: 00000100:00100000:0.0:1788843421.090818:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843421.090843:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134345856:0@lo:400: 00000100:00100000:0.0:1788843421.090870:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843421.090892:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788843421.090898:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134345472:0@lo:400: 00000100:00100000:0.0:1788843421.090931:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843421.090953:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134345984:0@lo:400: 00000100:00100000:0.0:1788843421.090975:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843421.091000:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134345728 00000100:00100000:0.0:1788843421.091005:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134345728 00000100:00100000:0.0:1788843421.091050:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134345472 00000100:00100000:0.0:1788843421.091054:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134345472 00000100:00100000:0.0:1788843421.091072:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788843421.091080:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134345728:12345-0@lo:400: 00000100:00100000:0.0:1788843421.091123:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134345728:12345-0@lo:400: Request processed in 44us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843421.091129:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788843421.091185:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788843421.091194:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134345472:12345-0@lo:400: 00000100:00100000:0.0:1788843421.091233:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134345472:12345-0@lo:400: Request processed in 41us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843421.091249:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788843421.091268:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134345344 00000100:00100000:0.0:1788843421.091272:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134345344 00000100:00100000:0.0:1788843421.091287:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134345856 00000100:00100000:0.0:1788843421.091289:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134345856 00000100:00100000:0.0:1788843421.091303:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134345984 00000100:00100000:0.0:1788843421.091306:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134345984 00000100:00100000:0.0:1788843421.091320:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788843421.091326:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134345344:12345-0@lo:400: 00000100:00100000:0.0:1788843421.091356:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134345344:12345-0@lo:400: Request processed in 31us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843421.091362:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788843421.091372:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788843421.091377:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134345856:12345-0@lo:400: 00000100:00100000:0.0:1788843421.091413:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134345856:12345-0@lo:400: Request processed in 36us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843421.091418:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788843421.091429:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788843421.091437:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134345984:12345-0@lo:400: 00000100:00100000:0.0:1788843421.091468:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134345984:12345-0@lo:400: Request processed in 33us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843421.091474:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788843421.091517:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134345728:0@lo:400: 00000100:00100000:0.0:1788843421.091549:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134345472:0@lo:400: 00010000:00080000:0.0:1788843421.091563:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd0059dd500 x1875738134345984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843421.091585:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134345984:0@lo:400: 00010000:00080000:0.0:1788843421.091598:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd0059df100 x1875738134345344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843421.091605:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134345344:0@lo:400: 00010000:00080000:0.0:1788843421.091614:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd0059dce00 x1875738134345856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843421.091622:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134345856:0@lo:400: 00000100:00100000:3.0:1788843421.093941:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:8896:x1875738134345216:12345-0@lo:5: Request processed in 5994us (6356us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788843421.093954:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788843421.094074:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788843421.094080:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788843421.094083:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788843421.095791:0:8896:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd1203d2d80 x1875738134345216/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788843437 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843421.095816:0:8896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8896:1875738134345216:0@lo:5: 00000004:00080000:2.0:1788843421.095834:0:8896:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1788843421.095882:0:8896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059ddf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8896:1875738134346240:0@lo:900: 00000100:00100000:2.0:1788843421.095956:0:8896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843421.096000:0:8896:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10556a240 going to sleep for 11 seconds 00000100:00100000:3.0:1788843421.096406:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134346240 00000100:00100000:3.0:1788843421.096413:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134346240 00000100:00100000:3.0:1788843421.096466:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788843421.096477:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8896:x1875738134346240:12345-0@lo:900: 00000100:00100000:3.0:1788843421.096538:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8896:x1875738134346240:12345-0@lo:900: Request processed in 64us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843421.096544:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788843421.096620:0:8896:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd0059ddf80 x1875738134346240/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788843437 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843421.096629:0:8896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059ddf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8896:1875738134346240:0@lo:900: 00000100:00100000:1.0:1788843421.594685:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134346368:0@lo:13: 00000100:00100000:1.0:1788843421.594778:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843421.595053:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134346368 00000100:00100000:3.0:1788843421.595075:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134346368 00000100:00100000:3.0:1788843421.595167:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788843421.595179:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134346368:12345-0@lo:13: 00002000:00000024:3.0:1788843421.595208:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843421.595260:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134346368:12345-0@lo:13: Request processed in 83us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843421.595267:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788843421.595505:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd10f954a80 x1875738134346368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843421.595532:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134346368:0@lo:13: 00010000:00010000:3.0:1788843421.859446:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843422.620371:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134346496:0@lo:41: 00000100:00100000:1.0:1788843422.620854:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134346624:0@lo:41: 00000100:00100000:0.0:1788843422.622889:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843422.623743:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134346496 00000100:00100000:3.0:1788843422.623754:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134346496 00000100:00100000:3.0:1788843422.623814:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788843422.623825:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134346496:12345-0@lo:41: 00000004:00000024:3.0:1788843422.623864:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788843422.631601:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843422.631791:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134346624 00000100:00100000:1.0:1788843422.631801:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134346624 00000100:00100000:1.0:1788843422.631859:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788843422.631871:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134346624:12345-0@lo:41: 00000004:00000024:1.0:1788843422.631910:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788843422.631962:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134346624:12345-0@lo:41: Request processed in 93us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843422.631970:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788843422.632054:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134346624:0@lo:41: 00000100:00100000:3.0:1788843422.633731:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134346496:12345-0@lo:41: Request processed in 9901us (10844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843422.633753:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788843422.639366:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134346496:0@lo:41: 00010000:00010000:3.0:1788843422.874304:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788843423.654401:0:8417:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:3.0:1788843423.898245:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843424.922275:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843425.951015:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843426.203050:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134347008:0@lo:400: 00000100:00100000:3.0:1788843426.203121:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843426.203201:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134347520:0@lo:400: 00000100:00100000:0.0:1788843426.205044:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134346752:0@lo:400: 00000100:00100000:0.0:1788843426.205116:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843426.205174:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134347264:0@lo:400: 00000100:00100000:0.0:1788843426.205202:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843426.205224:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134347776:0@lo:400: 00000100:00100000:0.0:1788843426.205249:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843426.205276:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788843426.205282:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f984380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134346880:0@lo:400: 00000100:00100000:0.0:1788843426.205306:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843426.205323:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134347392:0@lo:400: 00000100:00100000:0.0:1788843426.205361:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843426.205437:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134346752 00000100:00100000:0.0:1788843426.205444:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134346752 00000100:00100000:0.0:1788843426.205488:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788843426.205497:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:3630:x1875738134346752:12345-0@lo:400: 00000100:00100000:0.0:1788843426.205542:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:3630:x1875738134346752:12345-0@lo:400: Request processed in 46us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843426.205549:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788843426.205580:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134347008 00000100:00100000:0.0:1788843426.205584:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134347008 00000100:00100000:0.0:1788843426.205614:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134347264 00000100:00100000:0.0:1788843426.205617:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134347264 00000100:00100000:0.0:1788843426.205631:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788843426.205637:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134347008:12345-0@lo:400: 00000100:00100000:0.0:1788843426.205672:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134347008:12345-0@lo:400: Request processed in 35us (2552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843426.205678:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788843426.205690:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788843426.205696:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134347264:12345-0@lo:400: 00000100:00100000:0.0:1788843426.205721:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134347264:12345-0@lo:400: Request processed in 25us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843426.205726:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788843426.205742:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134347776 00000100:00100000:0.0:1788843426.205745:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134347776 00000100:00100000:0.0:1788843426.205778:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788843426.205784:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134347776:12345-0@lo:400: 00000100:00100000:0.0:1788843426.205814:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134347776:12345-0@lo:400: Request processed in 30us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843426.205826:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788843426.205843:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134346880 00000100:00100000:0.0:1788843426.205846:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134346880 00000100:00100000:0.0:1788843426.205866:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134347392 00000100:00100000:0.0:1788843426.205868:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134347392 00000100:00100000:0.0:1788843426.205881:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788843426.205887:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134346880:12345-0@lo:400: 00000100:00100000:0.0:1788843426.205918:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134346880:12345-0@lo:400: Request processed in 31us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843426.205924:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788843426.205935:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788843426.205941:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134347392:12345-0@lo:400: 00000100:00100000:0.0:1788843426.205965:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134347392:12345-0@lo:400: Request processed in 25us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843426.205971:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788843426.206016:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd10f984380 x1875738134346880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843426.206030:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f984380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134346880:0@lo:400: 00010000:00080000:0.0:1788843426.206040:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd10f984000 x1875738134347392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843426.206048:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134347392:0@lo:400: 00000100:00100000:0.0:1788843426.206055:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134346752:0@lo:400: 00000100:00100000:0.0:1788843426.206063:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134347264:0@lo:400: 00010000:00080000:0.0:1788843426.206071:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd10f986d80 x1875738134347776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843426.206086:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134347776:0@lo:400: 00000100:00100000:0.0:1788843426.206128:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788843426.206134:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134347904:0@lo:13: 00000100:00100000:0.0:1788843426.206219:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843426.207297:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134347136:0@lo:400: 00000100:00100000:0.0:1788843426.207347:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843426.207481:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134347648:0@lo:400: 00000100:00100000:0.0:1788843426.207508:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843426.207824:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134347136 00000100:00100000:1.0:1788843426.207832:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134347136 00000100:00100000:3.0:1788843426.207854:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843426.207903:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134347904 00000100:00100000:3.0:1788843426.207908:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134347904 00000100:00100000:1.0:1788843426.207914:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134347520 00000100:00100000:1.0:1788843426.207920:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134347520 00000100:00100000:3.0:1788843426.207949:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788843426.207952:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788843426.207961:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134347904:12345-0@lo:13: 00000100:00100000:1.0:1788843426.207963:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134347136:12345-0@lo:400: 00002000:00000024:3.0:1788843426.207994:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788843426.208046:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134347136:12345-0@lo:400: Request processed in 85us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843426.208048:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134347904:12345-0@lo:13: Request processed in 90us (1827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843426.208057:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788843426.208072:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788843426.208076:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788843426.208085:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134347520:12345-0@lo:400: 00000100:00080000:3.0:1788843426.208095:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788843426.208100:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788843426.208103:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788843426.208132:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134347520:12345-0@lo:400: Request processed in 37us (267us total) trans 0 rc 0/0 00010000:00080000:3.0:1788843426.208135:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd10f955c00 x1875738134347904/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843426.208164:0:3630:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1788843426.208169:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788843426.208189:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134347904:0@lo:13: 00000100:00100000:1.0:1788843426.208194:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134347648 00000100:00100000:1.0:1788843426.208199:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134347648 00010000:00080000:3.0:1788843426.208223:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd10f987b80 x1875738134347520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843426.208233:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788843426.208240:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134347648:12345-0@lo:400: 00000100:00100000:1.0:1788843426.208281:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134347648:12345-0@lo:400: Request processed in 42us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843426.208288:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788843426.208318:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd10f987480 x1875738134347136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843426.208329:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134347136:0@lo:400: 00010000:00080000:1.0:1788843426.208338:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd10f985c00 x1875738134347648/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843426.208544:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134347648:0@lo:400: 00000100:00100000:3.0:1788843426.208564:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134347520:0@lo:400: 00000100:00100000:3.0:1788843426.208600:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134347008:0@lo:400: 00000100:00100000:1.0:1788843426.714610:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788843426.714635:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134348032:0@lo:13: 00000100:00100000:1.0:1788843426.714708:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843426.714781:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134348032 00000100:00100000:1.0:1788843426.714789:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134348032 00000100:00100000:1.0:1788843426.714838:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788843426.714847:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134348032:12345-0@lo:13: 00002000:00000024:1.0:1788843426.714884:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788843426.714929:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134348032:12345-0@lo:13: Request processed in 82us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843426.714936:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788843426.714980:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd10fe0ca80 x1875738134348032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843426.714997:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134348032:0@lo:13: 00010000:00010000:3.0:1788843426.971326:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843427.739985:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788843427.740011:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134348160:0@lo:41: 00000100:00100000:2.0:1788843427.740094:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843427.740184:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134348160 00000100:00100000:2.0:1788843427.740190:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134348160 00000100:00100000:1.0:1788843427.740965:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788843427.740977:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134348288:0@lo:41: 00000100:00100000:1.0:1788843427.741013:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843427.742925:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134348288 00000100:00100000:2.0:1788843427.742941:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134348288 00000100:00100000:2.0:1788843427.742984:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788843427.742994:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134348160:12345-0@lo:41: 00000100:00100000:3.0:1788843427.743575:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788843427.743597:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134348288:12345-0@lo:41: 00000004:00000024:3.0:1788843427.743624:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000004:00000024:2.0:1788843427.743675:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788843427.743707:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134348288:12345-0@lo:41: Request processed in 124us (2693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843427.743714:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788843427.743740:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134348160:12345-0@lo:41: Request processed in 748us (3647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843427.743746:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788843427.743794:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134348160:0@lo:41: 00000100:00100000:1.0:1788843427.743963:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134348288:0@lo:41: 00010000:00010000:3.0:1788843427.995263:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843429.020690:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843430.042508:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788843430.504102:0:9499:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788843430.504106:0:9499:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788843430.504108:0:9499:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788843430.506279:0:9499:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bd006461000 00000020:01000004:2.0:1788843430.506787:0:9499:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788843430.506809:0:9499:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788843430.506830:0:9499:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9bd10fbb4d28) 00000020:00000080:2.0:1788843430.506858:0:9499:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788843430.592482:0:9499:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788843430.592583:0:9499:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:0.0:1788843430.631698:0:9499:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788843430.635975:0:9499:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788843430.635996:0:9499:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788843430.636708:0:9499:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa762dfcbd58d0eb5 00000020:01000004:0.0:1788843430.636718:0:9499:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788843430.636745:0:9499:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.133@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788843430.636749:0:9499:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.133@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788843430.636755:0:9499:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788843430.642027:0:9499:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1788843430.642039:0:9499:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.133@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788843430.695840:0:9499:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.133@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788843430.695882:0:9499:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.133@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788843430.695887:0:9499:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788843430.695892:0:9499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788843430.695894:0:9499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843430.695895:0:9499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843430.695896:0:9499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843430.695897:0:9499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843430.695899:0:9499:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788843430.695900:0:9499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788843430.695901:0:9499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788843430.695903:0:9499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843430.695904:0:9499:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788843430.695907:0:9499:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788843430.695909:0:9499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788843430.695910:0:9499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788843430.695911:0:9499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843430.695912:0:9499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843430.695913:0:9499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843430.695913:0:9499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843430.695914:0:9499:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788843430.695915:0:9499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788843430.695916:0:9499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788843430.695916:0:9499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843430.695917:0:9499:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788843430.695941:0:9499:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788843430.695958:0:9499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134348416:0@lo:253: 00000100:00100000:2.0:1788843430.696028:0:9499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843430.696097:0:9499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1037099c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843430.696304:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134348416 00000100:00100000:0.0:1788843430.696312:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134348416 00000100:00100000:0.0:1788843430.696372:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788843430.696381:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1153f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:9499:x1875738134348416:12345-0@lo:253: 20000000:01000000:0.0:1788843430.696410:0:6500:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788843430.696414:0:6500:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788843430.696419:0:6500:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788843430.696428:0:6500:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788843430.696661:0:6500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788843430.696797:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1788843430.696813:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788843430.696832:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1788843430.696839:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788843430.696851:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1788843430.696865:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1788843430.696946:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1788843430.696959:0:6500:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.133@tcp 20000000:01000000:0.0:1788843430.696962:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.133@tcp (null) (null) (null) 00000040:00080000:0.0:1788843430.696976:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1788843430.696981:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788843430.696996:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1788843430.697002:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.133@tcp (null) (null) 00000040:00080000:0.0:1788843430.697015:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1788843430.697021:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788843430.697036:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1788843430.697052:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1788843430.697127:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1788843430.697159:0:6500:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.133@tcp 20000000:01000000:0.0:1788843430.697161:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.133@tcp (null) (null) (null) 00000040:00080000:0.0:1788843430.697178:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1788843430.697184:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788843430.697198:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1788843430.697204:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.133@tcp (null) (null) 00000040:00080000:0.0:1788843430.697231:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1788843430.697238:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788843430.697251:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1788843430.697267:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1788843430.697653:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1788843430.697677:0:6500:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.133@tcp 20000000:01000000:0.0:1788843430.697679:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.133@tcp (null) (null) (null) 00000040:00080000:0.0:1788843430.697695:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1788843430.697701:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788843430.697712:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1788843430.697716:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.133@tcp (null) (null) 00000040:00080000:0.0:1788843430.697728:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1788843430.697733:0:6500:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788843430.697745:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1788843430.697762:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1788843430.697777:0:6500:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788843430.697779:0:6500:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788843430.697782:0:6500:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788843430.697825:0:6500:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788843430.697827:0:6500:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788843430.703547:0:9505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1788843430.703818:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1788843430.703854:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1788843430.703871:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:2.0:1788843430.703887:0:6500:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788843430.703889:0:6500:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788843430.704755:0:9506:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1788843430.704798:0:9506:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1788843430.704811:0:9506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1788843430.704976:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1788843430.704996:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:2.0:1788843430.705009:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:2.0:1788843430.705023:0:6500:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788843430.705026:0:6500:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788843430.705394:0:9507:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:2.0:1788843430.705424:0:9507:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:2.0:1788843430.705437:0:9507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:0.0:1788843430.705576:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:0.0:1788843430.705596:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:0.0:1788843430.705611:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:0.0:1788843430.705621:0:6500:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788843430.705623:0:6500:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788843430.707310:0:9508:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1788843430.707385:0:9508:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1788843430.707402:0:9508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1788843430.707627:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1788843430.707665:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1788843430.707681:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:1.0:1788843430.707692:0:6500:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788843430.707695:0:6500:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788843430.708300:0:9509:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 28 1->4: lustre sys.timeout 20000000:01000000:2.0:1788843430.708326:0:9509:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 28 2->4: lustre sys.timeout 00000040:00080000:2.0:1788843430.708528:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1788843430.708689:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1788843430.708709:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1788843430.708740:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 10000000:01000000:1.0:1788843430.708756:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788843430.708777:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd13fb34000/0xa762dfcbd58d0ebc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.708795:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd1153e7c00/0xa762dfcbd58d0db2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0dab expref: 21 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.708803:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0ddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0dd5 expref: 21 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.708810:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd1153e6c00/0xa762dfcbd58d0e1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0e14 expref: 21 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.708817:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d0e37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0e30 expref: 21 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.708824:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd10f7af400/0xa762dfcbd58d0e61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0e5a expref: 21 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.708831:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd13fb34800/0xa762dfcbd58d0e7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0e76 expref: 21 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.708838:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd1153e6e00/0xa762dfcbd58d0ea0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0e99 expref: 21 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.708845:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd13fb34000/0xa762dfcbd58d0ebc lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.708883:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd1153e6e00/0xa762dfcbd58d0ea0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0e99 expref: 21 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.708909:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd1153e6e00/0xa762dfcbd58d0ea0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0e99 expref: 21 pid: 6501 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843430.708923:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe0ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6500:1875738134348544:0@lo:104: 00000100:00100000:1.0:1788843430.708989:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788843430.709049:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd13fb34800/0xa762dfcbd58d0e7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0e76 expref: 21 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.709058:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd13fb34800/0xa762dfcbd58d0e7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0e76 expref: 21 pid: 6500 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843430.709066:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe0f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6500:1875738134348672:0@lo:104: 00000100:00100000:1.0:1788843430.709087:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788843430.709119:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd10f7af400/0xa762dfcbd58d0e61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0e5a expref: 21 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.709126:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd10f7af400/0xa762dfcbd58d0e61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0e5a expref: 21 pid: 6501 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843430.709134:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe0c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6500:1875738134348800:0@lo:104: 00000100:00100000:1.0:1788843430.709190:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788843430.709213:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d0e37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0e30 expref: 21 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.709221:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d0e37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0e30 expref: 21 pid: 6500 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843430.709230:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe0dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6500:1875738134348928:0@lo:104: 00000100:00100000:1.0:1788843430.709259:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788843430.709277:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd1153e6c00/0xa762dfcbd58d0e1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0e14 expref: 21 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.709285:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd1153e6c00/0xa762dfcbd58d0e1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0e14 expref: 21 pid: 6500 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843430.709294:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe0e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6500:1875738134349056:0@lo:104: 00000100:00100000:1.0:1788843430.709315:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788843430.709341:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0ddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0dd5 expref: 21 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.709350:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0ddc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0dd5 expref: 21 pid: 6498 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843430.709358:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd136c44e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6500:1875738134349184:0@lo:104: 00000100:00100000:1.0:1788843430.709397:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788843430.709425:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd1153e7c00/0xa762dfcbd58d0db2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0dab expref: 21 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.709433:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd1153e7c00/0xa762dfcbd58d0db2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0dab expref: 21 pid: 6500 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843430.709441:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6500:1875738134349312:0@lo:104: 00000100:00100000:1.0:1788843430.709462:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1106d0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788843430.709581:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788843430.709602:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843430.709614:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134348544 00000100:00100000:2.0:1788843430.709620:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134348544 00000100:00100000:2.0:1788843430.709659:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134348672 00000100:00100000:2.0:1788843430.709663:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134348672 00000100:00100000:2.0:1788843430.709672:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134348800 00000100:00100000:2.0:1788843430.709674:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134348800 00000100:00100000:2.0:1788843430.709681:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134348928 00000100:00100000:2.0:1788843430.709683:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134348928 00000100:00100000:2.0:1788843430.709691:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134349056 00000100:00100000:2.0:1788843430.709693:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134349056 00000100:00100000:2.0:1788843430.709700:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134349184 00000100:00100000:2.0:1788843430.709703:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134349184 00000100:00100000:2.0:1788843430.709711:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134349312 00000100:00100000:2.0:1788843430.709713:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134349312 00000100:00100000:2.0:1788843430.709737:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788843430.709746:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+9:6500:x1875738134348544:12345-0@lo:104: 00010000:00010000:2.0:1788843430.709772:0:6490:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6000/0xa762dfcbd58d0e99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0ea0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843430.709840:0:6490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788843430.709846:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+9:6500:x1875738134348544:12345-0@lo:104: Request processed in 102us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843430.709852:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788843430.709869:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788843430.709875:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+8:6500:x1875738134348672:12345-0@lo:104: 00010000:00010000:2.0:1788843430.709890:0:6490:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0e76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0e7d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843430.709922:0:6490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788843430.709927:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+8:6500:x1875738134348672:12345-0@lo:104: Request processed in 53us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843430.709934:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788843430.709947:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788843430.709953:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+7:6500:x1875738134348800:12345-0@lo:104: 00010000:00010000:2.0:1788843430.709960:0:6490:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd100031200/0xa762dfcbd58d0e5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0e61 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843430.709985:0:6490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788843430.709990:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+7:6500:x1875738134348800:12345-0@lo:104: Request processed in 39us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843430.709995:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788843430.710007:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788843430.710012:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+6:6500:x1875738134348928:12345-0@lo:104: 00010000:00010000:2.0:1788843430.710017:0:6490:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d0e30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0e37 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843430.710036:0:6490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788843430.710040:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+6:6500:x1875738134348928:12345-0@lo:104: Request processed in 29us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843430.710045:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788843430.710053:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788843430.710058:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+5:6500:x1875738134349056:12345-0@lo:104: 00010000:00010000:2.0:1788843430.710069:0:6490:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd100031400/0xa762dfcbd58d0e14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0e1b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843430.710089:0:6490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788843430.710093:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+5:6500:x1875738134349056:12345-0@lo:104: Request processed in 36us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843430.710098:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788843430.710110:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788843430.710115:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0065aec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+4:6500:x1875738134349184:12345-0@lo:104: 00010000:00010000:2.0:1788843430.710121:0:6490:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d0dd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0ddc expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843430.710165:0:6490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1788843430.710170:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0065aec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+4:6500:x1875738134349184:12345-0@lo:104: Request processed in 56us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843430.710175:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788843430.710216:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788843430.710222:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+3:6500:x1875738134349312:12345-0@lo:104: 00010000:00010000:2.0:1788843430.710229:0:6490:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d0dab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0db2 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843430.710253:0:6490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1788843430.710257:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+3:6500:x1875738134349312:12345-0@lo:104: Request processed in 36us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843430.710263:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788843430.710428:0:6495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788843430.710437:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6000/0xa762dfcbd58d0e99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0ea0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.710444:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e6000 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:0.0:1788843430.710454:0:6495:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6000/0xa762dfcbd58d0e99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0ea0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.710463:0:6495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6000/0xa762dfcbd58d0e99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0ea0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843430.710470:0:6495:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6000/0xa762dfcbd58d0e99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0ea0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843430.710476:0:6495:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788843430.710517:0:6495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6000/0xa762dfcbd58d0e99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0ea0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.710523:0:6495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843430.710544:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6000/0xa762dfcbd58d0e99 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0ea0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.710551:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6000/0xa762dfcbd58d0e99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0ea0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.710563:0:6495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788843430.710566:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0e76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0e7d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.710571:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e6200 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:0.0:1788843430.710574:0:6495:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0e76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0e7d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.710580:0:6495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0e76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0e7d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843430.710596:0:6495:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0e76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0e7d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843430.710601:0:6495:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788843430.710615:0:6495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0e76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0e7d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.710621:0:6495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843430.710635:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0e76 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0e7d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.710641:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0e76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0e7d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.710650:0:6495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788843430.710653:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd100031200/0xa762dfcbd58d0e5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0e61 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.710659:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd100031200 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:0.0:1788843430.710661:0:6495:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd100031200/0xa762dfcbd58d0e5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0e61 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.710667:0:6495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd100031200/0xa762dfcbd58d0e5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0e61 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843430.710673:0:6495:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd100031200/0xa762dfcbd58d0e5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0e61 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843430.710679:0:6495:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788843430.710700:0:6495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd100031200/0xa762dfcbd58d0e5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0e61 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.710706:0:6495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843430.710712:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd100031200/0xa762dfcbd58d0e5a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0e61 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.710717:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd100031200/0xa762dfcbd58d0e5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0e61 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.710728:0:6495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788843430.710732:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d0e30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0e37 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.710737:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7afe00 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:0.0:1788843430.710740:0:6495:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d0e30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0e37 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.710746:0:6495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d0e30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0e37 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843430.710752:0:6495:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d0e30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0e37 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843430.710758:0:6495:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788843430.710771:0:6495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d0e30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0e37 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.710777:0:6495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843430.710781:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d0e30 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0e37 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.710797:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d0e30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0e37 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.710806:0:6495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788843430.710809:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd100031400/0xa762dfcbd58d0e14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0e1b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.710815:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd100031400 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:0.0:1788843430.710818:0:6495:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd100031400/0xa762dfcbd58d0e14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0e1b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.710825:0:6495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd100031400/0xa762dfcbd58d0e14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0e1b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843430.710831:0:6495:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd100031400/0xa762dfcbd58d0e14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0e1b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843430.710836:0:6495:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788843430.710848:0:6495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd100031400/0xa762dfcbd58d0e14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0e1b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.710853:0:6495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843430.710856:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd100031400/0xa762dfcbd58d0e14 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0e1b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.710861:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd100031400/0xa762dfcbd58d0e14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0e1b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.710868:0:6495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788843430.710876:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d0dd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0ddc expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.710881:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7ae600 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:0.0:1788843430.710883:0:6495:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d0dd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0ddc expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.710889:0:6495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d0dd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0ddc expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843430.710894:0:6495:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d0dd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0ddc expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843430.710898:0:6495:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788843430.710909:0:6495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d0dd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0ddc expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.710914:0:6495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843430.710919:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d0dd5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0ddc expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.710924:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae600/0xa762dfcbd58d0dd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0ddc expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.710932:0:6495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843430.710934:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d0dab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0db2 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.710940:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb34200 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:0.0:1788843430.710942:0:6495:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d0dab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0db2 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.710958:0:6495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d0dab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0db2 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843430.710965:0:6495:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d0dab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0db2 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843430.710970:0:6495:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788843430.710982:0:6495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d0dab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0db2 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.710987:0:6495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843430.710991:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d0dab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0db2 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.710997:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d0dab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0db2 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.711011:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843430.711013:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843430.711015:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843430.711030:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134349440:0@lo:103: 00000100:00100000:0.0:1788843430.711084:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843430.711113:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134349952:0@lo:103: 00000100:00100000:0.0:1788843430.711133:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843430.711180:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788843430.711186:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134349824:0@lo:103: 00000100:00100000:0.0:1788843430.711206:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843430.711236:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134349568:0@lo:103: 00000100:00100000:0.0:1788843430.711270:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843430.711287:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e879500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134350080:0@lo:103: 00000100:00100000:0.0:1788843430.711307:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843430.711318:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788843430.711323:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134349696:0@lo:103: 00000100:00100000:0.0:1788843430.711353:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843430.711363:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134350208:0@lo:103: 00000100:00100000:0.0:1788843430.711381:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843430.711408:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134349440 00000100:00100000:0.0:1788843430.711414:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134349440 00010000:00010000:0.0:1788843430.711441:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd1153e6e00/0xa762dfcbd58d0ea0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0e99 expref: 22 pid: 6501 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843430.711458:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134349952 00000100:00100000:0.0:1788843430.711460:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134349952 00010000:00010000:0.0:1788843430.711470:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd1153e6c00/0xa762dfcbd58d0e1b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0e14 expref: 23 pid: 6500 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843430.711480:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134349824 00000100:00100000:0.0:1788843430.711482:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134349824 00010000:00010000:0.0:1788843430.711494:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d0e37 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0e30 expref: 24 pid: 6500 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843430.711502:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134349568 00000100:00100000:0.0:1788843430.711505:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134349568 00010000:00010000:0.0:1788843430.711513:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd13fb34800/0xa762dfcbd58d0e7d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0e76 expref: 25 pid: 6500 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843430.711521:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134350080 00000100:00100000:0.0:1788843430.711523:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134350080 00010000:00010000:0.0:1788843430.711540:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0ddc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0dd5 expref: 26 pid: 6498 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843430.711551:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134349696 00000100:00100000:0.0:1788843430.711554:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134349696 00010000:00010000:0.0:1788843430.711563:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd10f7af400/0xa762dfcbd58d0e61 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0e5a expref: 27 pid: 6501 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843430.711571:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134350208 00000100:00100000:0.0:1788843430.711574:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134350208 00010000:00010000:0.0:1788843430.711596:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd1153e7c00/0xa762dfcbd58d0db2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0dab expref: 28 pid: 6500 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843430.711610:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788843430.711617:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007242d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e79d9884-ba2e-42e7-accb-b4784b9c1837+28:3631:x1875738134349440:12345-0@lo:103: 00010000:00010000:0.0:1788843430.711628:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843430.711633:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd1153e6e00/0xa762dfcbd58d0ea0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0e99 expref: 28 pid: 6501 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.711643:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd1153e6e00/0xa762dfcbd58d0ea0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0e99 expref: 28 pid: 6501 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.711660:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843430.711694:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007242d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e79d9884-ba2e-42e7-accb-b4784b9c1837+28:3631:x1875738134349440:12345-0@lo:103: Request processed in 78us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843430.711700:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788843430.711715:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788843430.711721:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007240700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e79d9884-ba2e-42e7-accb-b4784b9c1837+27:3631:x1875738134349952:12345-0@lo:103: 00010000:00010000:0.0:1788843430.711729:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843430.711734:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd1153e6c00/0xa762dfcbd58d0e1b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0e14 expref: 27 pid: 6500 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.711748:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd1153e6c00/0xa762dfcbd58d0e1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0e14 expref: 27 pid: 6500 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.711757:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843430.711780:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007240700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e79d9884-ba2e-42e7-accb-b4784b9c1837+27:3631:x1875738134349952:12345-0@lo:103: Request processed in 59us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843430.711787:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788843430.711800:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788843430.711806:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007243100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e79d9884-ba2e-42e7-accb-b4784b9c1837+26:3631:x1875738134349824:12345-0@lo:103: 00010000:00010000:0.0:1788843430.711814:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843430.711818:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d0e37 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0e30 expref: 26 pid: 6500 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.711826:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d0e37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0e30 expref: 26 pid: 6500 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.711835:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843430.711855:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007243100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e79d9884-ba2e-42e7-accb-b4784b9c1837+26:3631:x1875738134349824:12345-0@lo:103: Request processed in 50us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843430.711861:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788843430.711872:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788843430.711877:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13332e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e79d9884-ba2e-42e7-accb-b4784b9c1837+25:3632:x1875738134349568:12345-0@lo:103: 00010000:00010000:0.0:1788843430.711884:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843430.711888:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd13fb34800/0xa762dfcbd58d0e7d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0e76 expref: 25 pid: 6500 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.711896:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd13fb34800/0xa762dfcbd58d0e7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0e76 expref: 25 pid: 6500 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.711912:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843430.711938:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13332e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e79d9884-ba2e-42e7-accb-b4784b9c1837+25:3632:x1875738134349568:12345-0@lo:103: Request processed in 61us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843430.711944:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788843430.711976:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788843430.711983:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007242300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3632:x1875738134350080:12345-0@lo:103: 00010000:00010000:0.0:1788843430.711989:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843430.711993:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0ddc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0dd5 expref: 24 pid: 6498 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.712002:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0ddc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0dd5 expref: 24 pid: 6498 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.712011:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843430.712032:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007242300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3632:x1875738134350080:12345-0@lo:103: Request processed in 49us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843430.712038:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788843430.712052:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788843430.712058:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007241180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:3632:x1875738134349696:12345-0@lo:103: 00010000:00010000:0.0:1788843430.712064:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843430.712069:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd10f7af400/0xa762dfcbd58d0e61 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0e5a expref: 23 pid: 6501 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.712077:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd10f7af400/0xa762dfcbd58d0e61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0e5a expref: 23 pid: 6501 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.712086:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843430.712114:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007241180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:3632:x1875738134349696:12345-0@lo:103: Request processed in 56us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843430.712120:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788843430.712132:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788843430.712138:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007242a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:3632:x1875738134350208:12345-0@lo:103: 00010000:00010000:0.0:1788843430.712169:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843430.712174:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd1153e7c00/0xa762dfcbd58d0db2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0dab expref: 22 pid: 6500 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.712184:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd1153e7c00/0xa762dfcbd58d0db2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0dab expref: 22 pid: 6500 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.712195:0:7448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd13fb34000/0xa762dfcbd58d0ebc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.712203:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd13fb34000/0xa762dfcbd58d0ebc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.712217:0:7448:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd13fb34000/0xa762dfcbd58d0ebc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.712224:0:7448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd13fb34000/0xa762dfcbd58d0ebc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.712232:0:7448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd13fb34000/0xa762dfcbd58d0ebc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.712238:0:7448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd13fb34000/0xa762dfcbd58d0ebc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.712243:0:7448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb34000 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843430.712254:0:7448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd13fb34000/0xa762dfcbd58d0ebc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.712263:0:7448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd13fb34000/0xa762dfcbd58d0ebc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.712272:0:7448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd13fb34000/0xa762dfcbd58d0ebc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.712281:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843430.712306:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007242a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:3632:x1875738134350208:12345-0@lo:103: Request processed in 168us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843430.712311:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788843430.712372:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134349696:0@lo:103: 00000100:00100000:0.0:1788843430.712381:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134350208:0@lo:103: 00000100:00100000:0.0:1788843430.712387:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134349568:0@lo:103: 00000100:00100000:0.0:1788843430.712393:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e879500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134350080:0@lo:103: 00000100:00100000:0.0:1788843430.712421:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134349824:0@lo:103: 00000100:00100000:0.0:1788843430.712428:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134349440:0@lo:103: 00000100:00100000:0.0:1788843430.712434:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134349952:0@lo:103: 00010000:00010000:1.0:1788843430.712542:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1153e6e00/0xa762dfcbd58d0ea0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0e99 expref: 21 pid: 6501 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843430.712555:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe0ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6500:1875738134348544:0@lo:104: 00010000:00010000:1.0:1788843430.712565:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd13fb34800/0xa762dfcbd58d0e7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0e76 expref: 20 pid: 6500 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843430.712581:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe0f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6500:1875738134348672:0@lo:104: 00010000:00010000:1.0:1788843430.712595:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd10f7af400/0xa762dfcbd58d0e61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0e5a expref: 19 pid: 6501 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843430.712602:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe0c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6500:1875738134348800:0@lo:104: 00010000:00010000:1.0:1788843430.712611:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d0e37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0e30 expref: 18 pid: 6500 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843430.712618:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe0dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6500:1875738134348928:0@lo:104: 00010000:00010000:1.0:1788843430.712627:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1153e6c00/0xa762dfcbd58d0e1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0e14 expref: 17 pid: 6500 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843430.712635:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe0e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6500:1875738134349056:0@lo:104: 00010000:00010000:1.0:1788843430.712644:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0ddc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0dd5 expref: 16 pid: 6498 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843430.712652:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd136c44e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6500:1875738134349184:0@lo:104: 00010000:00010000:1.0:1788843430.712661:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1153e7c00/0xa762dfcbd58d0db2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0dab expref: 15 pid: 6500 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843430.712668:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6500:1875738134349312:0@lo:104: 00010000:00010000:1.0:1788843430.712691:0:6500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd13fb34000/0xa762dfcbd58d0ebc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.712700:0:6500:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd13fb34000/0xa762dfcbd58d0ebc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.712716:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd13fb34000/0xa762dfcbd58d0ebc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.712723:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd13fb34000/0xa762dfcbd58d0ebc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788843430.712735:0:6500:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:3.0:1788843430.713102:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843430.729963:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1153f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+14:9499:x1875738134348416:12345-0@lo:253: Request processed in 33572us (33923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843430.729977:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788843430.730103:0:9499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134348416:0@lo:253: 10000000:01000000:2.0:1788843430.730120:0:9499:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788843430.730175:0:9499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788843430.730177:0:9499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788843430.730179:0:9499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843430.730180:0:9499:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788843430.730181:0:9499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843430.730182:0:9499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843430.730183:0:9499:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788843430.730185:0:9499:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788843430.730187:0:9499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843430.730188:0:9499:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788843430.730209:0:9499:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bd006461000 from lustre-OST0001 10000000:01000000:2.0:1788843430.730245:0:9499:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788843430.730248:0:9499:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788843430.730258:0:9499:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bd13339b370 local copy 10000000:01000000:2.0:1788843430.730262:0:9499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788843430.730298:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0ec3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843430.730309:0:9499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0ec3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843430.730319:0:9499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0ec3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843430.730350:0:9499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134350336:0@lo:101: 00000100:00100000:2.0:1788843430.730389:0:9499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843430.730426:0:9499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10556a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843430.730695:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134350336 00000100:00100000:0.0:1788843430.730703:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134350336 00000100:00100000:0.0:1788843430.730793:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788843430.730803:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1032f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+14:9499:x1875738134350336:12345-0@lo:101: 00010000:00010000:0.0:1788843430.730816:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843430.730836:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd100031400/0xa762dfcbd58d0eca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0ec3 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.730858:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd100031400/0xa762dfcbd58d0eca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0ec3 expref: 15 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.730868:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd100031400/0xa762dfcbd58d0eca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0ec3 expref: 15 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.730877:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd100031400, rc 0) 00000100:00100000:0.0:1788843430.730932:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1032f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:9499:x1875738134350336:12345-0@lo:101: Request processed in 131us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843430.730938:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788843430.731029:0:9499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134350336:0@lo:101: 00010000:00010000:1.0:1788843430.731042:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0ec3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa762dfcbd58d0eca expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.731049:0:9499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0ec3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa762dfcbd58d0eca expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843430.731191:0:9499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134350464:0@lo:501: 00000100:00100000:1.0:1788843430.731220:0:9499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843430.731247:0:9499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1106d03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843430.731409:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134350464 00000100:00100000:0.0:1788843430.731414:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134350464 00000100:00100000:0.0:1788843430.731449:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788843430.731457:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1032f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:9499:x1875738134350464:12345-0@lo:501: 00000100:00100000:0.0:1788843430.731531:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1032f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:9499:x1875738134350464:12345-0@lo:501: Request processed in 74us (310us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788843430.731537:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788843430.731622:0:9499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134350464:0@lo:501: 10000000:01000000:3.0:1788843430.731637:0:9499:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.133@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788843430.731660:0:9499:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.133@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788843430.731666:0:9499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0ec3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa762dfcbd58d0eca expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843430.731674:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0ec3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa762dfcbd58d0eca expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843430.731681:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0ec3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa762dfcbd58d0eca expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843430.731708:0:9499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788843430.731745:0:9499:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bd006461000 10000000:01000000:3.0:1788843430.731749:0:9499:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788843430.731755:0:9499:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788843430.731757:0:9499:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788843430.731761:0:9499:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788843430.731763:0:9499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788843430.731782:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae200/0xa762dfcbd58d0ed1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843430.731789:0:9499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae200/0xa762dfcbd58d0ed1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843430.731796:0:9499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae200/0xa762dfcbd58d0ed1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843430.731808:0:9499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f987800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134350592:0@lo:101: 00000100:00100000:3.0:1788843430.731838:0:9499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843430.731860:0:9499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13fa33300 going to sleep for 11 seconds 00010000:00010000:0.0:1788843430.731974:0:6495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843430.731981:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0ec3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa762dfcbd58d0eca expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.731988:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e6200 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:0.0:1788843430.731992:0:6495:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0ec3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa762dfcbd58d0eca expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.732000:0:6495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0ec3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xa762dfcbd58d0eca expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843430.732017:0:6495:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0ec3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xa762dfcbd58d0eca expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843430.732022:0:6495:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788843430.732041:0:6495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0ec3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa762dfcbd58d0eca expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.732047:0:6495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843430.732073:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0ec3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa762dfcbd58d0eca expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.732080:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0ec3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa762dfcbd58d0eca expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.732111:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843430.732113:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843430.732114:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843430.732121:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788843430.732133:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007242d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134350720:0@lo:103: 00000100:00100000:0.0:1788843430.732187:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843430.732221:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134350720 00000100:00100000:0.0:1788843430.732225:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134350720 00000100:00100000:0.0:1788843430.732258:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788843430.732266:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007240700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:3631:x1875738134350720:12345-0@lo:103: 00010000:00010000:0.0:1788843430.732276:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843430.732289:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd100031400/0xa762dfcbd58d0eca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d0ec3 expref: 15 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.732302:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843430.732350:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007240700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e79d9884-ba2e-42e7-accb-b4784b9c1837+14:3631:x1875738134350720:12345-0@lo:103: Request processed in 84us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843430.732357:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788843430.732387:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007242d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134350720:0@lo:103: 00000100:00100000:0.0:1788843430.732402:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134350592 00000100:00100000:0.0:1788843430.732404:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134350592 00000100:00100000:0.0:1788843430.732419:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788843430.732424:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1032f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+14:9499:x1875738134350592:12345-0@lo:101: 00010000:00010000:0.0:1788843430.732432:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843430.732443:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd100031200/0xa762dfcbd58d0ed8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0ed1 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.732461:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd100031200/0xa762dfcbd58d0ed8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0ed1 expref: 15 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.732471:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd100031200/0xa762dfcbd58d0ed8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0ed1 expref: 15 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.732477:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd100031200, rc 0) 00000100:00100000:0.0:1788843430.732505:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1032f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:9499:x1875738134350592:12345-0@lo:101: Request processed in 80us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843430.732511:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788843430.732617:0:9499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f987800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134350592:0@lo:101: 00010000:00010000:3.0:1788843430.732631:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae200/0xa762dfcbd58d0ed1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0ed8 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843430.732638:0:9499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae200/0xa762dfcbd58d0ed1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0ed8 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843430.732721:0:9499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f987800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134350848:0@lo:501: 00000100:00100000:3.0:1788843430.732754:0:9499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843430.732766:0:9499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13fa33300 going to sleep for 11 seconds 00000100:00100000:0.0:1788843430.732943:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134350848 00000100:00100000:0.0:1788843430.732947:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134350848 00000100:00100000:0.0:1788843430.732966:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788843430.732972:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:9499:x1875738134350848:12345-0@lo:501: 00000100:00100000:0.0:1788843430.733080:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:9499:x1875738134350848:12345-0@lo:501: Request processed in 108us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843430.733109:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788843430.733237:0:9499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f987800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134350848:0@lo:501: 00000100:00100000:3.0:1788843430.733272:0:9499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f987800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134350976:0@lo:503: 00000100:00100000:3.0:1788843430.733312:0:9499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843430.733345:0:9499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13fa33300 going to sleep for 11 seconds 00000100:00100000:0.0:1788843430.733457:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134350976 00000100:00100000:0.0:1788843430.733462:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134350976 00000100:00100000:0.0:1788843430.733481:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788843430.733487:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:9499:x1875738134350976:12345-0@lo:503: 00000100:00100000:0.0:1788843430.733570:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:9499:x1875738134350976:12345-0@lo:503: Request processed in 82us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843430.733576:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788843430.733654:0:9499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f987800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134350976:0@lo:503: 00000040:00080000:3.0:1788843430.733935:0:9499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788843430.733996:0:9499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f987800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134351104:0@lo:502: 00000100:00100000:3.0:1788843430.734036:0:9499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843430.734062:0:9499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13fa33300 going to sleep for 11 seconds 00000100:00100000:1.0:1788843430.737535:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134351104 00000100:00100000:1.0:1788843430.737551:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134351104 00000100:00100000:1.0:1788843430.737610:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788843430.737621:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:9499:x1875738134351104:12345-0@lo:502: 00000100:00100000:1.0:1788843430.737822:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:9499:x1875738134351104:12345-0@lo:502: Request processed in 202us (3785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843430.737831:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788843430.738516:0:9499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f987800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134351104:0@lo:502: 00000040:00080000:3.0:1788843430.738796:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788843430.738832:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788843430.738865:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788843430.738880:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788843430.738895:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788843430.738908:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788843430.738942:0:9499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f987800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134351232:0@lo:502: 00000100:00100000:3.0:1788843430.738994:0:9499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843430.739034:0:9499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13fa33300 going to sleep for 11 seconds 00000100:00100000:1.0:1788843430.739106:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134351232 00000100:00100000:1.0:1788843430.739111:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134351232 00000100:00100000:1.0:1788843430.739179:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788843430.739187:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:9499:x1875738134351232:12345-0@lo:502: 00000100:00100000:1.0:1788843430.739284:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:9499:x1875738134351232:12345-0@lo:502: Request processed in 98us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843430.739290:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788843430.739466:0:9499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f987800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134351232:0@lo:502: 00000040:00080000:3.0:1788843430.739516:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788843430.739525:0:9499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1788843430.740006:0:9510:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788843430.740014:0:9510:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788843430.740021:0:9510:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843430.740023:0:9510:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788843430.740028:0:9510:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788843430.740043:0:9510:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9bd13df30000) 00000020:00000080:3.0:1788843430.740073:0:9510:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788843430.740078:0:9510:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788843430.740194:0:9510:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd006461000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788843430.740202:0:9510:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788843430.740210:0:9510:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa762dfcbd58d0ee6 00010000:00010000:2.0:1788843430.754187:0:9510:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:2.0:1788843430.754525:0:9510:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1788843430.765669:0:9510:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788843430.767492:0:9510:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788843430.785379:0:9510:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1788843430.785670:0:9510:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1788843430.795546:0:9510:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1788843430.799718:0:9510:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788843430.799731:0:9510:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843430.799738:0:9510:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843430.799740:0:9510:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788843430.799743:0:9510:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843430.799747:0:9510:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843430.799748:0:9510:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788843430.799751:0:9510:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788843430.799753:0:9510:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788843430.799782:0:9510:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843430.799785:0:9510:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843430.799787:0:9510:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788843430.799790:0:9510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788843430.799985:0:9499:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788843430.800016:0:9499:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788843430.800041:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae200/0xa762dfcbd58d0ed1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0ed8 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.800053:0:9499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae200/0xa762dfcbd58d0ed1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0ed8 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843430.800061:0:9499:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd006461000 from 1 10000000:01000000:1.0:1788843430.800063:0:9499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788843430.800108:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34000/0xa762dfcbd58d0eed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.800117:0:9499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34000/0xa762dfcbd58d0eed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.800128:0:9499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34000/0xa762dfcbd58d0eed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843430.800191:0:9499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134351360:0@lo:101: 00000100:00100000:1.0:1788843430.800262:0:9499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843430.800307:0:9499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1106d09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843430.800523:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134351360 00000100:00100000:0.0:1788843430.800531:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134351360 00000100:00100000:0.0:1788843430.800571:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788843430.800581:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e092050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:9499:x1875738134351360:12345-0@lo:101: 00010000:00010000:0.0:1788843430.800593:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843430.800606:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd100031400/0xa762dfcbd58d0ef4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0eed expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.800630:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd100031400/0xa762dfcbd58d0ef4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0eed expref: 16 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.800652:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd100031400/0xa762dfcbd58d0ef4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0eed expref: 16 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.800661:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd100031400, rc 0) 00000100:00100000:0.0:1788843430.800712:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e092050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:9499:x1875738134351360:12345-0@lo:101: Request processed in 132us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843430.800718:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788843430.800812:0:9499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134351360:0@lo:101: 00010000:00010000:2.0:1788843430.800828:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34000/0xa762dfcbd58d0eed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0ef4 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843430.800844:0:9499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34000/0xa762dfcbd58d0eed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0ef4 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843430.800941:0:9499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134351488:0@lo:501: 00000100:00100000:2.0:1788843430.800969:0:9499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843430.800999:0:9499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10556a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843430.801053:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134351488 00000100:00100000:0.0:1788843430.801058:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134351488 00000100:00100000:0.0:1788843430.801099:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788843430.801106:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:9499:x1875738134351488:12345-0@lo:501: 00000100:00100000:0.0:1788843430.801221:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:9499:x1875738134351488:12345-0@lo:501: Request processed in 115us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843430.801227:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788843430.801259:0:9499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134351488:0@lo:501: 00000100:00100000:0.0:1788843430.801284:0:9499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007242d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134351616:0@lo:503: 00000100:00100000:0.0:1788843430.801326:0:9499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843430.801357:0:9499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd102d36000 going to sleep for 11 seconds 00000100:00100000:0.0:1788843430.801371:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134351616 00000100:00100000:0.0:1788843430.801374:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134351616 00000100:00100000:0.0:1788843430.801392:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788843430.801396:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:9499:x1875738134351616:12345-0@lo:503: 00000100:00100000:0.0:1788843430.801470:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:9499:x1875738134351616:12345-0@lo:503: Request processed in 73us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843430.801476:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788843430.801522:0:9499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007242d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134351616:0@lo:503: 00000040:00080000:0.0:1788843430.801756:0:9499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788843430.801812:0:9499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007242d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134351744:0@lo:502: 00000100:00100000:0.0:1788843430.801847:0:9499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843430.801862:0:9499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd102d36000 going to sleep for 11 seconds 00000100:00100000:0.0:1788843430.801875:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134351744 00000100:00100000:0.0:1788843430.801879:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134351744 00000100:00100000:0.0:1788843430.801896:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788843430.801901:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:9499:x1875738134351744:12345-0@lo:502: 00000100:00100000:0.0:1788843430.801972:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:9499:x1875738134351744:12345-0@lo:502: Request processed in 69us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843430.801978:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788843430.802015:0:9499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007242d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134351744:0@lo:502: 00000040:00080000:0.0:1788843430.802219:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788843430.802244:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788843430.802263:0:9499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007242d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134351872:0@lo:502: 00000100:00100000:0.0:1788843430.802295:0:9499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843430.802317:0:9499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd102d36000 going to sleep for 11 seconds 00000100:00100000:0.0:1788843430.802344:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134351872 00000100:00100000:0.0:1788843430.802348:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134351872 00000100:00100000:0.0:1788843430.802368:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788843430.802374:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:9499:x1875738134351872:12345-0@lo:502: 00000100:00100000:0.0:1788843430.802432:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:9499:x1875738134351872:12345-0@lo:502: Request processed in 58us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843430.802439:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788843430.802442:0:9499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007242d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134351872:0@lo:502: 00000040:00080000:3.0:1788843430.802481:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788843430.802488:0:9499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788843430.818576:0:9514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843430.818591:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843430.818609:0:9514:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788843430.818617:0:9514:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd006461000 00000020:00000080:0.0:1788843430.818620:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788843430.818635:0:9514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843430.818638:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843430.818639:0:9514:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788843430.818642:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788843430.819057:0:9499:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788843430.819315:0:9499:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788843430.819380:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34000/0xa762dfcbd58d0eed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0ef4 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843430.819393:0:9499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34000/0xa762dfcbd58d0eed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0ef4 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843430.819520:0:9499:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788843430.819532:0:9499:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bd006461000 10000000:01000000:1.0:1788843430.819535:0:9499:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bd006461000 10000000:01000000:1.0:1788843430.819540:0:9499:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788843430.819547:0:9499:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd006461000 from 1 10000000:01000000:1.0:1788843430.819550:0:9499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788843430.819601:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34800/0xa762dfcbd58d0efb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.819610:0:9499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34800/0xa762dfcbd58d0efb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.819620:0:9499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34800/0xa762dfcbd58d0efb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843430.819643:0:9499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134352000:0@lo:101: 00000100:00100000:1.0:1788843430.819713:0:9499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843430.819763:0:9499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1106d00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843430.820933:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134352000 00000100:00100000:2.0:1788843430.820945:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134352000 00000100:00100000:2.0:1788843430.821015:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788843430.821026:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:9499:x1875738134352000:12345-0@lo:101: 00010000:00010000:2.0:1788843430.821041:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843430.821058:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1153e6000/0xa762dfcbd58d0f02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0efb expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843430.821085:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1153e6000/0xa762dfcbd58d0f02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0efb expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843430.821109:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1153e6000/0xa762dfcbd58d0f02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0efb expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843430.821135:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e6000, rc 0) 00000100:00100000:2.0:1788843430.821231:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:9499:x1875738134352000:12345-0@lo:101: Request processed in 207us (1518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843430.821238:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788843430.821450:0:9499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134352000:0@lo:101: 00010000:00010000:1.0:1788843430.821467:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34800/0xa762dfcbd58d0efb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0f02 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.821476:0:9499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34800/0xa762dfcbd58d0efb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0f02 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843430.822181:0:9499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134352128:0@lo:501: 00000100:00100000:1.0:1788843430.822230:0:9499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843430.822312:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134352128 00000100:00100000:2.0:1788843430.822318:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134352128 00000100:00100000:1.0:1788843430.822435:0:9499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1106d00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843430.823238:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788843430.823256:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:9499:x1875738134352128:12345-0@lo:501: 00000100:00100000:2.0:1788843430.823424:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:9499:x1875738134352128:12345-0@lo:501: Request processed in 175us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843430.823431:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788843430.823549:0:9499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134352128:0@lo:501: 00000100:00100000:1.0:1788843430.826471:0:9499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134352256:0@lo:503: 00000100:00100000:1.0:1788843430.826567:0:9499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843430.833275:0:9499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1106d00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843430.835236:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134352256 00000100:00100000:3.0:1788843430.835250:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134352256 00000100:00100000:3.0:1788843430.835319:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788843430.835329:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:9499:x1875738134352256:12345-0@lo:503: 00000100:00100000:3.0:1788843430.835525:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:9499:x1875738134352256:12345-0@lo:503: Request processed in 196us (8958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843430.835532:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788843430.835725:0:9499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134352256:0@lo:503: 00000040:00080000:1.0:1788843430.835993:0:9499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788843430.836481:0:9499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134352384:0@lo:502: 00000100:00100000:1.0:1788843430.836527:0:9499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843430.836562:0:9499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1106d00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843430.839403:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134352384 00000100:00100000:3.0:1788843430.839418:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134352384 00000100:00100000:3.0:1788843430.839469:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788843430.839478:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:9499:x1875738134352384:12345-0@lo:502: 00000100:00100000:3.0:1788843430.839662:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:9499:x1875738134352384:12345-0@lo:502: Request processed in 184us (3133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843430.839670:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788843430.839753:0:9499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134352384:0@lo:502: 00000040:00080000:1.0:1788843430.840065:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788843430.840099:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788843430.840115:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788843430.840127:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788843430.840159:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788843430.840176:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788843430.840187:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788843430.840201:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788843430.840213:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788843430.840226:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788843430.840238:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788843430.840524:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788843430.840545:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788843430.840559:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788843430.840570:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788843430.840600:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788843430.840614:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788843430.840627:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788843430.840642:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788843430.840656:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788843430.840670:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788843430.840685:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788843430.840711:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788843430.840726:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788843430.840740:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1788843430.840755:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1788843430.840770:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1788843430.840795:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1788843430.840807:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1788843430.840820:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1788843430.840833:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1788843430.840844:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1788843430.840856:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1788843430.840869:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1788843430.840882:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1788843430.840894:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1788843430.840906:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:1.0:1788843430.840919:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1788843430.840932:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:1.0:1788843430.840944:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:1.0:1788843430.840956:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:1.0:1788843430.840969:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:1.0:1788843430.840982:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:1.0:1788843430.841239:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:1.0:1788843430.841461:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:1.0:1788843430.841480:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:1.0:1788843430.841522:0:9499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134352512:0@lo:502: 00000100:00100000:1.0:1788843430.845822:0:9499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843430.845887:0:9499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1106d00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843430.845897:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134352512 00000100:00100000:3.0:1788843430.845907:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134352512 00000100:00100000:3.0:1788843430.845974:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788843430.845983:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:9499:x1875738134352512:12345-0@lo:502: 00000100:00100000:3.0:1788843430.846173:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:9499:x1875738134352512:12345-0@lo:502: Request processed in 191us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843430.846181:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788843430.846291:0:9499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134352512:0@lo:502: 00000040:00080000:0.0:1788843430.846392:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:0.0:1788843430.846406:0:9499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:0.0:1788843430.846929:0:9515:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788843430.846945:0:9515:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9bd13e918000) 00000020:00000080:0.0:1788843430.846970:0:9515:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:0.0:1788843430.847043:0:9515:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd006461000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788843430.847046:0:9515:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd006461000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788843430.847048:0:9515:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd006461000 3 00010000:00080000:0.0:1788843430.847072:0:9515:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd007225800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.133@tcp at head 00010000:00010000:0.0:1788843430.848548:0:9515:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:0.0:1788843430.848754:0:9515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788843430.848794:0:9515:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788843430.848806:0:9515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa762dfcbd58d0f10 00000100:00080000:0.0:1788843430.848815:0:9515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788843430.848820:0:9515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bd007225800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:0.0:1788843430.848852:0:9515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd007243100 x1875738134352640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788843430.848889:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007243100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1875738134352640:0@lo:38: 00000100:00100000:0.0:1788843430.848950:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788843430.848988:0:9515:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788843430.849073:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007241500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1875738134352768:0@lo:400: 00000100:00100000:0.0:1788843430.849107:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843430.849121:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1875738134353280:0@lo:400: 00000100:00100000:0.0:1788843430.849137:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843430.849172:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788843430.849177:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007242680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134353152:0@lo:400: 00000100:00100000:0.0:1788843430.849198:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843430.849212:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007241880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134353664:0@lo:400: 00000100:00100000:0.0:1788843430.849229:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843430.850767:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134352640 00000100:00100000:1.0:1788843430.850780:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134352640 00000100:00100000:1.0:1788843430.850816:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134352768 00000100:00100000:1.0:1788843430.850819:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134352768 00000100:00100000:1.0:1788843430.850841:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134353280 00000100:00100000:1.0:1788843430.850856:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134353280 00000100:00100000:1.0:1788843430.850897:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788843430.850907:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1875738134352768:12345-0@lo:400: 00000100:00080000:3.0:1788843430.851020:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843430.853353:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134352896:0@lo:400: 00000100:00100000:0.0:1788843430.853438:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843430.853533:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134353408:0@lo:400: 00000100:00100000:0.0:1788843430.853561:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843430.853581:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788843430.853588:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007240a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134353024:0@lo:400: 00000100:00100000:0.0:1788843430.853610:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843430.853622:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134353536:0@lo:400: 00000100:00100000:0.0:1788843430.853644:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843430.853688:0:6506:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788843430.853698:0:6506:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788843430.854452:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1875738134352768:12345-0@lo:400: Request processed in 3542us (5338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843430.854466:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788843430.854493:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134353408 00000100:00100000:1.0:1788843430.854501:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134353408 00000100:00100000:1.0:1788843430.854543:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134353024 00000100:00100000:1.0:1788843430.854546:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134353024 00000100:00100000:1.0:1788843430.854565:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788843430.854573:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1875738134353280:12345-0@lo:400: 00000100:00100000:1.0:1788843430.854627:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1875738134353280:12345-0@lo:400: Request processed in 55us (5489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843430.854633:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788843430.854647:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788843430.854653:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134353408:12345-0@lo:400: 00000100:00100000:1.0:1788843430.854685:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134353408:12345-0@lo:400: Request processed in 33us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843430.854691:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788843430.854702:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788843430.854708:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134353024:12345-0@lo:400: 00000100:00100000:1.0:1788843430.854733:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134353024:12345-0@lo:400: Request processed in 26us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843430.854738:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788843430.854749:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788843430.854754:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3629:x1875738134352640:12345-0@lo:38: 00010000:00080000:1.0:1788843430.854791:0:6507:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:1.0:1788843430.854835:0:6507:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa762dfcbd58d0f17 00000004:00100000:1.0:1788843430.854849:0:6507:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788843430.854881:0:6507:0:(import.c:65:import_set_state_nolock()) ffff9bd10f906000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843430.854918:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1875738134352640:12345-0@lo:38: Request processed in 162us (5967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843430.854924:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788843430.854945:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788843430.854980:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd007243100 x1875738134352640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788843440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843430.854990:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788843430.854998:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788843430.855006:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788843430.855011:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788843430.855013:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd007225800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788843430.855018:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007243100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1875738134352640:0@lo:38: 00010000:00080000:1.0:1788843430.855052:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd007241500 x1875738134352768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843430.855062:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007241500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1875738134352768:0@lo:400: 00010000:00080000:1.0:1788843430.855078:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd007240380 x1875738134353280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843430.855085:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1875738134353280:0@lo:400: 00010000:00080000:1.0:1788843430.855123:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd007240a80 x1875738134353024/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843430.855168:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007240a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134353024:0@lo:400: 00010000:00080000:1.0:1788843430.855183:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd007243800 x1875738134353408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843430.855191:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134353408:0@lo:400: 00000100:00100000:2.0:1788843430.856494:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134353664 00000100:00100000:2.0:1788843430.856506:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134353664 00000100:00100000:2.0:1788843430.856554:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134353536 00000100:00100000:2.0:1788843430.856557:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134353536 00000100:00100000:2.0:1788843430.856826:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788843430.856838:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134353664:12345-0@lo:400: 00000100:00100000:2.0:1788843430.856920:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134353664:12345-0@lo:400: Request processed in 85us (7689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843430.856926:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788843430.856941:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788843430.856947:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134353536:12345-0@lo:400: 00000100:00100000:2.0:1788843430.856977:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134353536:12345-0@lo:400: Request processed in 30us (3332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843430.856983:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788843430.857591:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134353152 00000100:00100000:3.0:1788843430.857599:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134353152 00000100:00080000:1.0:1788843430.858942:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788843430.859004:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd007241880 x1875738134353664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843430.859020:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007241880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134353664:0@lo:400: 00010000:00080000:1.0:1788843430.859057:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd007243480 x1875738134353536/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843430.859067:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134353536:0@lo:400: 00000100:00100000:0.0:1788843430.860299:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134352896 00000100:00100000:0.0:1788843430.860309:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134352896 00000100:00100000:0.0:1788843430.860379:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788843430.860389:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134352896:12345-0@lo:400: 00000100:00100000:0.0:1788843430.860487:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134352896:12345-0@lo:400: Request processed in 100us (7048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843430.860494:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788843430.860564:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134352896:0@lo:400: 00000100:00100000:2.0:1788843430.866290:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788843430.866311:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134353152:12345-0@lo:400: 00000100:00100000:2.0:1788843430.867208:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134353152:12345-0@lo:400: Request processed in 899us (18006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843430.867219:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000020:01000004:0.0:1788843430.867302:0:9515:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788843430.867319:0:9515:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9bd13e91b370) 00000020:00000080:0.0:1788843430.867353:0:9515:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:0.0:1788843430.867438:0:9515:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd006461000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788843430.867442:0:9515:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd006461000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788843430.867445:0:9515:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd006461000 3 00010000:00080000:0.0:1788843430.867487:0:9515:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd0075e9800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.133@tcp at head 00010000:00010000:0.0:1788843430.869066:0:9515:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:0.0:1788843430.869303:0:9515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788843430.869356:0:9515:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788843430.869368:0:9515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xa762dfcbd58d0f25 00000100:00080000:0.0:1788843430.869378:0:9515:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788843430.869383:0:9515:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9bd0075e9800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:0.0:1788843430.869421:0:9515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd1203d2d80 x1875738134353792/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788843430.869445:0:9515:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788843430.869547:0:9518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d1500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9518:1875738134353920:0@lo:901: 00000100:00100000:0.0:1788843430.869619:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843430.869665:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134353920 00000100:00100000:0.0:1788843430.869671:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134353920 00000100:00100000:0.0:1788843430.869730:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788843430.869740:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e879500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9518:x1875738134353920:12345-0@lo:901: 00000100:00100000:0.0:1788843430.869824:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e879500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9518:x1875738134353920:12345-0@lo:901: Request processed in 85us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843430.869831:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788843430.869861:0:9518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd102d36780 going to sleep for 11 seconds 00010000:00080000:0.0:1788843430.869892:0:9518:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd1203d1500 x1875738134353920/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788843446 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843430.869904:0:9518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d1500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9518:1875738134353920:0@lo:901: 00000100:00100000:1.0:1788843430.870462:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007242680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134353152:0@lo:400: 00000100:00100000:1.0:1788843430.870487:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3629:1875738134353792:0@lo:38: 00000100:00100000:1.0:1788843430.870524:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788843430.870560:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843430.870571:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134353792 00000100:00100000:1.0:1788843430.870575:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134353792 00000100:00100000:1.0:1788843430.870598:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788843430.870603:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3629:x1875738134353792:12345-0@lo:38: 00010000:00080000:1.0:1788843430.870623:0:6507:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:1.0:1788843430.870658:0:6507:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xa762dfcbd58d0f2c 00000004:00100000:1.0:1788843430.870675:0:6507:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788843430.870706:0:6507:0:(import.c:65:import_set_state_nolock()) ffff9bd10f901000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843430.870759:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1875738134353792:12345-0@lo:38: Request processed in 154us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843430.870766:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788843430.870801:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd1203d2d80 x1875738134353792/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788843440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843430.870808:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788843430.870813:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788843430.870821:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788843430.870825:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788843430.870828:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd0075e9800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788843430.870832:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3629:1875738134353792:0@lo:38: 00000040:00080000:0.0:1788843430.876800:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:2.0:1788843430.886232:0:9499:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1788843430.886287:0:9499:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788843430.886308:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34800/0xa762dfcbd58d0efb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0f02 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843430.886321:0:9499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34800/0xa762dfcbd58d0efb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0f02 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788843430.886401:0:9499:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788843430.886403:0:9499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788843430.886405:0:9499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843430.886406:0:9499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843430.886407:0:9499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843430.886408:0:9499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843430.886410:0:9499:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788843430.886411:0:9499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788843430.886412:0:9499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788843430.886414:0:9499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843430.886415:0:9499:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788843430.886419:0:9499:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788843430.886421:0:9499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788843430.886422:0:9499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788843430.886423:0:9499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843430.886424:0:9499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843430.886425:0:9499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843430.886426:0:9499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843430.886427:0:9499:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788843430.886428:0:9499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788843430.886428:0:9499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788843430.886429:0:9499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843430.886430:0:9499:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788843430.886463:0:9499:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788843430.886482:0:9499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134354048:0@lo:253: 00000100:00100000:2.0:1788843430.886557:0:9499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843430.886716:0:9499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10556af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788843430.890251:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134354048 00000100:00100000:1.0:1788843430.890266:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134354048 00000100:00100000:2.0:1788843430.891242:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788843430.891256:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:9499:x1875738134354048:12345-0@lo:253: 20000000:01000000:2.0:1788843430.891294:0:6501:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788843430.891309:0:6501:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788843430.902589:0:6501:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788843430.902609:0:6501:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788843430.902744:0:6522:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788843430.902749:0:6522:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788843430.902776:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0f33 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.902795:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd100030a00/0xa762dfcbd58d0e29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0e22 expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.902803:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd10f7afc00/0xa762dfcbd58d0e6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0e68 expref: 17 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.902811:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0f33 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.902855:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd10f7afc00/0xa762dfcbd58d0e6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0e68 expref: 17 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.902870:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd10f7afc00/0xa762dfcbd58d0e6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0e68 expref: 17 pid: 6498 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843430.902885:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e878700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6522:1875738134354176:0@lo:104: 00000100:00100000:0.0:1788843430.902954:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788843430.903023:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd100030a00/0xa762dfcbd58d0e29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0e22 expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.903031:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd100030a00/0xa762dfcbd58d0e29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0e22 expref: 17 pid: 6500 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843430.903064:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d2d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6522:1875738134354304:0@lo:104: 00000100:00100000:0.0:1788843430.903086:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843430.903113:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd102d36900 going to sleep for 11 seconds 00000100:00100000:3.0:1788843430.903183:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134354176 00000100:00100000:3.0:1788843430.903191:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134354176 00000100:00100000:2.0:1788843430.903206:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134354304 00000100:00100000:2.0:1788843430.903209:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134354304 00000100:00100000:3.0:1788843430.903241:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788843430.903250:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e879f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+4:6522:x1875738134354176:12345-0@lo:104: 00010000:00010000:3.0:1788843430.903404:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6600/0xa762dfcbd58d0e68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0e6f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843430.903478:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788843430.903485:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e879f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+4:6522:x1875738134354176:12345-0@lo:104: Request processed in 237us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843430.903539:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e878700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6522:1875738134354176:0@lo:104: 00010000:00010000:1.0:1788843430.903646:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843430.903653:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6600/0xa762dfcbd58d0e68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0e6f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.903661:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e6600 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:1.0:1788843430.903666:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6600/0xa762dfcbd58d0e68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0e6f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.903684:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6600/0xa762dfcbd58d0e68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0e6f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788843430.903699:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6600/0xa762dfcbd58d0e68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0e6f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843430.903705:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788843430.903738:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6600/0xa762dfcbd58d0e68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0e6f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.903752:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788843430.903772:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6600/0xa762dfcbd58d0e68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0e6f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.903778:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6600/0xa762dfcbd58d0e68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0e6f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.903791:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843430.903793:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843430.903794:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843430.903806:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134354432:0@lo:103: 00000100:00100000:1.0:1788843430.903839:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843430.903884:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134354432 00000100:00100000:1.0:1788843430.903889:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134354432 00010000:00010000:1.0:1788843430.903911:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd10f7afc00/0xa762dfcbd58d0e6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0e68 expref: 18 pid: 6498 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843430.903934:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788843430.903941:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:3631:x1875738134354432:12345-0@lo:103: 00010000:00010000:1.0:1788843430.903951:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843430.903956:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd10f7afc00/0xa762dfcbd58d0e6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0e68 expref: 18 pid: 6498 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.903965:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd10f7afc00/0xa762dfcbd58d0e6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0e68 expref: 18 pid: 6498 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.903978:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd10f7afc00/0xa762dfcbd58d0e6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0e68 expref: 18 pid: 6498 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.904001:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843430.904034:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:3631:x1875738134354432:12345-0@lo:103: Request processed in 92us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843430.904040:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788843430.904075:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134354432:0@lo:103: 00000100:00100000:3.0:1788843430.906573:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788843430.906621:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788843430.906639:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+3:6522:x1875738134354304:12345-0@lo:104: 00010000:00010000:3.0:1788843430.906658:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d0e22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0e29 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843430.906765:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788843430.906772:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+3:6522:x1875738134354304:12345-0@lo:104: Request processed in 144us (3684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843430.906778:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788843430.906947:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d2d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6522:1875738134354304:0@lo:104: 00010000:00010000:2.0:1788843430.906975:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0f33 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843430.907340:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:9499:x1875738134354048:12345-0@lo:253: Request processed in 16079us (20773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843430.907351:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00010000:00010000:0.0:1788843430.907395:0:6495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843430.907402:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d0e22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0e29 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.907410:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e7a00 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:0.0:1788843430.907414:0:6495:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d0e22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0e29 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.907423:0:6495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d0e22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0e29 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843430.907430:0:6495:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d0e22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0e29 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843430.907436:0:6495:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788843430.907475:0:6495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d0e22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0e29 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.907482:0:6495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843430.907508:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d0e22 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0e29 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.907535:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d0e22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0e29 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843430.907551:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843430.907553:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843430.907554:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843430.907569:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134354560:0@lo:103: 00000100:00100000:3.0:1788843430.907615:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843430.914952:0:9499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e79d9884-ba2e-42e7-accb-b4784b9c1837:9499:1875738134354048:0@lo:253: 10000000:01000000:2.0:1788843430.914974:0:9499:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788843430.914977:0:9499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788843430.914980:0:9499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788843430.914982:0:9499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843430.914983:0:9499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843430.914984:0:9499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843430.914985:0:9499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843430.914987:0:9499:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788843430.914989:0:9499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788843430.914990:0:9499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788843430.914992:0:9499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843430.914993:0:9499:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788843430.915022:0:9499:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788843430.917200:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134354560 00000100:00100000:0.0:1788843430.917215:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134354560 00010000:00010000:1.0:1788843430.917306:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd100030a00/0xa762dfcbd58d0e29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0e22 expref: 16 pid: 6500 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843430.917357:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788843430.917368:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f987800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:3632:x1875738134354560:12345-0@lo:103: 00010000:00010000:1.0:1788843430.917385:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843430.917391:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd100030a00/0xa762dfcbd58d0e29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0e22 expref: 16 pid: 6500 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.917402:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd100030a00/0xa762dfcbd58d0e29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0e22 expref: 16 pid: 6500 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.917421:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd100030a00/0xa762dfcbd58d0e29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0e22 expref: 16 pid: 6500 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.917438:0:7448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0f33 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.917447:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0f33 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788843430.917466:0:7448:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014718127s 00010000:00010000:1.0:1788843430.917471:0:7448:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0f33 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.917495:0:7448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0f33 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.917502:0:7448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0f33 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.917510:0:7448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0f33 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.917517:0:7448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd100030e00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843430.917521:0:7448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0f33 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.917530:0:7448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0f33 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.917551:0:7448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0f33 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843430.917564:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843430.917646:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f987800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:3632:x1875738134354560:12345-0@lo:103: Request processed in 280us (10030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843430.917654:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788843430.917701:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134354560:0@lo:103: 00010000:00010000:3.0:1788843430.917975:0:6522:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0f33 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843430.917985:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0f33 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843430.917992:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0f33 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1788843430.922852:0:9499:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788843430.923042:0:9499:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788843430.923749:0:9499:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788843430.923902:0:9499:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788843430.924552:0:9499:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788843430.930233:0:9499:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1788843430.935591:0:9499:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788843430.971457:0:9499:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788843430.971468:0:9499:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788843430.971523:0:9499:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788843430.971567:0:9499:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.133@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788843430.971619:0:9499:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1788843430.971643:0:9499:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1788843430.972680:0:9499:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788843430.972889:0:9499:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1788843431.076559:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843431.325027:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134354688:0@lo:13: 00000100:00100000:3.0:1788843431.325160:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843431.325268:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134354688 00000100:00100000:3.0:1788843431.325278:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134354688 00000100:00100000:3.0:1788843431.325354:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788843431.325368:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f986300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134354688:12345-0@lo:13: 00002000:00000024:3.0:1788843431.325412:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843431.325471:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f986300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134354688:12345-0@lo:13: Request processed in 105us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843431.325479:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788843431.325548:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f987b80 x1875738134354688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843431.325569:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134354688:0@lo:13: 00000100:00100000:0.0:1788843431.834672:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134354816:0@lo:13: 00000100:00100000:0.0:1788843431.834774:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843431.834928:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134354816 00000100:00100000:3.0:1788843431.834940:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134354816 00000100:00100000:3.0:1788843431.835004:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788843431.835016:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134354816:12345-0@lo:13: 00002000:00000024:3.0:1788843431.835048:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843431.835133:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134354816:12345-0@lo:13: Request processed in 119us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843431.835163:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788843431.835261:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00723d500 x1875738134354816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843431.835283:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134354816:0@lo:13: 00010000:00010000:1.0:1788843432.104929:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788843432.146169:0:9572:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788843432.146431:0:9572:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788843432.859103:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134354944:0@lo:41: 00000100:00100000:1.0:1788843432.859234:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843432.859434:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134354944 00000100:00100000:2.0:1788843432.859446:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134354944 00000100:00100000:2.0:1788843432.859508:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788843432.859519:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134354944:12345-0@lo:41: 00000004:00000024:2.0:1788843432.859564:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788843432.859668:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134354944:12345-0@lo:41: Request processed in 149us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843432.859676:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788843432.859852:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134354944:0@lo:41: 00000100:00100000:1.0:1788843432.860216:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134355072:0@lo:41: 00000100:00100000:1.0:1788843432.860256:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843432.860428:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134355072 00000100:00100000:0.0:1788843432.860435:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134355072 00000100:00100000:0.0:1788843432.860476:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788843432.860485:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134355072:12345-0@lo:41: 00000004:00000024:0.0:1788843432.860510:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1788843432.860562:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134355072:12345-0@lo:41: Request processed in 79us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843432.860568:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788843432.860640:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134355072:0@lo:41: 00010000:00010000:1.0:1788843433.117479:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843434.138571:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843435.165550:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843435.931657:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134355584:0@lo:400: 00000100:00100000:3.0:1788843435.931760:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843435.931839:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134356096:0@lo:400: 00000100:00100000:3.0:1788843435.931868:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843435.931906:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788843435.931914:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134355200:0@lo:400: 00000100:00100000:3.0:1788843435.931946:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843435.931981:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134355712:0@lo:400: 00000100:00100000:3.0:1788843435.932007:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843435.932028:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134356224:0@lo:400: 00000100:00100000:3.0:1788843435.932049:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843435.932090:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134355584 00000100:00100000:3.0:1788843435.932100:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134355584 00000100:00100000:3.0:1788843435.932191:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788843435.932203:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134355584:12345-0@lo:400: 00000100:00100000:3.0:1788843435.932469:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134355584:12345-0@lo:400: Request processed in 267us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843435.932478:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788843435.932510:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134356096 00000100:00100000:3.0:1788843435.932515:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134356096 00000100:00100000:3.0:1788843435.932554:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134356224 00000100:00100000:3.0:1788843435.932557:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134356224 00000100:00100000:3.0:1788843435.932602:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788843435.932608:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f985180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134356096:12345-0@lo:400: 00000100:00100000:3.0:1788843435.932654:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f985180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134356096:12345-0@lo:400: Request processed in 45us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843435.932660:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788843435.932673:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788843435.932679:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134356224:12345-0@lo:400: 00000100:00100000:3.0:1788843435.932705:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134356224:12345-0@lo:400: Request processed in 27us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843435.932711:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788843435.932729:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134355200 00000100:00100000:3.0:1788843435.932733:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134355200 00000100:00100000:3.0:1788843435.932757:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788843435.932764:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:3632:x1875738134355200:12345-0@lo:400: 00000100:00100000:3.0:1788843435.932794:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:3632:x1875738134355200:12345-0@lo:400: Request processed in 31us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843435.932801:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788843435.932834:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134355712 00000100:00100000:3.0:1788843435.932838:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134355712 00000100:00100000:3.0:1788843435.932867:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788843435.932874:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f986a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134355712:12345-0@lo:400: 00000100:00100000:3.0:1788843435.932909:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f986a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134355712:12345-0@lo:400: Request processed in 36us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843435.932915:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1788843435.932938:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843435.933098:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134355200:0@lo:400: 00000100:00100000:3.0:1788843435.933114:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134355712:0@lo:400: 00010000:00080000:3.0:1788843435.933168:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00723c700 x1875738134356224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843435.933180:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134356224:0@lo:400: 00010000:00080000:3.0:1788843435.933193:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00723d880 x1875738134355584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843435.933203:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134355584:0@lo:400: 00010000:00080000:3.0:1788843435.933214:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00723ed80 x1875738134356096/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843435.933288:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134356096:0@lo:400: 00000100:00100000:3.0:1788843435.933401:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134355328:0@lo:400: 00000100:00100000:3.0:1788843435.933441:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843435.933469:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134355840:0@lo:400: 00000100:00100000:3.0:1788843435.933491:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843435.933510:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1875738134356352:0@lo:400: 00000100:00100000:3.0:1788843435.933539:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843435.933560:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788843435.933567:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134355456:0@lo:400: 00000100:00100000:3.0:1788843435.933592:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843435.933612:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134355968:0@lo:400: 00000100:00100000:3.0:1788843435.933633:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843435.935132:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134356480:0@lo:400: 00000100:00100000:0.0:1788843435.935379:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134355328 00000100:00100000:0.0:1788843435.935390:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134355328 00000100:00100000:0.0:1788843435.935443:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134355840 00000100:00100000:0.0:1788843435.935446:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134355840 00000100:00100000:0.0:1788843435.935481:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134356352 00000100:00100000:0.0:1788843435.935484:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134356352 00000100:00100000:0.0:1788843435.935516:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134355968 00000100:00100000:0.0:1788843435.935520:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134355968 00000100:00100000:0.0:1788843435.935540:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788843435.935550:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134355328:12345-0@lo:400: 00000100:00100000:0.0:1788843435.935626:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134355328:12345-0@lo:400: Request processed in 76us (2184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843435.935633:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788843435.935663:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788843435.935670:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134355840:12345-0@lo:400: 00000100:00100000:0.0:1788843435.935699:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134355840:12345-0@lo:400: Request processed in 31us (2208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843435.935705:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788843435.935717:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788843435.935723:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875738134356352:12345-0@lo:400: 00000100:00100000:0.0:1788843435.935749:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875738134356352:12345-0@lo:400: Request processed in 27us (2210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843435.935755:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788843435.935765:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788843435.935770:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134355968:12345-0@lo:400: 00000100:00100000:0.0:1788843435.935793:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134355968:12345-0@lo:400: Request processed in 24us (2160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843435.935799:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1788843435.935823:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788843435.935828:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843435.935953:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788843435.936079:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00723f800 x1875738134355328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843435.936105:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134355328:0@lo:400: 00010000:00080000:3.0:1788843435.936120:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00723fb80 x1875738134355840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843435.936129:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134355840:0@lo:400: 00010000:00080000:3.0:1788843435.936167:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00723f100 x1875738134356352/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843435.936176:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1875738134356352:0@lo:400: 00010000:00080000:3.0:1788843435.936208:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00723dc00 x1875738134355968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843435.936217:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134355968:0@lo:400: 00000100:00100000:3.0:1788843435.936329:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134356480 00000100:00100000:3.0:1788843435.936334:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134356480 00000100:00100000:3.0:1788843435.936371:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788843435.936378:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134356480:12345-0@lo:400: 00000100:00100000:3.0:1788843435.936421:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134356480:12345-0@lo:400: Request processed in 43us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843435.936427:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788843435.936457:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134355456 00000100:00100000:3.0:1788843435.936462:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134355456 00000100:00100000:3.0:1788843435.936489:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788843435.936497:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134355456:12345-0@lo:400: 00000100:00100000:3.0:1788843435.936534:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134355456:12345-0@lo:400: Request processed in 38us (2941us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843435.936540:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1788843435.936562:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788843435.936592:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134355456:0@lo:400: 00010000:00080000:3.0:1788843435.936604:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00723d500 x1875738134356480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843435.936613:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134356480:0@lo:400: 00010000:00010000:1.0:1788843436.188075:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843436.442385:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134356608:0@lo:13: 00000100:00100000:0.0:1788843436.442466:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843436.442651:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134356608 00000100:00100000:3.0:1788843436.442661:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134356608 00000100:00100000:3.0:1788843436.442709:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 10000000:01000000:0.0:1788843436.442739:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788843436.442757:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd10c0f0000 from 39 10000000:01000000:0.0:1788843436.442761:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788843436.442792:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd100031600/0xa762dfcbd58d0f3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843436.442802:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd100031600/0xa762dfcbd58d0f3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843436.442814:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd100031600/0xa762dfcbd58d0f3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843436.442830:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe21180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134356736:0@lo:101: 00000100:00100000:0.0:1788843436.442863:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843436.442884:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00747c180 going to sleep for 11 seconds 00000100:00100000:0.0:1788843436.442897:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134356736 00000100:00100000:0.0:1788843436.442900:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134356736 00000100:00100000:0.0:1788843436.442929:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788843436.442936:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:6503:x1875738134356736:12345-0@lo:101: 00010000:00010000:0.0:1788843436.442948:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843436.442961:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0f41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0f3a expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843436.442984:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0f41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0f3a expref: 16 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843436.442995:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0f41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0f3a expref: 16 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843436.443003:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd100030e00, rc 0) 00000100:00100000:0.0:1788843436.443038:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:6503:x1875738134356736:12345-0@lo:101: Request processed in 102us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843436.443051:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788843436.443103:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe21180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134356736:0@lo:101: 00010000:00010000:0.0:1788843436.443117:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd100031600/0xa762dfcbd58d0f3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0f41 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843436.443127:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd100031600/0xa762dfcbd58d0f3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0f41 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843436.443199:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe21180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134356864:0@lo:501: 00000100:00100000:0.0:1788843436.443222:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843436.443241:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00747c180 going to sleep for 11 seconds 00000100:00100000:0.0:1788843436.443252:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134356864 00000100:00100000:0.0:1788843436.443255:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134356864 00000100:00100000:0.0:1788843436.443275:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788843436.443280:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:6503:x1875738134356864:12345-0@lo:501: 00000100:00100000:0.0:1788843436.443405:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:6503:x1875738134356864:12345-0@lo:501: Request processed in 124us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843436.443412:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788843436.443438:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe21180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134356864:0@lo:501: 00000100:00100000:0.0:1788843436.443461:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe21180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134356992:0@lo:503: 00000100:00100000:0.0:1788843436.443497:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843436.443509:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00747c180 going to sleep for 11 seconds 00000100:00100000:3.0:1788843436.443566:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134356608:12345-0@lo:13: 00002000:00000024:3.0:1788843436.443590:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843436.443629:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134356608:12345-0@lo:13: Request processed in 912us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843436.443719:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134356992 00000100:00100000:0.0:1788843436.443723:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134356992 00000100:00100000:0.0:1788843436.443746:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788843436.443753:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:6503:x1875738134356992:12345-0@lo:503: 00000100:00100000:0.0:1788843436.443837:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:6503:x1875738134356992:12345-0@lo:503: Request processed in 83us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843436.443844:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788843436.448600:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788843436.448765:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f986d80 x1875738134356608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843436.448792:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134356608:0@lo:13: 00000100:00100000:0.0:1788843436.448846:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe21180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134356992:0@lo:503: 00000100:00100000:3.0:1788843436.455075:0:9746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f985880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:9746:1875738134357120:0@lo:502: 00000100:00100000:3.0:1788843436.455197:0:9746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843436.455241:0:9746:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00772e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843436.455333:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134357120 00000100:00100000:0.0:1788843436.455340:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134357120 00000100:00100000:0.0:1788843436.455505:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788843436.455665:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:9746:x1875738134357120:12345-0@lo:502: 00000100:00100000:0.0:1788843436.455804:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:9746:x1875738134357120:12345-0@lo:502: Request processed in 290us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843436.455813:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788843436.456055:0:9746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f985880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:9746:1875738134357120:0@lo:502: 00000100:00100000:3.0:1788843436.456110:0:9746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f985880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:9746:1875738134357248:0@lo:502: 00000100:00100000:3.0:1788843436.456496:0:9746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843436.457684:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134357248 00000100:00100000:3.0:1788843436.457696:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134357248 00000100:00100000:3.0:1788843436.457785:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788843436.457795:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:9746:x1875738134357248:12345-0@lo:502: 00000100:00100000:3.0:1788843436.457924:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:9746:x1875738134357248:12345-0@lo:502: Request processed in 130us (1427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843436.457941:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788843436.457996:0:9746:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00772e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843436.458015:0:9746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f985880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:9746:1875738134357248:0@lo:502: 00000040:00080000:3.0:1788843436.458044:0:9746:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788843436.459080:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788843436.459107:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788843436.459117:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd100031600/0xa762dfcbd58d0f3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0f41 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843436.459129:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd100031600/0xa762dfcbd58d0f3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0f41 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843436.459161:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788843436.459164:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1788843436.459167:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788843436.459202:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7200/0xa762dfcbd58d0f48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843436.459210:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7200/0xa762dfcbd58d0f48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843436.459231:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7200/0xa762dfcbd58d0f48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843436.459252:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134357376:0@lo:101: 00000100:00100000:2.0:1788843436.459313:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843436.459345:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd11ae64480 going to sleep for 11 seconds 00000100:00100000:2.0:1788843436.459362:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134357376 00000100:00100000:2.0:1788843436.459368:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134357376 00000100:00100000:2.0:1788843436.459401:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788843436.459409:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:6503:x1875738134357376:12345-0@lo:101: 00010000:00010000:2.0:1788843436.459420:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843436.459432:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1153e7400/0xa762dfcbd58d0f4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0f48 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843436.459456:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1153e7400/0xa762dfcbd58d0f4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0f48 expref: 17 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843436.459467:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1153e7400/0xa762dfcbd58d0f4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0f48 expref: 17 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843436.459474:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e7400, rc 0) 00000100:00100000:2.0:1788843436.459504:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:6503:x1875738134357376:12345-0@lo:101: Request processed in 96us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843436.459510:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788843436.459548:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134357376:0@lo:101: 00010000:00010000:2.0:1788843436.459562:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7200/0xa762dfcbd58d0f48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0f4f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843436.459581:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7200/0xa762dfcbd58d0f48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0f4f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843436.460884:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134357504:0@lo:501: 00000100:00100000:2.0:1788843436.460930:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843436.460957:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd11ae64480 going to sleep for 11 seconds 00000100:00100000:2.0:1788843436.460994:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134357504 00000100:00100000:2.0:1788843436.461000:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134357504 00000100:00100000:2.0:1788843436.461044:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788843436.461052:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:6503:x1875738134357504:12345-0@lo:501: 00000100:00100000:2.0:1788843436.461208:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:6503:x1875738134357504:12345-0@lo:501: Request processed in 155us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843436.461216:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788843436.463751:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134357504:0@lo:501: 00000100:00100000:3.0:1788843436.463819:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f985880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134357632:0@lo:503: 00000100:00100000:3.0:1788843436.463896:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843436.463936:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00772e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843436.463961:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134357632 00000100:00100000:3.0:1788843436.463966:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134357632 00000100:00100000:3.0:1788843436.464013:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788843436.464021:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:6503:x1875738134357632:12345-0@lo:503: 00000100:00100000:3.0:1788843436.464158:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:6503:x1875738134357632:12345-0@lo:503: Request processed in 118us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843436.464314:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788843436.464735:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f985880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134357632:0@lo:503: 00000100:00100000:3.0:1788843436.464933:0:9750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f985880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:9750:1875738134357760:0@lo:502: 00000100:00100000:3.0:1788843436.464973:0:9750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843436.464996:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134357760 00000100:00100000:3.0:1788843436.465000:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134357760 00000100:00100000:3.0:1788843436.465024:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788843436.465030:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:9750:x1875738134357760:12345-0@lo:502: 00000100:00100000:3.0:1788843436.465109:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:9750:x1875738134357760:12345-0@lo:502: Request processed in 79us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843436.465126:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788843436.468449:0:9750:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00772ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1788843436.468491:0:9750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f985880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:9750:1875738134357760:0@lo:502: 00000020:01000000:3.0:1788843436.468643:0:9750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788843436.468657:0:9750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843436.468660:0:9750:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788843436.468666:0:9750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788843436.468668:0:9750:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788843436.468703:0:9750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f985880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:9750:1875738134357888:0@lo:502: 00000100:00100000:3.0:1788843436.468776:0:9750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843436.468814:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134357888 00000100:00100000:3.0:1788843436.468821:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134357888 00000100:00100000:3.0:1788843436.468862:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788843436.468871:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:9750:x1875738134357888:12345-0@lo:502: 00000100:00100000:3.0:1788843436.468970:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:9750:x1875738134357888:12345-0@lo:502: Request processed in 100us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843436.468977:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788843436.469013:0:9750:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00772ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1788843436.469024:0:9750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f985880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:9750:1875738134357888:0@lo:502: 00000020:01000000:3.0:1788843436.469041:0:9750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843436.469045:0:9750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843436.469047:0:9750:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788843436.469051:0:9750:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1788843436.469114:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1788843436.469135:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788843436.471683:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7200/0xa762dfcbd58d0f48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0f4f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843436.471721:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7200/0xa762dfcbd58d0f48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0f4f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843436.471733:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788843436.471736:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd12e2b3800 from 39 10000000:01000000:3.0:1788843436.471740:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788843436.471780:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae800/0xa762dfcbd58d0f56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843436.471789:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae800/0xa762dfcbd58d0f56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843436.471799:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae800/0xa762dfcbd58d0f56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843436.471821:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f985880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134358016:0@lo:101: 00000100:00100000:3.0:1788843436.471885:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843436.471968:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00772ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788843436.476392:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134358016 00000100:00100000:1.0:1788843436.476406:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134358016 00000100:00100000:1.0:1788843436.476471:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788843436.476483:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:6503:x1875738134358016:12345-0@lo:101: 00010000:00010000:1.0:1788843436.476500:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843436.476520:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd13fb35400/0xa762dfcbd58d0f5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0f56 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843436.476550:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd13fb35400/0xa762dfcbd58d0f5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0f56 expref: 18 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843436.476561:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd13fb35400/0xa762dfcbd58d0f5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0f56 expref: 18 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843436.476570:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fb35400, rc 0) 00000100:00100000:1.0:1788843436.476666:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:6503:x1875738134358016:12345-0@lo:101: Request processed in 186us (4780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843436.476680:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788843436.476852:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f985880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134358016:0@lo:101: 00010000:00010000:1.0:1788843436.476873:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae800/0xa762dfcbd58d0f56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0f5d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843436.476883:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae800/0xa762dfcbd58d0f56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0f5d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843436.476958:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134358144:0@lo:501: 00000100:00100000:1.0:1788843436.476994:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843436.477022:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd114fe83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843436.477048:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134358144 00000100:00100000:1.0:1788843436.477052:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134358144 00000100:00100000:1.0:1788843436.477076:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788843436.477082:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:6503:x1875738134358144:12345-0@lo:501: 00000100:00100000:1.0:1788843436.477369:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:6503:x1875738134358144:12345-0@lo:501: Request processed in 286us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843436.477376:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788843436.477407:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134358144:0@lo:501: 00000100:00100000:1.0:1788843436.477433:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134358272:0@lo:503: 00000100:00100000:1.0:1788843436.477471:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843436.477484:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd118d470c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843436.477495:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134358272 00000100:00100000:1.0:1788843436.477498:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134358272 00000100:00100000:1.0:1788843436.477522:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788843436.477528:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:6503:x1875738134358272:12345-0@lo:503: 00000100:00100000:1.0:1788843436.477612:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:6503:x1875738134358272:12345-0@lo:503: Request processed in 83us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843436.477887:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788843436.478127:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134358272:0@lo:503: 00000100:00100000:1.0:1788843436.479359:0:9752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:9752:1875738134358400:0@lo:502: 00000100:00100000:1.0:1788843436.479423:0:9752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843436.479451:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134358400 00000100:00100000:1.0:1788843436.479457:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134358400 00000100:00100000:1.0:1788843436.479485:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788843436.479491:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:9752:x1875738134358400:12345-0@lo:502: 00000100:00100000:1.0:1788843436.479592:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:9752:x1875738134358400:12345-0@lo:502: Request processed in 99us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843436.479609:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788843436.479653:0:9752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd118d47780 going to sleep for 11 seconds 00000100:00100000:1.0:1788843436.479672:0:9752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:9752:1875738134358400:0@lo:502: 00000100:00100000:1.0:1788843436.479720:0:9752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:9752:1875738134358528:0@lo:502: 00000100:00100000:1.0:1788843436.479871:0:9752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843436.479903:0:9752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd118d47780 going to sleep for 11 seconds 00000100:00100000:0.0:1788843436.480101:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134358528 00000100:00100000:0.0:1788843436.480106:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134358528 00000100:00100000:0.0:1788843436.480174:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788843436.480183:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:9752:x1875738134358528:12345-0@lo:502: 00000100:00100000:0.0:1788843436.480265:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:9752:x1875738134358528:12345-0@lo:502: Request processed in 84us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843436.480272:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788843436.480283:0:9752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:9752:1875738134358528:0@lo:502: 00000040:00080000:1.0:1788843436.480314:0:9752:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1788843436.480391:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1788843436.480409:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788843436.480419:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae800/0xa762dfcbd58d0f56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0f5d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843436.480440:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae800/0xa762dfcbd58d0f56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0f5d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843436.480449:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788843436.480451:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd12e2b3800 from 6 10000000:01000000:1.0:1788843436.480453:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788843436.480480:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35600/0xa762dfcbd58d0f64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843436.480487:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35600/0xa762dfcbd58d0f64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843436.480496:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35600/0xa762dfcbd58d0f64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843436.480510:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134358656:0@lo:101: 00000100:00100000:1.0:1788843436.480536:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843436.480557:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd118d47780 going to sleep for 11 seconds 00000100:00100000:1.0:1788843436.480569:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134358656 00000100:00100000:1.0:1788843436.480572:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134358656 00000100:00100000:1.0:1788843436.480593:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788843436.480711:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:6503:x1875738134358656:12345-0@lo:101: 00010000:00010000:1.0:1788843436.480720:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843436.480799:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd13fb35e00/0xa762dfcbd58d0f6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0f64 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843436.480822:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd13fb35e00/0xa762dfcbd58d0f6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0f64 expref: 19 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843436.480842:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd13fb35e00/0xa762dfcbd58d0f6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0f64 expref: 19 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843436.480850:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fb35e00, rc 0) 00000100:00100000:1.0:1788843436.480879:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+19:6503:x1875738134358656:12345-0@lo:101: Request processed in 279us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843436.480885:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788843436.480916:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134358656:0@lo:101: 00010000:00010000:1.0:1788843436.480928:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35600/0xa762dfcbd58d0f64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0f6b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843436.480936:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35600/0xa762dfcbd58d0f64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0f6b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843436.480973:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134358784:0@lo:256: 00000100:00100000:1.0:1788843436.481000:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843436.481021:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd118d47780 going to sleep for 11 seconds 00000100:00100000:0.0:1788843436.481071:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134358784 00000100:00100000:0.0:1788843436.481076:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134358784 00000100:00100000:0.0:1788843436.481102:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788843436.481108:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+19:6503:x1875738134358784:12345-0@lo:256: 20000000:01000000:0.0:1788843436.481130:0:6498:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788843436.481169:0:6498:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788843436.481172:0:6498:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788843436.481248:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+19:6503:x1875738134358784:12345-0@lo:256: Request processed in 140us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843436.481255:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788843436.481985:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134358784:0@lo:256: 10000000:01000000:1.0:1788843436.482800:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788843436.482813:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35600/0xa762dfcbd58d0f64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0f6b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843436.482824:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35600/0xa762dfcbd58d0f64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0f6b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843436.482833:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788843436.482842:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:1.0:1788843436.482845:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788843436.482875:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d0f72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843436.482882:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d0f72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843436.482890:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d0f72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843436.482907:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134358912:0@lo:101: 00000100:00100000:1.0:1788843436.482960:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843436.482998:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd118d47780 going to sleep for 11 seconds 00000100:00100000:0.0:1788843436.483745:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134358912 00000100:00100000:0.0:1788843436.483754:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134358912 00000100:00100000:0.0:1788843436.483930:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788843436.483940:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+19:6503:x1875738134358912:12345-0@lo:101: 00010000:00010000:0.0:1788843436.483954:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843436.483968:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd100030a00/0xa762dfcbd58d0f79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0f72 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843436.483992:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd100030a00/0xa762dfcbd58d0f79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0f72 expref: 20 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843436.484001:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd100030a00/0xa762dfcbd58d0f79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0f72 expref: 20 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843436.484008:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd100030a00, rc 0) 00000100:00100000:0.0:1788843436.484066:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:6503:x1875738134358912:12345-0@lo:101: Request processed in 128us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843436.484072:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788843436.484381:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134358912:0@lo:101: 00010000:00010000:2.0:1788843436.484396:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d0f72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0f79 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843436.484404:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d0f72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0f79 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843436.484486:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134359040:0@lo:501: 00000100:00100000:2.0:1788843436.484825:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843436.484853:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd11ae64480 going to sleep for 11 seconds 00000100:00100000:1.0:1788843436.486312:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134359040 00000100:00100000:1.0:1788843436.486324:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134359040 00000100:00100000:1.0:1788843436.486381:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788843436.486390:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:6503:x1875738134359040:12345-0@lo:501: 00000100:00100000:1.0:1788843436.486560:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:6503:x1875738134359040:12345-0@lo:501: Request processed in 170us (1733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843436.486568:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788843436.486626:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134359040:0@lo:501: 00000100:00100000:1.0:1788843436.486673:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134359168:0@lo:503: 00000100:00100000:1.0:1788843436.486723:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843436.486762:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd118d47600 going to sleep for 11 seconds 00000100:00100000:1.0:1788843436.486774:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134359168 00000100:00100000:1.0:1788843436.486777:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134359168 00000100:00100000:1.0:1788843436.486794:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788843436.486800:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:6503:x1875738134359168:12345-0@lo:503: 00000100:00100000:1.0:1788843436.486876:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:6503:x1875738134359168:12345-0@lo:503: Request processed in 76us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843436.486883:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788843436.486920:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134359168:0@lo:503: 00000100:00100000:3.0:1788843436.487385:0:9754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f984000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:9754:1875738134359296:0@lo:502: 00000100:00100000:3.0:1788843436.487427:0:9754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843436.487456:0:9754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00772ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788843436.492369:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134359296 00000100:00100000:1.0:1788843436.492384:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134359296 00000100:00100000:1.0:1788843436.492455:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788843436.492466:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:9754:x1875738134359296:12345-0@lo:502: 00000100:00100000:1.0:1788843436.492642:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:9754:x1875738134359296:12345-0@lo:502: Request processed in 178us (5213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843436.492649:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788843436.497892:0:9754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f984000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:9754:1875738134359296:0@lo:502: 00000020:01000000:3.0:1788843436.497944:0:9754:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788843436.497952:0:9754:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788843436.497960:0:9754:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843436.497963:0:9754:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788843436.497969:0:9754:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788843436.497973:0:9754:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.133@tcp to nid 0x20000c0a8cb85 (192.168.203.133@tcp) 00000020:01000000:3.0:1788843436.498004:0:9754:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788843436.498008:0:9754:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788843436.498035:0:9754:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9bd0078b8000) 00000020:00000080:3.0:1788843436.498060:0:9754:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1788843436.498068:0:9754:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788843436.498188:0:9754:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788843436.498195:0:9754:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788843436.498204:0:9754:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa762dfcbd58d0f87 00010000:00080000:3.0:1788843436.498232:0:9754:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd13e95e800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.133@tcp at head 00010000:00010000:3.0:1788843436.498498:0:9754:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1788843436.498751:0:9754:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788843436.498764:0:9754:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788843436.498943:0:9754:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788843436.499073:0:9754:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788843436.499253:0:9754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788843436.499360:0:9754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788843436.501379:0:9755:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788843436.501385:0:9755:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788843436.516923:0:9754:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788843436.516939:0:9754:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788843436.516989:0:9754:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788843436.517014:0:9754:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa762dfcbd58d0f8e 00000100:00080000:3.0:1788843436.517025:0:9754:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788843436.517030:0:9754:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9bd13e95e800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:3.0:1788843436.517065:0:9754:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd10f984000 x1875738134359424/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788843436.517095:0:9754:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1788843436.517229:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134359424:0@lo:8: 00000100:00100000:1.0:1788843436.517312:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843436.517376:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134359424 00000100:00100000:1.0:1788843436.517383:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134359424 00000100:00100000:1.0:1788843436.517412:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788843436.517418:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3629:x1875738134359424:12345-0@lo:8: 00010000:00080000:1.0:1788843436.517452:0:8424:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:1.0:1788843436.517477:0:8424:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa762dfcbd58d0f95 00002000:00100000:1.0:1788843436.517490:0:8424:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9bd10f900000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396f ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788843436.517495:0:8424:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:1.0:1788843436.517498:0:8424:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788843436.517567:0:8424:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:3.0:1788843436.517655:0:9754:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843436.517659:0:9754:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843436.517661:0:9754:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788843436.517664:0:9754:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788843436.517669:0:9754:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843436.517680:0:9754:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788843436.517684:0:9754:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788843436.517686:0:9754:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788843436.517708:0:9754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f984380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:9754:1875738134359552:0@lo:502: 00000100:00100000:3.0:1788843436.517756:0:9754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843436.517781:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134359552 00000100:00100000:3.0:1788843436.517785:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134359552 00000100:00100000:3.0:1788843436.517823:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788843436.517830:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:9754:x1875738134359552:12345-0@lo:502: 00000100:00100000:3.0:1788843436.517931:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:9754:x1875738134359552:12345-0@lo:502: Request processed in 101us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843436.517939:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00002000:00080000:1.0:1788843436.517951:0:8424:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788843436.517974:0:8424:0:(import.c:65:import_set_state_nolock()) ffff9bd10f904000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788843436.517976:0:9754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00772e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843436.517994:0:9754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f984380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:9754:1875738134359552:0@lo:502: 00000020:01000000:3.0:1788843436.518015:0:9754:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:1.0:1788843436.518017:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3629:x1875738134359424:12345-0@lo:8: Request processed in 597us (704us total) trans 0 rc 0/0 00000020:00000080:3.0:1788843436.518018:0:9754:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843436.518020:0:9754:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788843436.518023:0:9754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:1.0:1788843436.518023:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788843436.519249:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f984000 x1875738134359424/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788843446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843436.519262:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788843436.519280:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788843436.519288:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788843436.519305:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788843436.519309:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd13e95e800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788843436.519328:0:3629:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788843436.519335:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134359424:0@lo:8: 00000004:00080000:2.0:1788843436.519377:0:9755:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788843436.519456:0:9755:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 214572314790ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788843436.519469:0:9755:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000020:01000000:2.0:1788843436.520256:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1788843436.520316:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788843436.520327:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d0f72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0f79 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843436.520339:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d0f72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0f79 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843436.520491:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788843436.520494:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd118db4800 from 39 10000000:01000000:2.0:1788843436.520497:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788843436.520666:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6e00/0xa762dfcbd58d0f9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843436.520675:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6e00/0xa762dfcbd58d0f9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843436.520684:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6e00/0xa762dfcbd58d0f9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843436.520705:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134359808:0@lo:101: 00000100:00100000:2.0:1788843436.520780:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843436.520823:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd11ae64480 going to sleep for 11 seconds 00000100:00100000:2.0:1788843436.520841:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134359808 00000100:00100000:2.0:1788843436.520848:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134359808 00000100:00100000:2.0:1788843436.520892:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788843436.520900:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:6503:x1875738134359808:12345-0@lo:101: 00010000:00010000:2.0:1788843436.520912:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843436.520925:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d0fa3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0f9c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843436.520948:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d0fa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0f9c expref: 21 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843436.520957:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d0fa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0f9c expref: 21 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843436.520964:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e7e00, rc 0) 00000100:00100000:2.0:1788843436.520998:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:6503:x1875738134359808:12345-0@lo:101: Request processed in 98us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843436.521004:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788843436.521042:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134359808:0@lo:101: 00010000:00010000:2.0:1788843436.521057:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6e00/0xa762dfcbd58d0f9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0fa3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843436.521066:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6e00/0xa762dfcbd58d0f9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0fa3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843436.521116:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134359936:0@lo:501: 00000100:00100000:2.0:1788843436.521179:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843436.521197:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd109144900 going to sleep for 11 seconds 00000100:00100000:2.0:1788843436.521208:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134359936 00000100:00100000:2.0:1788843436.521211:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134359936 00000100:00100000:2.0:1788843436.521230:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788843436.521235:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:6503:x1875738134359936:12345-0@lo:501: 00000100:00100000:2.0:1788843436.521359:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:6503:x1875738134359936:12345-0@lo:501: Request processed in 123us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843436.521365:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788843436.521393:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134359936:0@lo:501: 00000100:00100000:2.0:1788843436.521417:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134360064:0@lo:503: 00000100:00100000:2.0:1788843436.521456:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843436.521469:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd109144900 going to sleep for 11 seconds 00000100:00100000:2.0:1788843436.521479:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134360064 00000100:00100000:2.0:1788843436.521482:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134360064 00000100:00100000:2.0:1788843436.521501:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788843436.521506:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:6503:x1875738134360064:12345-0@lo:503: 00000100:00100000:3.0:1788843436.521920:0:9756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f984380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9756:1875738134360192:0@lo:700: 00000100:00100000:3.0:1788843436.521957:0:9756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843436.521985:0:9756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00772e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843436.522173:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:6503:x1875738134360064:12345-0@lo:503: Request processed in 632us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843436.522180:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788843436.522350:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134360064:0@lo:503: 00000100:00100000:3.0:1788843436.522793:0:9757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f985880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:9757:1875738134360320:0@lo:502: 00000100:00100000:3.0:1788843436.522839:0:9757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843436.522872:0:9757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00772ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788843436.522913:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134360320 00000100:00100000:2.0:1788843436.522919:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134360320 00000100:00100000:2.0:1788843436.522958:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788843436.522967:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:9757:x1875738134360320:12345-0@lo:502: 00000100:00100000:2.0:1788843436.523053:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:9757:x1875738134360320:12345-0@lo:502: Request processed in 88us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843436.523070:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788843436.523410:0:9757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f985880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:9757:1875738134360320:0@lo:502: 00000100:00100000:3.0:1788843436.523454:0:9757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f985880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:9757:1875738134360448:0@lo:502: 00000100:00100000:3.0:1788843436.523489:0:9757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843436.523582:0:9757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00772ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788843436.523685:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134360448 00000100:00100000:2.0:1788843436.523690:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134360448 00000100:00100000:2.0:1788843436.523721:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788843436.523729:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:9757:x1875738134360448:12345-0@lo:502: 00000100:00100000:2.0:1788843436.523813:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:9757:x1875738134360448:12345-0@lo:502: Request processed in 84us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843436.523820:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788843436.523895:0:9757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f985880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:9757:1875738134360448:0@lo:502: 00000040:00080000:3.0:1788843436.523912:0:9757:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788843436.524036:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788843436.524060:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788843436.524070:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6e00/0xa762dfcbd58d0f9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0fa3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843436.524081:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6e00/0xa762dfcbd58d0f9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0fa3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843436.524090:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788843436.524093:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd118db4800 from 6 10000000:01000000:2.0:1788843436.524097:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788843436.524121:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6c00/0xa762dfcbd58d0faa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843436.524129:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6c00/0xa762dfcbd58d0faa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843436.524137:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6c00/0xa762dfcbd58d0faa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843436.524695:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134360576:0@lo:101: 00000100:00100000:2.0:1788843436.524738:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843436.524858:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893240 going to sleep for 11 seconds 00000100:00100000:2.0:1788843436.524974:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134360576 00000100:00100000:2.0:1788843436.524980:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134360576 00000100:00100000:2.0:1788843436.525007:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788843436.525013:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:6503:x1875738134360576:12345-0@lo:101: 00010000:00010000:2.0:1788843436.525023:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843436.525035:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1153e7c00/0xa762dfcbd58d0fb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0faa expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843436.525056:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1153e7c00/0xa762dfcbd58d0fb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0faa expref: 22 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843436.525066:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1153e7c00/0xa762dfcbd58d0fb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0faa expref: 22 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843436.525074:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e7c00, rc 0) 00000100:00100000:2.0:1788843436.525102:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:6503:x1875738134360576:12345-0@lo:101: Request processed in 89us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843436.525108:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788843436.525206:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134360576:0@lo:101: 00010000:00010000:2.0:1788843436.525217:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6c00/0xa762dfcbd58d0faa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0fb1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843436.525226:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6c00/0xa762dfcbd58d0faa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0fb1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843436.525266:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134360704:0@lo:256: 00000100:00100000:2.0:1788843436.525310:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843436.525328:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893240 going to sleep for 11 seconds 00000100:00100000:2.0:1788843436.525338:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134360704 00000100:00100000:2.0:1788843436.525340:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134360704 00000100:00100000:2.0:1788843436.525359:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788843436.525364:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:6503:x1875738134360704:12345-0@lo:256: 20000000:01000000:2.0:1788843436.525375:0:6498:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788843436.525403:0:6498:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788843436.525406:0:6498:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788843436.525849:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:6503:x1875738134360704:12345-0@lo:256: Request processed in 482us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843436.525852:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134360192 00000100:00100000:2.0:1788843436.525857:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788843436.525867:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134360192 00000100:00100000:2.0:1788843436.525890:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134360704:0@lo:256: 00000100:00100000:1.0:1788843436.525917:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788843436.525928:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f984000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9756:x1875738134360192:12345-0@lo:700: 10000000:01000000:2.0:1788843436.525936:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788843436.525945:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6c00/0xa762dfcbd58d0faa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0fb1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843436.525954:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6c00/0xa762dfcbd58d0faa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0fb1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843436.525958:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8431:1875738134360832:0@lo:700: 10000000:01000000:2.0:1788843436.525977:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788843436.525979:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788843436.525981:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788843436.526000:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d0fb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843436.526007:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d0fb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843436.526024:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d0fb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843436.526035:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134360960:0@lo:101: 00000100:00100000:2.0:1788843436.526059:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843436.526072:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893240 going to sleep for 11 seconds 00000100:00100000:2.0:1788843436.526082:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134360960 00000100:00100000:2.0:1788843436.526084:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134360960 00000100:00100000:2.0:1788843436.526103:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788843436.526109:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:6503:x1875738134360960:12345-0@lo:101: 00010000:00010000:2.0:1788843436.526115:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843436.526126:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1153e6600/0xa762dfcbd58d0fbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0fb8 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843436.526135:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788843436.526169:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1153e6600/0xa762dfcbd58d0fbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0fb8 expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843436.526179:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd118d470c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788843436.526180:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1153e6600/0xa762dfcbd58d0fbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0fb8 expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843436.526190:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e6600, rc 0) 00000100:00080000:1.0:1788843436.526193:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788843436.526210:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134360832 00000100:00100000:1.0:1788843436.526214:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134360832 00000100:00100000:2.0:1788843436.526220:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:6503:x1875738134360960:12345-0@lo:101: Request processed in 110us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843436.526228:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788843436.526249:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788843436.526258:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8431:x1875738134360832:12345-0@lo:700: 00000100:00100000:2.0:1788843436.526263:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134360960:0@lo:101: 00010000:00010000:2.0:1788843436.526274:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d0fb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0fbf expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843436.526304:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d0fb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0fbf expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843436.526351:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134361088:0@lo:501: 00000100:00100000:2.0:1788843436.526372:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843436.526389:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893240 going to sleep for 11 seconds 00000100:00100000:2.0:1788843436.526397:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134361088 00000100:00100000:2.0:1788843436.526400:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134361088 00000100:00100000:2.0:1788843436.526415:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788843436.526420:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:6503:x1875738134361088:12345-0@lo:501: 00000100:00100000:2.0:1788843436.526506:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:6503:x1875738134361088:12345-0@lo:501: Request processed in 86us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843436.529837:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788843436.530679:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134361088:0@lo:501: 00000100:00100000:2.0:1788843436.530746:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134361216:0@lo:503: 00000100:00100000:2.0:1788843436.530815:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843436.530849:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893240 going to sleep for 11 seconds 00000100:00100000:2.0:1788843436.530865:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134361216 00000100:00100000:2.0:1788843436.530870:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134361216 00000100:00100000:2.0:1788843436.530902:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788843436.530909:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:6503:x1875738134361216:12345-0@lo:503: 00000004:00080000:3.0:1788843436.531118:0:7438:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1788843436.531813:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:6503:x1875738134361216:12345-0@lo:503: Request processed in 901us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843436.531823:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788843436.531883:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134361216:0@lo:503: 00000100:00100000:2.0:1788843436.532890:0:9758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:9758:1875738134361344:0@lo:502: 00000100:00100000:2.0:1788843436.532944:0:9758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843436.533034:0:9758:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893840 going to sleep for 11 seconds 00000100:00100000:3.0:1788843436.533077:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134361344 00000100:00100000:3.0:1788843436.533083:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134361344 00000100:00100000:3.0:1788843436.533126:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788843436.533135:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:9758:x1875738134361344:12345-0@lo:502: 00000100:00100000:3.0:1788843436.533263:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:9758:x1875738134361344:12345-0@lo:502: Request processed in 129us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843436.533270:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788843436.533416:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788843436.533429:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134359680:0@lo:400: 00000100:00100000:0.0:1788843436.533460:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843436.533536:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134361472:0@lo:400: 00000100:00100000:0.0:1788843436.533561:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843436.533708:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134361472 00000100:00100000:0.0:1788843436.533713:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134361472 00000100:00100000:0.0:1788843436.533744:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788843436.533751:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134361472:12345-0@lo:400: 00000100:00100000:0.0:1788843436.533789:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134361472:12345-0@lo:400: Request processed in 39us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843436.533796:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788843436.533830:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134361472:0@lo:400: 00000100:00100000:0.0:1788843436.533860:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1875738134361600:0@lo:400: 00000100:00100000:0.0:1788843436.533882:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843436.533907:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134359680 00000100:00100000:0.0:1788843436.533910:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134359680 00000100:00100000:0.0:1788843436.533930:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134361600 00000100:00100000:0.0:1788843436.533933:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134361600 00000100:00100000:0.0:1788843436.533947:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788843436.533953:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134359680:12345-0@lo:400: 00000100:00100000:0.0:1788843436.534051:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134359680:12345-0@lo:400: Request processed in 97us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843436.534057:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788843436.534069:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788843436.534075:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1875738134361600:12345-0@lo:400: 00000100:00100000:0.0:1788843436.534415:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1875738134361600:12345-0@lo:400: Request processed in 339us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843436.534422:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1788843436.534455:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fe21180 x1875738134359680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843436.534475:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134359680:0@lo:400: 00010000:00080000:0.0:1788843436.535077:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fe20e00 x1875738134361600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843436.535088:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1875738134361600:0@lo:400: 00000100:00100000:0.0:1788843436.535134:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134361728:0@lo:400: 00000100:00100000:0.0:1788843436.535182:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843436.535218:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134361728 00000100:00100000:0.0:1788843436.535223:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134361728 00000100:00100000:0.0:1788843436.535256:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788843436.535263:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134361728:12345-0@lo:400: 00000100:00100000:0.0:1788843436.535320:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134361728:12345-0@lo:400: Request processed in 57us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843436.535325:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788843436.535354:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134361728:0@lo:400: 00000100:00100000:0.0:1788843436.535377:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788843436.535382:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134361856:0@lo:400: 00000100:00100000:0.0:1788843436.535405:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843436.535427:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134361856 00000100:00100000:0.0:1788843436.535431:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134361856 00000100:00100000:0.0:1788843436.535453:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788843436.535459:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134361856:12345-0@lo:400: 00000100:00100000:0.0:1788843436.535489:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134361856:12345-0@lo:400: Request processed in 31us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843436.535495:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1788843436.535807:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fe20e00 x1875738134361856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843436.535817:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134361856:0@lo:400: 00000100:00100000:0.0:1788843436.535851:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134361984:0@lo:400: 00000100:00100000:0.0:1788843436.535876:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843436.535903:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134361984 00000100:00100000:0.0:1788843436.535907:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134361984 00000100:00100000:0.0:1788843436.535928:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788843436.535935:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134361984:12345-0@lo:400: 00000100:00100000:0.0:1788843436.536029:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134361984:12345-0@lo:400: Request processed in 93us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843436.536035:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1788843436.536062:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fe20e00 x1875738134361984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843436.536071:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134361984:0@lo:400: 00000100:00100000:0.0:1788843436.536097:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134362112:0@lo:400: 00000100:00100000:0.0:1788843436.536119:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843436.536184:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1875738134362240:0@lo:400: 00000100:00100000:0.0:1788843436.536227:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843436.536249:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134362240 00000100:00100000:0.0:1788843436.536252:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134362240 00000100:00100000:0.0:1788843436.536270:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788843436.536274:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1875738134362240:12345-0@lo:400: 00000100:00100000:0.0:1788843436.536318:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1875738134362240:12345-0@lo:400: Request processed in 43us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843436.536332:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1788843436.536354:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fe23800 x1875738134362240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843436.536363:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1875738134362240:0@lo:400: 00000100:00100000:3.0:1788843436.538096:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134362112 00000100:00100000:3.0:1788843436.538107:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134362112 00000100:00100000:3.0:1788843436.538175:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788843436.538184:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134362112:12345-0@lo:400: 00000100:00100000:3.0:1788843436.538254:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134362112:12345-0@lo:400: Request processed in 71us (2133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843436.538260:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788843436.538369:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fe20e00 x1875738134362112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843436.538382:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134362112:0@lo:400: 00000100:00100000:3.0:1788843436.539841:0:9758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:9758:1875738134361344:0@lo:502: 00000020:01000000:3.0:1788843436.539886:0:9758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788843436.539894:0:9758:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788843436.539902:0:9758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843436.539905:0:9758:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788843436.539911:0:9758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788843436.539915:0:9758:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.133@tcp to nid 0x20000c0a8cb85 (192.168.203.133@tcp) 00000020:01000000:3.0:1788843436.539940:0:9758:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788843436.539950:0:9758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788843436.539978:0:9758:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9bd0078bb370) 00000020:00000080:3.0:1788843436.540004:0:9758:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1788843436.540010:0:9758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788843436.540109:0:9758:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788843436.540116:0:9758:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788843436.540123:0:9758:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa762dfcbd58d0fcd 00010000:00080000:3.0:1788843436.540169:0:9758:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd0078e5000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.133@tcp at head 00010000:00010000:3.0:1788843436.540449:0:9758:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1788843436.540789:0:9758:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788843436.540803:0:9758:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788843436.540997:0:9758:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788843436.541118:0:9758:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788843436.541279:0:9758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788843436.541828:0:9758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1788843436.543748:0:9760:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788843436.543755:0:9760:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 40000000:02000000:0.0:1788843436.547132:0:6513:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000020:00000080:3.0:1788843436.552884:0:9758:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788843436.552900:0:9758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788843436.552949:0:9758:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788843436.552978:0:9758:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa762dfcbd58d0fd4 00000100:00080000:3.0:1788843436.552988:0:9758:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788843436.552995:0:9758:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bd0078e5000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:3.0:1788843436.553027:0:9758:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd10f985880 x1875738134362368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788843436.553066:0:9758:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788843436.553130:0:9758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843436.553135:0:9758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843436.553137:0:9758:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788843436.553164:0:9758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788843436.553176:0:9758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843436.553178:0:9758:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788843436.553182:0:9758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788843436.553184:0:9758:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788843436.553215:0:9758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f986d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:9758:1875738134362496:0@lo:502: 00000100:00100000:3.0:1788843436.553315:0:9758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843436.553380:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134362368:0@lo:8: 00000100:00100000:1.0:1788843436.553418:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843436.553477:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134362368 00000100:00100000:1.0:1788843436.553484:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134362368 00000100:00100000:1.0:1788843436.553515:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788843436.553522:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3629:x1875738134362368:12345-0@lo:8: 00010000:00080000:1.0:1788843436.553547:0:8424:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:1.0:1788843436.553587:0:8424:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa762dfcbd58d0fdb 00002000:00100000:1.0:1788843436.553600:0:8424:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9bd10f906800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788843436.553605:0:8424:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788843436.553608:0:8424:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788843436.553690:0:8424:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788843436.553720:0:8424:0:(import.c:65:import_set_state_nolock()) ffff9bd10f900800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843436.553771:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3629:x1875738134362368:12345-0@lo:8: Request processed in 247us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843436.553778:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788843436.553820:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f985880 x1875738134362368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788843446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843436.553831:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788843436.553839:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788843436.553848:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788843436.553853:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788843436.553855:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd0078e5000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788843436.553865:0:3629:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788843436.553870:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134362368:0@lo:8: 00000004:00080000:1.0:1788843436.553894:0:9760:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788843436.553963:0:9760:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 214606821457ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788843436.553970:0:9760:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1788843436.563236:0:6485:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1788843436.563996:0:9761:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788843436.564027:0:9761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059df100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9761:1875738134362752:0@lo:7: 00000100:00100000:2.0:1788843436.564105:0:9761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843436.564159:0:9761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0078939c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843436.564395:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134362624:0@lo:13: 00000100:00100000:1.0:1788843436.564426:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843436.564463:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134362624 00000100:00100000:1.0:1788843436.564469:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134362624 00000100:00100000:1.0:1788843436.564580:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788843436.564652:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1875738134362624:12345-0@lo:13: 00002000:00000024:1.0:1788843436.564682:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1788843436.564726:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1875738134362624:12345-0@lo:13: Request processed in 78us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843436.564733:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788843436.564753:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788843436.564790:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0059dce00 x1875738134362624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843436.564809:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134362624:0@lo:13: 00000100:00100000:3.0:1788843436.564907:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134362752 00000100:00100000:3.0:1788843436.564912:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134362752 00000100:00100000:3.0:1788843436.564938:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788843436.564944:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9761:x1875738134362752:12345-0@lo:7: 00000100:00100000:2.0:1788843436.566462:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134362496 00000100:00100000:2.0:1788843436.566473:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134362496 00000100:00100000:2.0:1788843436.566663:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788843436.566673:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:9758:x1875738134362496:12345-0@lo:502: 00000100:00100000:2.0:1788843436.566824:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:9758:x1875738134362496:12345-0@lo:502: Request processed in 153us (13509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843436.566831:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788843436.567706:0:9758:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1102c1000 going to sleep for 11 seconds 00000100:00100000:2.0:1788843436.567740:0:9758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f986d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:9758:1875738134362496:0@lo:502: 00000020:01000000:2.0:1788843436.567780:0:9758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843436.567788:0:9758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843436.567790:0:9758:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788843436.567795:0:9758:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1788843436.567882:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1788843436.567902:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788843436.567913:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d0fb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0fbf expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843436.567924:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d0fb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0fbf expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843436.567947:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788843436.567950:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9bd13339b370 from 1 10000000:01000000:2.0:1788843436.567953:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788843436.569245:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0fe2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843436.569258:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0fe2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843436.569267:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0fe2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843436.569286:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134362880:0@lo:101: 00000100:00100000:0.0:1788843436.570717:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8431:x1875738134360832:12345-0@lo:700: Request processed in 44455us (44576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843436.570731:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788843436.570793:0:8431:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00723e300 x1875738134360832/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788843452 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843436.570807:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8431:1875738134360832:0@lo:700: 40000000:02000000:0.0:1788843436.570819:0:8431:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:2.0:1788843436.580072:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843436.580158:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843436.580315:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134362880 00000100:00100000:2.0:1788843436.580325:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134362880 00000100:00100000:2.0:1788843436.580378:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788843436.580387:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:6503:x1875738134362880:12345-0@lo:101: 00010000:00010000:2.0:1788843436.580404:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843436.580425:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1153e7800/0xa762dfcbd58d0fe9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d0fe2 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843436.580455:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1153e7800/0xa762dfcbd58d0fe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d0fe2 expref: 24 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843436.580467:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1153e7800/0xa762dfcbd58d0fe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0fe2 expref: 24 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843436.580491:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e7800, rc 0) 00000100:00100000:2.0:1788843436.580578:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:6503:x1875738134362880:12345-0@lo:101: Request processed in 191us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843436.580732:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788843436.580794:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134362880:0@lo:101: 00010000:00010000:2.0:1788843436.580813:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0fe2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0fe9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843436.580823:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0fe2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0fe9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843436.580900:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134363008:0@lo:501: 00000100:00100000:2.0:1788843436.580939:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843436.581038:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843436.581052:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134363008 00000100:00100000:2.0:1788843436.581057:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134363008 00000100:00100000:2.0:1788843436.581083:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788843436.581089:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:6503:x1875738134363008:12345-0@lo:501: 00000100:00100000:2.0:1788843436.581185:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:6503:x1875738134363008:12345-0@lo:501: Request processed in 96us (245us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788843436.581193:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788843436.581221:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134363008:0@lo:501: 10000000:01000000:2.0:1788843436.581269:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788843436.581277:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0fe2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0fe9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843436.581310:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0fe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0fe9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788843436.591571:0:8423:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788843436.591583:0:8423:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788843436.591689:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9761:x1875738134362752:12345-0@lo:7: Request processed in 26740us (27579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843436.591699:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788843436.591779:0:9761:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0059df100 x1875738134362752/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788843452 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843436.591795:0:9761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059df100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9761:1875738134362752:0@lo:7: 00000004:00080000:3.0:1788843436.591810:0:9761:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788843436.591851:0:9761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f986d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9761:1875738134363136:0@lo:5: 00000100:00100000:3.0:1788843436.591883:0:9761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843436.591907:0:9761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10f9aea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788843436.591924:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134363136 00000100:00100000:3.0:1788843436.591930:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134363136 00000100:00100000:3.0:1788843436.591966:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788843436.591975:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9761:x1875738134363136:12345-0@lo:5: 00002000:00080000:3.0:1788843436.592000:0:8424:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788843436.592004:0:8424:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:1.0:1788843436.609811:0:9500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1788843436.609836:0:9500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788843436.609840:0:9500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788843436.610034:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9761:x1875738134363136:12345-0@lo:5: Request processed in 18055us (18144us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788843436.610046:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788843436.610183:0:9761:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f986d80 x1875738134363136/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788843452 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843436.610196:0:9761:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788843436.610202:0:9761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f986d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9761:1875738134363136:0@lo:5: 00000004:00080000:2.0:1788843436.610218:0:9761:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788843436.610266:0:9761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059de300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9761:1875738134363264:0@lo:700: 00000100:00100000:2.0:1788843436.610314:0:9761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843436.610347:0:9761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843436.610423:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 2 min 2 max 16 00000100:00100000:0.0:1788843436.610431:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_002' 00000100:00100000:1.0:1788843436.610775:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134363264 00000100:00100000:1.0:1788843436.610783:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134363264 00000100:00100000:0.0:1788843436.610922:0:9766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788843436.610933:0:9766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9761:x1875738134363264:12345-0@lo:700: 00000100:00100000:2.0:1788843436.618440:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f984000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9756:x1875738134360192:12345-0@lo:700: Request processed in 92505us (96471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843436.618453:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788843436.620062:0:9756:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f984380 x1875738134360192/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788843452 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843436.620081:0:9756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f984380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9756:1875738134360192:0@lo:700: 00000004:00080000:1.0:1788843436.650875:0:9756:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788843436.650907:0:9756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9756:1875738134363520:0@lo:7: 00000100:00100000:1.0:1788843436.650951:0:9756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843436.651014:0:9756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd118d47c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788843436.651033:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134363520 00000100:00100000:1.0:1788843436.651039:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134363520 00000100:00100000:1.0:1788843436.651085:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788843436.651094:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9756:x1875738134363520:12345-0@lo:7: 00000100:00100000:0.0:1788843436.654382:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134363392:0@lo:13: 00000100:00100000:0.0:1788843436.654463:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843436.654609:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134363392 00000100:00100000:0.0:1788843436.654617:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134363392 00000100:00100000:0.0:1788843436.654663:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788843436.654671:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3630:x1875738134363392:12345-0@lo:13: 00002000:00000024:0.0:1788843436.654694:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1788843436.654737:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3630:x1875738134363392:12345-0@lo:13: Request processed in 66us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843436.654745:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788843436.654786:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00723dc00 x1875738134363392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843436.654806:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134363392:0@lo:13: 00000100:00100000:3.0:1788843436.656387:0:9766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9761:x1875738134363264:12345-0@lo:700: Request processed in 45449us (46066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843436.656400:0:9766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788843436.656890:0:9761:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0059de300 x1875738134363264/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788843452 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843436.656905:0:9761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059de300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9761:1875738134363264:0@lo:700: 00002000:00080000:1.0:1788843436.657795:0:8901:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788843436.657805:0:8901:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788843436.658400:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9756:x1875738134363520:12345-0@lo:7: Request processed in 7303us (7445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843436.658411:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788843436.658523:0:9756:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00723f100 x1875738134363520/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788843452 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843436.658536:0:9756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9756:1875738134363520:0@lo:7: 00000004:00080000:3.0:1788843436.658546:0:9756:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788843436.658581:0:9756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f984380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9756:1875738134363648:0@lo:5: 00000100:00100000:3.0:1788843436.658618:0:9756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843436.658650:0:9756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10f9ae840 going to sleep for 11 seconds 00000100:00100000:2.0:1788843436.658696:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134363648 00000100:00100000:2.0:1788843436.658703:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134363648 00000100:00100000:2.0:1788843436.658778:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788843436.658788:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f986d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9756:x1875738134363648:12345-0@lo:5: 00002000:00080000:2.0:1788843436.658815:0:8421:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1788843436.658854:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f986d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9756:x1875738134363648:12345-0@lo:5: Request processed in 68us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843436.658871:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788843436.659212:0:9756:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f984380 x1875738134363648/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788843452 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843436.659223:0:9756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f984380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9756:1875738134363648:0@lo:5: 00000004:00080000:0.0:1788843436.659231:0:9756:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788843436.659257:0:9756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe23800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9756:1875738134363776:0@lo:5: 00000100:00100000:0.0:1788843436.659282:0:9756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843436.659535:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134363776 00000100:00100000:3.0:1788843436.659540:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134363776 00000100:00100000:3.0:1788843436.659568:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788843436.659575:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9756:x1875738134363776:12345-0@lo:5: 00002000:00080000:3.0:1788843436.659602:0:8424:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:3.0:1788843436.661234:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:9756:x1875738134363776:12345-0@lo:5: Request processed in 1655us (1947us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788843436.661245:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788843436.661861:0:9756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00747c9c0 going to sleep for 11 seconds 00010000:00080000:0.0:1788843436.661895:0:9756:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fe23800 x1875738134363776/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788843452 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843436.661911:0:9756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe23800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9756:1875738134363776:0@lo:5: 00000004:00080000:0.0:1788843436.661926:0:9756:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788843436.661977:0:9756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe20000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9756:1875738134363904:0@lo:900: 00000100:00100000:0.0:1788843436.662017:0:9756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843436.662056:0:9756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00747c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843436.662247:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134363904 00000100:00100000:3.0:1788843436.662254:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134363904 00000100:00100000:3.0:1788843436.662307:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788843436.662316:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9756:x1875738134363904:12345-0@lo:900: 00000100:00100000:3.0:1788843436.662366:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9756:x1875738134363904:12345-0@lo:900: Request processed in 51us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843436.662378:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788843436.662731:0:9756:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fe20000 x1875738134363904/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788843452 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843436.662742:0:9756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe20000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9756:1875738134363904:0@lo:900: 00000004:02000040:0.0:1788843436.663051:0:9761:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:1.0:1788843436.672822:0:9761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9761:1875738134364032:0@lo:5: 00000100:00100000:1.0:1788843436.672909:0:9761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843436.672955:0:9761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd118d47d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788843436.673302:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134364032 00000100:00100000:0.0:1788843436.673310:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134364032 00000100:00100000:0.0:1788843436.674214:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788843436.674227:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9761:x1875738134364032:12345-0@lo:5: 00002000:00080000:2.0:1788843436.685114:0:8424:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788843436.685135:0:8424:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:2.0:1788843436.689091:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9761:x1875738134364032:12345-0@lo:5: Request processed in 14861us (16174us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788843436.689227:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788843436.689545:0:9761:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00723f800 x1875738134364032/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788843452 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843436.689564:0:9761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9761:1875738134364032:0@lo:5: 00000004:00080000:1.0:1788843436.689588:0:9761:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000100:00100000:1.0:1788843436.955761:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134364160:0@lo:13: 00000100:00100000:1.0:1788843436.955831:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843436.955907:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134364160 00000100:00100000:1.0:1788843436.955915:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134364160 00000100:00100000:1.0:1788843436.955971:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788843436.955982:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134364160:12345-0@lo:13: 00002000:00000024:1.0:1788843436.956004:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788843436.956049:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134364160:12345-0@lo:13: Request processed in 68us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843436.956056:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788843436.956099:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00723d880 x1875738134364160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843436.956117:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134364160:0@lo:13: 00010000:00010000:1.0:1788843437.211128:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843437.978553:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134364288:0@lo:41: 00000100:00100000:2.0:1788843437.978627:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843437.978786:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134364288 00000100:00100000:2.0:1788843437.978793:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134364288 00000100:00100000:2.0:1788843437.978839:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788843437.978847:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134364288:12345-0@lo:41: 00000004:00000024:2.0:1788843437.978882:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788843437.978926:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134364288:12345-0@lo:41: Request processed in 79us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843437.978934:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788843437.979049:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134364288:0@lo:41: 00000100:00100000:3.0:1788843437.979313:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f984380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134364416:0@lo:41: 00000100:00100000:3.0:1788843437.979366:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843437.979405:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134364416 00000100:00100000:3.0:1788843437.979410:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134364416 00000100:00100000:3.0:1788843437.979436:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788843437.979443:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134364416:12345-0@lo:41: 00000004:00000024:3.0:1788843437.979463:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788843437.979499:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134364416:12345-0@lo:41: Request processed in 55us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843437.979506:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788843437.979535:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f984380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134364416:0@lo:41: 00010000:00010000:2.0:1788843438.235960:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788843438.936346:0:9873:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg333-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788843439.261865:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788843439.905177:0:9925:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788843439.905422:0:9925:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788843440.283313:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788843441.114187:0:9500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:1.0:1788843441.114213:0:9500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1788843441.306611:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843441.562489:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788843441.562523:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134364544:0@lo:13: 00000100:00100000:0.0:1788843441.562616:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843441.562724:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134364544 00000100:00100000:2.0:1788843441.562735:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134364544 00000100:00100000:2.0:1788843441.562812:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788843441.562822:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788843441.562825:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134364544:12345-0@lo:13: 00002000:00000024:2.0:1788843441.562863:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788843441.562931:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134364544:12345-0@lo:13: Request processed in 107us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843441.562958:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788843441.562986:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007934380 x1875738134364544/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843441.563020:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134364544:0@lo:13: 00000100:00100000:3.0:1788843441.563297:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134364800:0@lo:400: 00000100:00100000:3.0:1788843441.563332:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843441.563359:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134365312:0@lo:400: 00000100:00100000:2.0:1788843441.563374:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134364928:0@lo:400: 00000100:00100000:3.0:1788843441.563379:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843441.563394:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1875738134365824:0@lo:400: 00000100:00100000:2.0:1788843441.563404:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843441.563409:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843441.563422:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1875738134365440:0@lo:400: 00000100:00100000:3.0:1788843441.563436:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134364800 00000100:00100000:3.0:1788843441.563440:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134364800 00000100:00100000:2.0:1788843441.563445:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843441.563458:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134365952:0@lo:400: 00000100:00100000:3.0:1788843441.563464:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134365312 00000100:00100000:3.0:1788843441.563474:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134365312 00000100:00100000:2.0:1788843441.563479:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843441.563496:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134365824 00000100:00100000:3.0:1788843441.563499:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134365824 00000100:00100000:3.0:1788843441.563512:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134365440 00000100:00100000:2.0:1788843441.563512:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134364928 00000100:00100000:3.0:1788843441.563514:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134365440 00000100:00100000:2.0:1788843441.563515:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134364928 00000100:00100000:3.0:1788843441.563527:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788843441.563533:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134364800:12345-0@lo:400: 00000100:00100000:2.0:1788843441.563538:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788843441.563544:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134364928:12345-0@lo:400: 00000100:00100000:3.0:1788843441.563572:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134364800:12345-0@lo:400: Request processed in 38us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843441.563578:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788843441.563593:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788843441.563599:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134365312:12345-0@lo:400: 00000100:00100000:3.0:1788843441.563624:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134365312:12345-0@lo:400: Request processed in 26us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843441.563630:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788843441.563640:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788843441.563646:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1875738134365824:12345-0@lo:400: 00000100:00100000:3.0:1788843441.563684:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1875738134365824:12345-0@lo:400: Request processed in 27us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843441.563691:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788843441.563704:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788843441.563710:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875738134365440:12345-0@lo:400: 00000100:00100000:1.0:1788843441.563767:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134365056:0@lo:400: 00000100:00100000:1.0:1788843441.563798:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843441.563814:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134365568:0@lo:400: 00000100:00100000:1.0:1788843441.563836:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843441.563849:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134366080:0@lo:400: 00000100:00100000:1.0:1788843441.563868:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843441.563896:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788843441.563902:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134364672:0@lo:400: 00000100:00100000:1.0:1788843441.563929:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843441.563950:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134365184:0@lo:400: 00000100:00100000:1.0:1788843441.563972:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843441.563987:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1875738134365696:0@lo:400: 00000100:00100000:1.0:1788843441.564008:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843441.564174:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134364928:12345-0@lo:400: Request processed in 629us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843441.564182:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788843441.564195:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134365184 00000100:00100000:2.0:1788843441.564199:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134365184 00000100:00100000:2.0:1788843441.564215:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788843441.564221:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134365184:12345-0@lo:400: 00000100:00100000:2.0:1788843441.564252:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134365184:12345-0@lo:400: Request processed in 31us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843441.564271:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788843441.564292:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134365952 00000100:00100000:2.0:1788843441.564295:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134365952 00000100:00100000:2.0:1788843441.564319:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134365568 00000100:00100000:2.0:1788843441.564322:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134365568 00000100:00100000:2.0:1788843441.564334:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134366080 00000100:00100000:2.0:1788843441.564336:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134366080 00000100:00100000:2.0:1788843441.564360:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788843441.564366:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134365952:12345-0@lo:400: 00000100:00100000:1.0:1788843441.564444:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134365184:0@lo:400: 00000100:00100000:1.0:1788843441.564471:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788843441.564478:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134365568:12345-0@lo:400: 00000100:00100000:1.0:1788843441.564513:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134365568:12345-0@lo:400: Request processed in 36us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843441.564519:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788843441.564532:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788843441.564538:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134366080:12345-0@lo:400: 00000100:00100000:1.0:1788843441.564578:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134366080:12345-0@lo:400: Request processed in 40us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843441.564583:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788843441.564616:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd13e878700 x1875738134365568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843441.564627:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134365568:0@lo:400: 00010000:00080000:1.0:1788843441.564637:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fe0f480 x1875738134366080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843441.564645:0:3630:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1788843441.564658:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134366080:0@lo:400: 00000100:00100000:1.0:1788843441.564706:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134364672 00000100:00100000:1.0:1788843441.564710:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134364672 00000100:00100000:1.0:1788843441.564742:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788843441.564749:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3630:x1875738134364672:12345-0@lo:400: 00000100:00100000:1.0:1788843441.564786:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3630:x1875738134364672:12345-0@lo:400: Request processed in 38us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843441.564792:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788843441.564897:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134365056 00000100:00100000:0.0:1788843441.564901:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134365056 00000100:00100000:0.0:1788843441.564920:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134365696 00000100:00100000:0.0:1788843441.564922:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134365696 00000100:00100000:0.0:1788843441.564937:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788843441.564943:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134365056:12345-0@lo:400: 00000100:00100000:0.0:1788843441.564978:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134365056:12345-0@lo:400: Request processed in 35us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843441.564984:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788843441.564994:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788843441.565000:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875738134365696:12345-0@lo:400: 00000100:00100000:0.0:1788843441.565322:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875738134365696:12345-0@lo:400: Request processed in 321us (1312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843441.565339:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788843441.565401:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134364672:0@lo:400: 00010000:00080000:0.0:1788843441.565415:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fe0e300 x1875738134365696/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843441.565424:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1875738134365696:0@lo:400: 00010000:00080000:0.0:1788843441.565433:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0059ddf80 x1875738134365056/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843441.565442:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134365056:0@lo:400: 00000100:00080000:0.0:1788843441.565488:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788843441.565493:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788843441.565496:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788843441.565499:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788843441.565522:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0059df800 x1875738134365312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843441.565531:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134365312:0@lo:400: 00010000:00080000:0.0:1788843441.565543:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fe0dc00 x1875738134365824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843441.565566:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1875738134365824:0@lo:400: 00010000:00080000:0.0:1788843441.565580:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0059df100 x1875738134364800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843441.565588:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134364800:0@lo:400: 00000100:00100000:3.0:1788843441.570244:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875738134365440:12345-0@lo:400: Request processed in 6518us (6782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843441.570272:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788843441.571825:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134365952:12345-0@lo:400: Request processed in 7444us (8329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843441.571843:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788843441.572848:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134364928:0@lo:400: 00010000:00080000:1.0:1788843441.572885:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0059dca80 x1875738134365440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843441.572897:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1875738134365440:0@lo:400: 00010000:00080000:1.0:1788843441.572912:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fe0c000 x1875738134365952/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843441.572920:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788843441.572942:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134365952:0@lo:400: 00000100:00100000:1.0:1788843442.074369:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788843442.074377:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843442.074408:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134366336:0@lo:13: 00000100:00100000:0.0:1788843442.074409:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134366208:0@lo:13: 00000100:00100000:0.0:1788843442.074553:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843442.074722:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788843442.074745:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134366464:0@lo:13: 00000100:00100000:2.0:1788843442.074788:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843442.074889:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134366208 00000100:00100000:0.0:1788843442.074898:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134366208 00000100:00100000:0.0:1788843442.074936:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134366464 00000100:00100000:0.0:1788843442.074940:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134366464 00000100:00100000:0.0:1788843442.074956:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788843442.074964:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134366208:12345-0@lo:13: 00002000:00000024:0.0:1788843442.074993:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843442.075116:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134366208:12345-0@lo:13: Request processed in 151us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843442.075123:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788843442.075164:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788843442.075172:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134366464:12345-0@lo:13: 00002000:00000024:0.0:1788843442.075182:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843442.075215:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134366464:12345-0@lo:13: Request processed in 44us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843442.075221:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788843442.075575:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fe21c00 x1875738134366208/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843442.075593:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134366208:0@lo:13: 00010000:00080000:2.0:1788843442.075627:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fe0fb80 x1875738134366464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843442.075640:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134366464:0@lo:13: 00000100:00100000:1.0:1788843442.080857:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843442.083287:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134366336 00000100:00100000:0.0:1788843442.083311:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134366336 00000100:00100000:0.0:1788843442.083414:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788843442.083426:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134366336:12345-0@lo:13: 00002000:00000024:0.0:1788843442.083461:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843442.083583:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134366336:12345-0@lo:13: Request processed in 159us (2857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843442.083591:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788843442.084197:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00723f800 x1875738134366336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843442.084226:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134366336:0@lo:13: 00010000:00010000:1.0:1788843442.330363:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843443.099024:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788843443.099056:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134366592:0@lo:41: 00000100:00100000:0.0:1788843443.099177:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843443.099268:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134366592 00000100:00100000:0.0:1788843443.099277:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134366592 00000100:00100000:0.0:1788843443.099340:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788843443.099351:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134366592:12345-0@lo:41: 00000004:00000024:0.0:1788843443.099393:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788843443.099450:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134366592:12345-0@lo:41: Request processed in 100us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843443.099458:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788843443.099517:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134366592:0@lo:41: 00000100:00100000:0.0:1788843443.101983:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788843443.102016:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134366720:0@lo:41: 00000100:00100000:0.0:1788843443.102103:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843443.102185:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134366720 00000100:00100000:0.0:1788843443.102194:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134366720 00000100:00100000:0.0:1788843443.102246:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788843443.102269:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134366720:12345-0@lo:41: 00000004:00000024:0.0:1788843443.102311:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788843443.102364:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134366720:12345-0@lo:41: Request processed in 96us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843443.102371:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788843443.102427:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134366720:0@lo:41: 00000020:00000004:0.0:1788843443.182202:0:10027:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788843443.182472:0:10027:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788843443.355103:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843444.391293:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788843444.433378:0:10075:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788843444.433391:0:10075:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:2.0:1788843445.054814:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843445.055205:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116489344 00000100:00100000:0.0:1788843445.055218:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116489344 00000100:00100000:0.0:1788843445.055306:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 181 00000100:00100000:0.0:1788843445.055315:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2386:x1875738116489344:12345-192.168.203.33@tcp:250: 00010000:00080000:0.0:1788843445.055355:0:6500:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 7928f422-fe0e-4906-b099-11067616e1bb@192.168.203.33@tcp t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:0.0:1788843445.055390:0:6500:0:(genops.c:1385:class_connect()) connect: client 7928f422-fe0e-4906-b099-11067616e1bb, cookie 0xa762dfcbd58d0ff0 00000100:00080000:0.0:1788843445.055547:0:6500:0:(import.c:65:import_set_state_nolock()) ffff9bd0075ec800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788843445.055642:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+5:2386:x1875738116489344:12345-192.168.203.33@tcp:250: Request processed in 325us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843445.055651:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 181 00000100:00100000:3.0:1788843445.059350:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843445.059479:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116489472 00000100:00100000:0.0:1788843445.059493:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116489472 00000100:00100000:0.0:1788843445.059569:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 182 00000100:00100000:0.0:1788843445.059590:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+5:6150:x1875738116489472:12345-192.168.203.33@tcp:101: 00010000:00010000:0.0:1788843445.059613:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843445.059636:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d0ff7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490759 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843445.059673:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d0ff7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490759 expref: 6 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843445.059687:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d0ff7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490759 expref: 6 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843445.059697:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1420e5200, rc 0) 00000100:00100000:0.0:1788843445.059786:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+6:6150:x1875738116489472:12345-192.168.203.33@tcp:101: Request processed in 207us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843445.059795:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 182 00000100:00100000:2.0:1788843445.065572:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843445.065764:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116489600 00000100:00100000:1.0:1788843445.065795:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116489600 00000100:00100000:1.0:1788843445.065874:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 183 00000100:00100000:1.0:1788843445.065886:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+6:6150:x1875738116489600:12345-192.168.203.33@tcp:501: 00000100:00100000:1.0:1788843445.066056:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+6:6150:x1875738116489600:12345-192.168.203.33@tcp:501: Request processed in 172us (499us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788843445.066065:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 183 00000100:00100000:3.0:1788843445.076882:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843445.077045:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116489728 00000100:00100000:2.0:1788843445.077059:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116489728 00000100:00100000:2.0:1788843445.077134:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 184 00000100:00100000:2.0:1788843445.077197:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+6:6150:x1875738116489728:12345-192.168.203.33@tcp:101: 00010000:00010000:2.0:1788843445.077221:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843445.077253:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1153e6800/0xa762dfcbd58d0ffe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490760 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843445.077290:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1153e6800/0xa762dfcbd58d0ffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490760 expref: 7 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843445.077312:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1153e6800/0xa762dfcbd58d0ffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490760 expref: 7 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843445.077323:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e6800, rc 0) 00000100:00100000:2.0:1788843445.077394:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+7:6150:x1875738116489728:12345-192.168.203.33@tcp:101: Request processed in 250us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843445.077401:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 184 00000100:00100000:3.0:1788843445.086637:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843445.087083:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116489856 00000100:00100000:0.0:1788843445.087114:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116489856 00000100:00100000:0.0:1788843445.087231:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 185 00000100:00100000:0.0:1788843445.087253:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+7:6150:x1875738116489856:12345-192.168.203.33@tcp:501: 00000100:00100000:0.0:1788843445.087504:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+8:6150:x1875738116489856:12345-192.168.203.33@tcp:501: Request processed in 252us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843445.087513:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 185 00000100:00100000:0.0:1788843445.096867:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843445.097610:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116489984 00000100:00100000:1.0:1788843445.097967:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116489984 00000100:00100000:1.0:1788843445.098111:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 186 00000100:00100000:1.0:1788843445.098124:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+8:6150:x1875738116489984:12345-192.168.203.33@tcp:503: 00000100:00100000:1.0:1788843445.098405:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+8:6150:x1875738116489984:12345-192.168.203.33@tcp:503: Request processed in 281us (1562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843445.098414:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 186 00000100:00100000:0.0:1788843445.106378:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843445.106493:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116490112 00000100:00100000:2.0:1788843445.106507:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116490112 00000100:00100000:2.0:1788843445.106584:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 187 00000100:00100000:2.0:1788843445.106596:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+8:6168:x1875738116490112:12345-192.168.203.33@tcp:502: 00000100:00100000:2.0:1788843445.106810:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+8:6168:x1875738116490112:12345-192.168.203.33@tcp:502: Request processed in 215us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843445.106821:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 187 00000100:00100000:0.0:1788843445.150420:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843445.150580:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116490240 00000100:00100000:1.0:1788843445.150593:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116490240 00000100:00100000:1.0:1788843445.150735:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 188 00000100:00100000:1.0:1788843445.150750:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1153f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+8:6168:x1875738116490240:12345-192.168.203.33@tcp:502: 00000100:00100000:1.0:1788843445.150946:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1153f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+8:6168:x1875738116490240:12345-192.168.203.33@tcp:502: Request processed in 199us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843445.150955:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 188 00000100:00100000:3.0:1788843445.158867:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843445.159304:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116490368 00000100:00100000:0.0:1788843445.159318:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116490368 00000100:00100000:0.0:1788843445.159394:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 189 00000100:00100000:0.0:1788843445.159406:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1032f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+8:6150:x1875738116490368:12345-192.168.203.33@tcp:101: 00010000:00010000:0.0:1788843445.159429:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843445.159450:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1420e4800/0xa762dfcbd58d1005 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490791 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843445.159485:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1420e4800/0xa762dfcbd58d1005 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490791 expref: 9 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843445.159497:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1420e4800/0xa762dfcbd58d1005 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490791 expref: 9 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843445.159507:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1420e4800, rc 0) 00000100:00100000:0.0:1788843445.161351:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1032f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+9:6150:x1875738116490368:12345-192.168.203.33@tcp:101: Request processed in 1930us (2482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843445.161365:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 189 00000100:00100000:0.0:1788843445.168975:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843445.169254:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116490496 00000100:00100000:2.0:1788843445.169268:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116490496 00000100:00100000:2.0:1788843445.169401:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 190 00000100:00100000:2.0:1788843445.169415:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1032f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+9:6150:x1875738116490496:12345-192.168.203.33@tcp:256: 20000000:01000000:2.0:1788843445.169450:0:6500:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788843445.169472:0:6500:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788843445.169477:0:6500:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788843445.169481:0:6500:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788843445.169484:0:6500:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788843445.169487:0:6500:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1788843445.176603:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1032f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+9:6150:x1875738116490496:12345-192.168.203.33@tcp:256: Request processed in 7174us (7628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843445.176622:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 190 00000100:00100000:3.0:1788843445.184194:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843445.184315:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116490624 00000100:00100000:0.0:1788843445.184329:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116490624 00000100:00100000:0.0:1788843445.184404:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 191 00000100:00100000:0.0:1788843445.184418:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1032f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+9:6150:x1875738116490624:12345-192.168.203.33@tcp:101: 00010000:00010000:0.0:1788843445.184441:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843445.184503:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd10fa3cc00/0xa762dfcbd58d100c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490798 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843445.184545:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd10fa3cc00/0xa762dfcbd58d100c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490798 expref: 10 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843445.184559:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd10fa3cc00/0xa762dfcbd58d100c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490798 expref: 10 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843445.184568:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3cc00, rc 0) 00000100:00100000:0.0:1788843445.184648:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1032f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+10:6150:x1875738116490624:12345-192.168.203.33@tcp:101: Request processed in 233us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843445.184655:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 191 00000100:00100000:2.0:1788843445.194002:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843445.194269:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116490752 00000100:00100000:0.0:1788843445.194283:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116490752 00000100:00100000:0.0:1788843445.194356:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 192 00000100:00100000:0.0:1788843445.194368:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+10:6150:x1875738116490752:12345-192.168.203.33@tcp:501: 00000100:00100000:0.0:1788843445.194567:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+10:6150:x1875738116490752:12345-192.168.203.33@tcp:501: Request processed in 200us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843445.194576:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 192 00000100:00100000:2.0:1788843445.198002:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843445.200121:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116490880 00000100:00100000:1.0:1788843445.200154:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116490880 00000100:00100000:1.0:1788843445.200250:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 193 00000100:00100000:1.0:1788843445.200262:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+10:6150:x1875738116490880:12345-192.168.203.33@tcp:503: 00000100:00100000:1.0:1788843445.202493:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+10:6150:x1875738116490880:12345-192.168.203.33@tcp:503: Request processed in 2215us (4488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843445.202535:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 193 00000100:00100000:2.0:1788843445.212557:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843445.212677:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116491008 00000100:00100000:0.0:1788843445.212691:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116491008 00000100:00100000:0.0:1788843445.212771:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 194 00000100:00100000:0.0:1788843445.212783:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+10:6173:x1875738116491008:12345-192.168.203.33@tcp:502: 00000100:00100000:0.0:1788843445.212999:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+10:6173:x1875738116491008:12345-192.168.203.33@tcp:502: Request processed in 218us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843445.213008:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 194 00000100:00100000:0.0:1788843445.215207:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843445.215322:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116491136 00000100:00100000:1.0:1788843445.215333:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116491136 00000100:00100000:1.0:1788843445.215423:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 195 00000100:00100000:1.0:1788843445.215435:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+10:6173:x1875738116491136:12345-192.168.203.33@tcp:502: 00000100:00100000:1.0:1788843445.215599:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+10:6173:x1875738116491136:12345-192.168.203.33@tcp:502: Request processed in 165us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843445.215608:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 195 00000100:00100000:2.0:1788843445.218837:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843445.218889:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843445.218995:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116491264 00000100:00100000:3.0:1788843445.219007:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116491264 00000100:00100000:3.0:1788843445.219054:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116491520 00000100:00100000:3.0:1788843445.219057:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116491520 00000100:00100000:3.0:1788843445.219079:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7 00000100:00100000:3.0:1788843445.219089:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2386:x1875738116491264:12345-192.168.203.33@tcp:38: 00010000:00080000:3.0:1788843445.219126:0:6508:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f25f61b6-5faf-4e05-81a4-dea3dba05dc5@192.168.203.33@tcp t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:3.0:1788843445.219218:0:6508:0:(genops.c:1385:class_connect()) connect: client f25f61b6-5faf-4e05-81a4-dea3dba05dc5, cookie 0xa762dfcbd58d1013 00000004:00100000:3.0:1788843445.219259:0:6508:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788843445.219514:0:6508:0:(import.c:65:import_set_state_nolock()) ffff9bd10f938000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788843445.219596:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2386:x1875738116491264:12345-192.168.203.33@tcp:38: Request processed in 506us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843445.219606:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7 00000100:00100000:3.0:1788843445.219627:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 8 00000100:00100000:3.0:1788843445.219632:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2386:x1875738116491520:12345-192.168.203.33@tcp:38: 00010000:00080000:3.0:1788843445.219649:0:6508:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from f25f61b6-5faf-4e05-81a4-dea3dba05dc5@192.168.203.33@tcp t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:3.0:1788843445.219681:0:6508:0:(genops.c:1385:class_connect()) connect: client f25f61b6-5faf-4e05-81a4-dea3dba05dc5, cookie 0xa762dfcbd58d101a 00000004:00100000:3.0:1788843445.219695:0:6508:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788843445.219843:0:6508:0:(import.c:65:import_set_state_nolock()) ffff9bd10f93b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788843445.219867:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2386:x1875738116491520:12345-192.168.203.33@tcp:38: Request processed in 234us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843445.219874:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 8 00010000:00010000:0.0:1788843445.405079:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843446.246718:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843446.246774:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843446.246870:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843446.246918:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116491648 00000100:00100000:0.0:1788843446.246936:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116491648 00000100:00100000:0.0:1788843446.247043:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116491392 00000100:00100000:0.0:1788843446.247047:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116491392 00000100:00100000:0.0:1788843446.247063:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116491776 00000100:00100000:0.0:1788843446.247066:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116491776 00000100:00100000:0.0:1788843446.247086:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 9 00000100:00100000:0.0:1788843446.247097:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:0:x1875738116491648:12345-192.168.203.33@tcp:41: 00000004:00000024:0.0:1788843446.247182:0:9517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788843446.247304:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:0:x1875738116491648:12345-192.168.203.33@tcp:41: Request processed in 207us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843446.247312:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 9 00000100:00100000:0.0:1788843446.247333:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 10 00000100:00100000:0.0:1788843446.247341:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:0:x1875738116491392:12345-192.168.203.33@tcp:41: 00000004:00000024:0.0:1788843446.247359:0:9517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788843446.247384:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:0:x1875738116491392:12345-192.168.203.33@tcp:41: Request processed in 45us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843446.247391:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 10 00000100:00100000:0.0:1788843446.247422:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 11 00000100:00100000:0.0:1788843446.247429:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:6150:x1875738116491776:12345-192.168.203.33@tcp:41: 00000004:00000024:0.0:1788843446.247442:0:9517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788843446.247466:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:6150:x1875738116491776:12345-192.168.203.33@tcp:41: Request processed in 38us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843446.247474:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 11 00000100:00080000:2.0:1788843446.248778:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788843446.248787:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788843446.250318:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843446.252002:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116491904 00000100:00100000:0.0:1788843446.252020:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116491904 00000100:00100000:0.0:1788843446.252117:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 12 00000100:00100000:0.0:1788843446.252131:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:6150:x1875738116491904:12345-192.168.203.33@tcp:40: 00000100:00100000:0.0:1788843446.252440:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:6150:x1875738116491904:12345-192.168.203.33@tcp:40: Request processed in 310us (2132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843446.252449:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 12 00000100:00100000:0.0:1788843446.255550:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843446.255620:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843446.255711:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116492288 00000100:00100000:3.0:1788843446.255723:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116492288 00000100:00100000:3.0:1788843446.255794:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 4 00000100:00100000:3.0:1788843446.255806:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:6150:x1875738116492288:12345-192.168.203.33@tcp:900: 00000100:00100000:3.0:1788843446.255915:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:6150:x1875738116492288:12345-192.168.203.33@tcp:900: Request processed in 110us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843446.255924:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 4 00000100:00100000:2.0:1788843446.257222:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116492416 00000100:00100000:2.0:1788843446.257245:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116492416 00000100:00100000:2.0:1788843446.257309:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 196 00000100:00100000:2.0:1788843446.257318:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e092050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+10:2388:x1875738116492416:12345-192.168.203.33@tcp:400: 00000100:00100000:2.0:1788843446.257390:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e092050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+10:2388:x1875738116492416:12345-192.168.203.33@tcp:400: Request processed in 73us (1769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843446.257398:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 196 00000100:00100000:0.0:1788843446.262320:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843446.262469:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843446.264389:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843446.264509:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116492544 00000100:00100000:3.0:1788843446.264522:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116492544 00000100:00100000:3.0:1788843446.264589:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 0 00000100:00100000:3.0:1788843446.264601:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:6150:x1875738116492544:12345-192.168.203.33@tcp:33: 00000100:00100000:1.0:1788843446.274853:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116492032 00000100:00100000:1.0:1788843446.274877:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116492032 00000100:00100000:1.0:1788843446.274982:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116492160 00000100:00100000:1.0:1788843446.274987:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116492160 00000100:00100000:1.0:1788843446.275292:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 16 00000100:00100000:1.0:1788843446.275303:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2386:x1875738116492032:12345-192.168.203.33@tcp:8: 00010000:00080000:1.0:1788843446.275347:0:8423:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f25f61b6-5faf-4e05-81a4-dea3dba05dc5@192.168.203.33@tcp t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:1.0:1788843446.275428:0:8423:0:(genops.c:1385:class_connect()) connect: client f25f61b6-5faf-4e05-81a4-dea3dba05dc5, cookie 0xa762dfcbd58d1021 00002000:00100000:1.0:1788843446.275444:0:8423:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f25f61b6-5faf-4e05-81a4-dea3dba05dc5/ffff9bd0059c4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788843446.275467:0:8423:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788843446.275707:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 17 00000100:00100000:3.0:1788843446.275721:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2386:x1875738116492160:12345-192.168.203.33@tcp:8: 00010000:00080000:3.0:1788843446.275763:0:8424:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f25f61b6-5faf-4e05-81a4-dea3dba05dc5@192.168.203.33@tcp t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:3.0:1788843446.275799:0:8424:0:(genops.c:1385:class_connect()) connect: client f25f61b6-5faf-4e05-81a4-dea3dba05dc5, cookie 0xa762dfcbd58d1028 00002000:00100000:3.0:1788843446.275812:0:8424:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f25f61b6-5faf-4e05-81a4-dea3dba05dc5/ffff9bd141b0c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788843446.275830:0:8424:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788843446.276090:0:8424:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788843446.276127:0:8424:0:(import.c:65:import_set_state_nolock()) ffff9bd141b0b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788843446.276256:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2386:x1875738116492160:12345-192.168.203.33@tcp:8: Request processed in 536us (13786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843446.276264:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 17 00002000:00080000:1.0:1788843446.277417:0:8423:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788843446.277460:0:8423:0:(import.c:65:import_set_state_nolock()) ffff9bd0059c1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843446.277520:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2386:x1875738116492032:12345-192.168.203.33@tcp:8: Request processed in 2217us (15213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843446.277530:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 16 00000004:00080000:3.0:1788843446.331318:0:6509:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 63512us 00000004:00200000:3.0:1788843446.361888:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788843446.362015:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:6150:x1875738116492544:12345-192.168.203.33@tcp:33: Request processed in 97410us (97633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843446.362035:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 0 00010000:00010000:2.0:1788843446.426578:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843446.688677:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134366976:0@lo:400: 00000100:00100000:2.0:1788843446.688781:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843446.688915:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134366976 00000100:00100000:1.0:1788843446.688931:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134366976 00000100:00100000:1.0:1788843446.689032:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788843446.689217:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3632:x1875738134366976:12345-0@lo:400: 00000100:00100000:3.0:1788843446.690547:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788843446.690581:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134366848:0@lo:13: 00000100:00100000:3.0:1788843446.690653:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843446.694686:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3632:x1875738134366976:12345-0@lo:400: Request processed in 5458us (5889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843446.694705:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788843446.700003:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134367104:0@lo:400: 00000100:00100000:2.0:1788843446.700321:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134366976:0@lo:400: 00000100:00100000:1.0:1788843446.701043:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843446.701254:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134366848 00000100:00100000:1.0:1788843446.701262:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134366848 00000100:00100000:1.0:1788843446.701325:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788843446.701335:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007937b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134366848:12345-0@lo:13: 00002000:00000024:1.0:1788843446.701358:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788843446.701410:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007937b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134366848:12345-0@lo:13: Request processed in 77us (10757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843446.701417:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788843446.701440:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843446.704599:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134367104 00000100:00100000:3.0:1788843446.704627:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134367104 00000100:00100000:3.0:1788843446.704842:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788843446.704854:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134367104:12345-0@lo:400: 00000100:00100000:3.0:1788843446.704972:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134367104:12345-0@lo:400: Request processed in 121us (3930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843446.704979:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1788843446.705072:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fa2ce00 x1875738134367104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843446.705089:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134367104:0@lo:400: 00010000:00080000:3.0:1788843446.705385:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007934000 x1875738134366848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843446.705404:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134366848:0@lo:13: 00000100:00100000:0.0:1788843446.708550:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134367616:0@lo:400: 00000100:00100000:3.0:1788843446.708821:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134367488:0@lo:400: 00000100:00100000:3.0:1788843446.708923:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843446.709032:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1875738134368000:0@lo:400: 00000100:00100000:3.0:1788843446.709060:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843446.709087:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788843446.709093:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134367360:0@lo:400: 00000100:00100000:2.0:1788843446.710435:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843446.710500:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134367488 00000100:00100000:2.0:1788843446.710510:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134367488 00000100:00100000:2.0:1788843446.710563:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788843446.710698:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843446.710832:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134368000 00000100:00100000:3.0:1788843446.710852:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134368000 00000100:00100000:3.0:1788843446.710891:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116492672 00000100:00100000:3.0:1788843446.710895:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116492672 00000100:00100000:3.0:1788843446.710918:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788843446.710926:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007935c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875738134368000:12345-0@lo:400: 00000100:00100000:1.0:1788843446.711044:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134367232:0@lo:400: 00000100:00100000:1.0:1788843446.711127:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843446.711349:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1875738134367744:0@lo:400: 00000100:00100000:1.0:1788843446.711395:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134367232 00000100:00100000:1.0:1788843446.711399:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134367232 00000100:00100000:0.0:1788843446.711482:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134368128:0@lo:400: 00000100:00100000:0.0:1788843446.711507:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843446.711685:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134367488:12345-0@lo:400: 00000100:00100000:2.0:1788843446.711753:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134367488:12345-0@lo:400: Request processed in 73us (2829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843446.711832:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007935c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875738134368000:12345-0@lo:400: Request processed in 907us (2770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843446.711839:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788843446.711860:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134367616 00000100:00100000:3.0:1788843446.711864:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134367616 00000100:00100000:3.0:1788843446.711880:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134368128 00000100:00100000:3.0:1788843446.711883:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134368128 00000100:00100000:3.0:1788843446.711896:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788843446.711902:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134367616:12345-0@lo:400: 00000100:00100000:3.0:1788843446.711936:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134367616:12345-0@lo:400: Request processed in 34us (1238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843446.711954:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788843446.711968:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788843446.711974:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134368128:12345-0@lo:400: 00000100:00100000:3.0:1788843446.711999:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134368128:12345-0@lo:400: Request processed in 26us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843446.712004:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788843446.712017:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 13 00000100:00100000:3.0:1788843446.712025:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:6191:x1875738116492672:12345-192.168.203.33@tcp:101: 00010000:00010000:3.0:1788843446.712037:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843446.712084:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aec00/0xa762dfcbd58d102f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f224907c9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843446.713673:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af200/0xa762dfcbd58d1036 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843446.713695:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af200/0xa762dfcbd58d1036 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843446.714111:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af200/0xa762dfcbd58d1036 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843446.714190:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788843446.714194:0:6508:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788843446.714221:0:6508:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af200/0xa762dfcbd58d1036 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843446.714263:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aec00/0xa762dfcbd58d102f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224907c9 expref: 8 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843446.714289:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af200/0xa762dfcbd58d1036 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224907c9 expref: 7 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843446.714300:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd007730d00) 00010000:00010000:3.0:1788843446.714302:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788843446.714306:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10f7af200, rc 0) 00000100:00100000:3.0:1788843446.714384:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:6191:x1875738116492672:12345-192.168.203.33@tcp:101: Request processed in 2358us (3951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843446.714392:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 13 00000100:00080000:3.0:1788843446.714550:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788843446.714555:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843446.716418:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843446.716481:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134367872:0@lo:400: 00000100:00100000:3.0:1788843446.716532:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843446.716551:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134368384:0@lo:400: 00000100:00100000:3.0:1788843446.716571:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843446.716606:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134367488:0@lo:400: 00010000:00080000:3.0:1788843446.716622:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fa2f480 x1875738134368000/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843446.716632:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1875738134368000:0@lo:400: 00000100:00100000:3.0:1788843446.716947:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134367360 00000100:00100000:3.0:1788843446.716955:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134367360 00000100:00100000:3.0:1788843446.716999:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788843446.717008:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134367360:12345-0@lo:400: 00000100:00100000:3.0:1788843446.717060:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134367360:12345-0@lo:400: Request processed in 54us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843446.717067:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788843446.717093:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134367872 00000100:00100000:3.0:1788843446.717097:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134367872 00000100:00100000:3.0:1788843446.717166:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134368384 00000100:00100000:3.0:1788843446.717169:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134368384 00000100:00100000:3.0:1788843446.717196:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788843446.717202:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007934700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134367872:12345-0@lo:400: 00000100:00100000:3.0:1788843446.717248:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007934700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134367872:12345-0@lo:400: Request processed in 46us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843446.717254:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788843446.717267:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788843446.717272:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007937100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134368384:12345-0@lo:400: 00000100:00100000:3.0:1788843446.717314:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007937100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134368384:12345-0@lo:400: Request processed in 41us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843446.717319:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788843446.717338:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788843446.717342:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843446.717365:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134367360:0@lo:400: 00010000:00080000:3.0:1788843446.717379:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fa2f800 x1875738134367872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843446.717388:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134367872:0@lo:400: 00010000:00080000:3.0:1788843446.717399:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fa2fb80 x1875738134368384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843446.717407:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134368384:0@lo:400: 00010000:00080000:3.0:1788843446.718520:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fa2e680 x1875738134367616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843446.718532:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134367616:0@lo:400: 00010000:00080000:3.0:1788843446.718545:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fa2d880 x1875738134368128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843446.718553:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134368128:0@lo:400: 00000100:00100000:3.0:1788843446.718893:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843446.718936:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134367744 00000100:00100000:3.0:1788843446.719078:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134367744 00000100:00100000:3.0:1788843446.719337:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788843446.719346:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1875738134367744:12345-0@lo:400: 00000100:00100000:3.0:1788843446.719409:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1875738134367744:12345-0@lo:400: Request processed in 65us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843446.719431:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1788843446.719456:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788843446.719483:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fa2c380 x1875738134367744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843446.719493:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1875738134367744:0@lo:400: 00000100:00100000:3.0:1788843446.719504:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134368256:0@lo:400: 00000100:00100000:3.0:1788843446.719537:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843446.719561:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134368256 00000100:00100000:3.0:1788843446.719565:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134368256 00000100:00100000:3.0:1788843446.719960:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788843446.719968:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134368256:12345-0@lo:400: 00000100:00100000:3.0:1788843446.720004:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134368256:12345-0@lo:400: Request processed in 37us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843446.720010:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788843446.720029:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788843446.720045:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fa2c000 x1875738134368256/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843446.720055:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134368256:0@lo:400: 00000100:00100000:1.0:1788843446.720428:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788843446.720440:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134367232:12345-0@lo:400: 00000100:00100000:1.0:1788843446.720489:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134367232:12345-0@lo:400: Request processed in 53us (9361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843446.720495:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788843446.720901:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134367232:0@lo:400: 00000100:00100000:2.0:1788843446.721839:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788843447.194679:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134368512:0@lo:13: 00000100:00100000:3.0:1788843447.194838:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843447.194939:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134368640:0@lo:13: 00000100:00100000:0.0:1788843447.194973:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843447.195103:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134368512 00000100:00100000:3.0:1788843447.195111:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134368512 00000100:00100000:3.0:1788843447.195185:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134368640 00000100:00100000:3.0:1788843447.195188:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134368640 00000100:00100000:3.0:1788843447.195236:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788843447.195246:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134368512:12345-0@lo:13: 00002000:00000024:3.0:1788843447.195268:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788843447.195474:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788843447.195485:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134368768:0@lo:13: 00000100:00100000:2.0:1788843447.195516:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843447.195616:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1788843447.195627:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1788843447.195836:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134368512:12345-0@lo:13: Request processed in 591us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843447.195845:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788843447.195866:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134368768 00000100:00100000:3.0:1788843447.195870:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134368768 00000100:00100000:3.0:1788843447.195951:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788843447.195959:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134368640:12345-0@lo:13: 00002000:00000024:3.0:1788843447.195971:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843447.196018:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134368640:12345-0@lo:13: Request processed in 60us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843447.196025:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788843447.196036:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788843447.196041:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788843447.196048:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134368768:12345-0@lo:13: 00002000:00000024:2.0:1788843447.196063:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788843447.196098:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134368768:12345-0@lo:13: Request processed in 54us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843447.196104:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788843447.196194:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd120368380 x1875738134368768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843447.196213:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134368768:0@lo:13: 00010000:00080000:1.0:1788843447.196241:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fa2c700 x1875738134368640/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843447.196252:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134368640:0@lo:13: 00010000:00080000:0.0:1788843447.200692:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd120369500 x1875738134368512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843447.201253:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134368512:0@lo:13: 00010000:00010000:0.0:1788843447.450452:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843448.219547:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134368896:0@lo:41: 00000100:00100000:0.0:1788843448.219855:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843448.219976:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788843448.219984:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134369024:0@lo:41: 00000100:00100000:0.0:1788843448.220035:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843448.236872:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134368896 00000100:00100000:1.0:1788843448.236888:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134368896 00000100:00100000:1.0:1788843448.236958:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134369024 00000100:00100000:1.0:1788843448.236961:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134369024 00000100:00100000:1.0:1788843448.236982:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788843448.236991:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134368896:12345-0@lo:41: 00000004:00000024:1.0:1788843448.237036:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788843448.237175:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134368896:12345-0@lo:41: Request processed in 185us (17321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843448.237183:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788843448.237199:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788843448.237205:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134369024:12345-0@lo:41: 00000004:00000024:1.0:1788843448.237230:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788843448.237258:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134369024:12345-0@lo:41: Request processed in 54us (17222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843448.237264:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788843448.238532:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134369024:0@lo:41: 00000100:00100000:2.0:1788843448.238553:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134368896:0@lo:41: 00010000:00010000:2.0:1788843448.477048:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843449.184547:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843449.184729:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116492800 00000100:00100000:3.0:1788843449.184738:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116492800 00000100:00100000:3.0:1788843449.184816:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 14 00000100:00100000:3.0:1788843449.184828:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:6244:x1875738116492800:12345-192.168.203.33@tcp:41: 00000004:00000024:3.0:1788843449.184866:0:6507:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00080000:0.0:1788843449.185261:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843449.185416:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:6244:x1875738116492800:12345-192.168.203.33@tcp:41: Request processed in 590us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843449.185434:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 14 00000100:00100000:3.0:1788843449.190496:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843449.191785:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116492928 00000100:00100000:0.0:1788843449.191801:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116492928 00000100:00100000:0.0:1788843449.191922:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 15 00000100:00100000:0.0:1788843449.191937:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:6244:x1875738116492928:12345-192.168.203.33@tcp:41: 00000004:00000024:0.0:1788843449.191990:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788843449.192083:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:6244:x1875738116492928:12345-192.168.203.33@tcp:41: Request processed in 151us (1602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843449.192091:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 15 00000100:00080000:3.0:1788843449.192671:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788843449.197258:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843449.197455:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116493056 00000100:00100000:3.0:1788843449.197467:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116493056 00000100:00100000:3.0:1788843449.197558:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 20 00000100:00100000:3.0:1788843449.197588:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:6244:x1875738116493056:12345-192.168.203.33@tcp:13: 00002000:00000024:3.0:1788843449.197632:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843449.197730:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:6244:x1875738116493056:12345-192.168.203.33@tcp:13: Request processed in 145us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843449.197747:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 20 00000100:00080000:0.0:1788843449.198882:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788843449.208262:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843449.208714:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116493184 00000100:00100000:2.0:1788843449.208724:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116493184 00000100:00100000:2.0:1788843449.208802:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 21 00000100:00100000:2.0:1788843449.208812:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:6244:x1875738116493184:12345-192.168.203.33@tcp:13: 00002000:00000024:2.0:1788843449.208846:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788843449.208921:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:6244:x1875738116493184:12345-192.168.203.33@tcp:13: Request processed in 110us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843449.208929:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 21 00000100:00080000:0.0:1788843449.209464:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788843449.498463:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788843449.774383:0:9500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f25f61b6-5faf-4e05-81a4-dea3dba05dc5 00010000:00010000:1.0:1788843450.523335:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788843450.787527:0:6485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f25f61b6-5faf-4e05-81a4-dea3dba05dc5 00000001:00100000:1.0:1788843450.788373:0:7438:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f25f61b6-5faf-4e05-81a4-dea3dba05dc5 00000100:00100000:1.0:1788843451.318863:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843451.318923:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843451.318966:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843451.318980:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116493312 00000100:00100000:0.0:1788843451.318995:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116493312 00000100:00100000:1.0:1788843451.319005:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843451.319036:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116493568 00000100:00100000:3.0:1788843451.319048:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116493568 00000100:00100000:1.0:1788843451.319055:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843451.319089:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116493824 00000100:00100000:2.0:1788843451.319097:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116493824 00000100:00100000:1.0:1788843451.319124:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 198 00000100:00100000:3.0:1788843451.319131:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116493440 00000100:00100000:3.0:1788843451.319137:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116493440 00000100:00100000:1.0:1788843451.319166:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+10:2390:x1875738116493312:12345-192.168.203.33@tcp:400: 00000100:00100000:3.0:1788843451.319220:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 53 00000100:00100000:3.0:1788843451.319237:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2390:x1875738116493568:12345-192.168.203.33@tcp:400: 00000100:00100000:2.0:1788843451.319259:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116493696 00000100:00100000:2.0:1788843451.319265:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116493696 00000100:00100000:3.0:1788843451.319322:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2390:x1875738116493568:12345-192.168.203.33@tcp:400: Request processed in 86us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843451.319322:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 14 00000100:00100000:3.0:1788843451.319344:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 53 00000100:00100000:2.0:1788843451.319354:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2390:x1875738116493824:12345-192.168.203.33@tcp:400: 00000100:00100000:3.0:1788843451.319379:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 54 00000100:00100000:2.0:1788843451.319452:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2390:x1875738116493824:12345-192.168.203.33@tcp:400: Request processed in 106us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843451.319460:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 14 00000100:00100000:2.0:1788843451.319480:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 15 00000100:00100000:2.0:1788843451.319488:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2390:x1875738116493696:12345-192.168.203.33@tcp:400: 00000100:00100000:2.0:1788843451.319514:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2390:x1875738116493696:12345-192.168.203.33@tcp:400: Request processed in 26us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843451.319519:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 15 00000100:00080000:2.0:1788843451.319564:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788843451.319568:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788843451.319570:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788843451.319573:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788843451.319578:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2390:x1875738116493440:12345-192.168.203.33@tcp:400: 00000100:00100000:3.0:1788843451.319994:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2390:x1875738116493440:12345-192.168.203.33@tcp:400: Request processed in 603us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843451.320011:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 54 00000100:00100000:1.0:1788843451.320011:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+10:2390:x1875738116493312:12345-192.168.203.33@tcp:400: Request processed in 868us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843451.325666:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 198 00010000:00010000:0.0:1788843451.549545:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843451.802415:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788843451.802445:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134369152:0@lo:13: 00000100:00100000:0.0:1788843451.802530:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843451.802643:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134369152 00000100:00100000:0.0:1788843451.802652:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134369152 00000100:00100000:0.0:1788843451.802719:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788843451.802729:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134369152:12345-0@lo:13: 00002000:00000024:0.0:1788843451.802759:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843451.802801:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134369152:12345-0@lo:13: Request processed in 74us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843451.802808:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1788843451.802832:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788843451.802856:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fa2c000 x1875738134369152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843451.802873:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134369152:0@lo:13: 00000100:00100000:1.0:1788843451.804546:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134369536:0@lo:400: 00000100:00100000:1.0:1788843451.804605:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843451.804649:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007240a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1875738134370048:0@lo:400: 00000100:00100000:1.0:1788843451.804682:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843451.804703:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd136c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134370560:0@lo:400: 00000100:00100000:1.0:1788843451.804731:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843451.804765:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788843451.804772:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007242680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134369408:0@lo:400: 00000100:00100000:1.0:1788843451.804794:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843451.804811:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1875738134369920:0@lo:400: 00000100:00100000:1.0:1788843451.804833:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843451.804852:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007243100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134370432:0@lo:400: 00000100:00100000:1.0:1788843451.804873:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843451.804903:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134369536 00000100:00100000:1.0:1788843451.804917:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134369536 00000100:00100000:1.0:1788843451.804960:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788843451.804970:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134369536:12345-0@lo:400: 00000100:00100000:1.0:1788843451.805019:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134369536:12345-0@lo:400: Request processed in 52us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843451.805026:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788843451.805048:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134370048 00000100:00100000:1.0:1788843451.805052:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134370048 00000100:00100000:1.0:1788843451.805079:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134369408 00000100:00100000:1.0:1788843451.805082:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134369408 00000100:00100000:1.0:1788843451.805096:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134369920 00000100:00100000:1.0:1788843451.805099:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134369920 00000100:00100000:1.0:1788843451.805111:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134370432 00000100:00100000:1.0:1788843451.805113:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134370432 00000100:00100000:1.0:1788843451.805129:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788843451.805135:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875738134370048:12345-0@lo:400: 00000100:00100000:1.0:1788843451.805209:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875738134370048:12345-0@lo:400: Request processed in 73us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843451.805215:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788843451.805239:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788843451.805246:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134369408:12345-0@lo:400: 00000100:00100000:1.0:1788843451.805273:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134369408:12345-0@lo:400: Request processed in 28us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843451.805279:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788843451.805291:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788843451.805298:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875738134369920:12345-0@lo:400: 00000100:00100000:1.0:1788843451.805328:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875738134369920:12345-0@lo:400: Request processed in 31us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843451.805343:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788843451.805353:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788843451.805359:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875738134370432:12345-0@lo:400: 00000100:00100000:1.0:1788843451.805390:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875738134370432:12345-0@lo:400: Request processed in 31us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843451.805395:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788843451.805433:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007242680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134369408:0@lo:400: 00000100:00100000:1.0:1788843451.805444:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1875738134369920:0@lo:400: 00010000:00080000:1.0:1788843451.805455:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007243100 x1875738134370432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843451.805466:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007243100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134370432:0@lo:400: 00000100:00100000:1.0:1788843451.805474:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134369536:0@lo:400: 00010000:00080000:1.0:1788843451.805482:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007240a80 x1875738134370048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843451.805491:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007240a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1875738134370048:0@lo:400: 00000100:00100000:2.0:1788843451.805943:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134369664:0@lo:400: 00000100:00100000:2.0:1788843451.805980:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843451.806012:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134370176:0@lo:400: 00000100:00100000:2.0:1788843451.806037:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843451.806057:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134370688:0@lo:400: 00000100:00100000:2.0:1788843451.806079:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843451.806101:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788843451.806107:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134369280:0@lo:400: 00000100:00100000:2.0:1788843451.806130:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843451.806172:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007241880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134369792:0@lo:400: 00000100:00100000:2.0:1788843451.806211:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843451.806245:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007241500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1875738134370304:0@lo:400: 00000100:00100000:2.0:1788843451.806271:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843451.806308:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134369792 00000100:00100000:2.0:1788843451.806313:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134369792 00000100:00100000:2.0:1788843451.806342:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788843451.806348:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134369792:12345-0@lo:400: 00000100:00100000:2.0:1788843451.806387:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134369792:12345-0@lo:400: Request processed in 38us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843451.806393:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788843451.806411:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134370560 00000100:00100000:2.0:1788843451.806414:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134370560 00000100:00100000:2.0:1788843451.806440:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134370176 00000100:00100000:2.0:1788843451.806443:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134370176 00000100:00100000:2.0:1788843451.806475:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134370688 00000100:00100000:2.0:1788843451.806478:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134370688 00000100:00100000:2.0:1788843451.806502:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788843451.806507:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134370560:12345-0@lo:400: 00000100:00100000:2.0:1788843451.806542:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134370560:12345-0@lo:400: Request processed in 35us (1811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843451.806548:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788843451.806560:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788843451.806566:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134370176:12345-0@lo:400: 00000100:00100000:2.0:1788843451.806591:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134370176:12345-0@lo:400: Request processed in 26us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843451.806596:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788843451.806606:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788843451.806612:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120368380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134370688:12345-0@lo:400: 00000100:00100000:2.0:1788843451.806651:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120368380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134370688:12345-0@lo:400: Request processed in 39us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843451.806657:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788843451.806679:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134369664 00000100:00100000:2.0:1788843451.806682:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134369664 00000100:00100000:2.0:1788843451.806701:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134370304 00000100:00100000:2.0:1788843451.806704:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134370304 00000100:00100000:2.0:1788843451.806718:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788843451.806723:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134369664:12345-0@lo:400: 00000100:00100000:2.0:1788843451.806757:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134369664:12345-0@lo:400: Request processed in 34us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843451.806763:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788843451.806774:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788843451.806780:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875738134370304:12345-0@lo:400: 00000100:00100000:2.0:1788843451.806820:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875738134370304:12345-0@lo:400: Request processed in 40us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843451.806827:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788843451.806866:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007241880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134369792:0@lo:400: 00000100:00100000:2.0:1788843451.806878:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007241500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1875738134370304:0@lo:400: 00000100:00100000:2.0:1788843451.806944:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134369664:0@lo:400: 00010000:00080000:2.0:1788843451.806956:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007240380 x1875738134370176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843451.806965:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134370176:0@lo:400: 00010000:00080000:2.0:1788843451.806975:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f8d2a00 x1875738134370688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843451.806983:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134370688:0@lo:400: 00000100:00100000:1.0:1788843451.808252:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134369280 00000100:00100000:1.0:1788843451.808263:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134369280 00000100:00100000:1.0:1788843451.808312:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788843451.808320:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3630:x1875738134369280:12345-0@lo:400: 00000100:00100000:1.0:1788843451.808380:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3630:x1875738134369280:12345-0@lo:400: Request processed in 61us (2249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843451.808387:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00010000:00080000:1.0:1788843451.808457:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd136c44e00 x1875738134370560/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843451.808479:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd136c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134370560:0@lo:400: 00000100:00080000:0.0:1788843451.808728:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788843451.808734:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788843451.808739:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788843451.808741:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788843451.809912:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134369280:0@lo:400: 00000001:00100000:2.0:1788843451.812929:0:8417:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f25f61b6-5faf-4e05-81a4-dea3dba05dc5 00000100:00100000:2.0:1788843452.317744:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788843452.317780:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e874a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134370816:0@lo:13: 00000100:00100000:2.0:1788843452.317874:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843452.318128:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134370944:0@lo:13: 00000100:00100000:1.0:1788843452.318182:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843452.318234:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134370816 00000100:00100000:1.0:1788843452.318242:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134370816 00000100:00100000:1.0:1788843452.318291:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134370944 00000100:00100000:1.0:1788843452.318294:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134370944 00000100:00100000:1.0:1788843452.318311:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788843452.318320:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134370816:12345-0@lo:13: 00002000:00000024:1.0:1788843452.318355:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788843452.318405:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134370816:12345-0@lo:13: Request processed in 85us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843452.318413:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788843452.318431:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788843452.318437:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134370944:12345-0@lo:13: 00002000:00000024:1.0:1788843452.318446:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788843452.318487:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134370944:12345-0@lo:13: Request processed in 50us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843452.318494:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788843452.318536:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f8d3800 x1875738134370944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843468 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843452.318557:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134370944:0@lo:13: 00010000:00080000:1.0:1788843452.318588:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd13e874a80 x1875738134370816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843468 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843452.318599:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e874a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134370816:0@lo:13: 00000100:00100000:1.0:1788843452.320292:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134371072:0@lo:13: 00000100:00100000:1.0:1788843452.320376:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843452.320583:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134371072 00000100:00100000:0.0:1788843452.320594:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134371072 00000100:00100000:0.0:1788843452.320650:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788843452.320661:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134371072:12345-0@lo:13: 00002000:00000024:0.0:1788843452.320685:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843452.320744:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134371072:12345-0@lo:13: Request processed in 85us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843452.320752:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788843452.320838:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd13e875880 x1875738134371072/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843468 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843452.320860:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134371072:0@lo:13: 00010000:00010000:2.0:1788843452.572687:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788843452.729605:0:10174:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788843453.344885:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788843453.344913:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134371200:0@lo:41: 00000100:00100000:0.0:1788843453.344983:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843453.345045:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134371200 00000100:00100000:1.0:1788843453.345053:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134371200 00000100:00100000:3.0:1788843453.345073:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788843453.345086:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007934a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134371328:0@lo:41: 00000100:00100000:1.0:1788843453.345102:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788843453.345112:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134371200:12345-0@lo:41: 00000100:00100000:3.0:1788843453.345124:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:1.0:1788843453.345190:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788843453.345254:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134371200:12345-0@lo:41: Request processed in 143us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843453.345262:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788843453.345278:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134371328 00000100:00100000:1.0:1788843453.345281:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134371328 00000100:00100000:0.0:1788843453.345299:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788843453.345453:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007934e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134371328:12345-0@lo:41: 00000004:00000024:0.0:1788843453.345484:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788843453.345534:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007934e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134371328:12345-0@lo:41: Request processed in 84us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843453.345593:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007934a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134371328:0@lo:41: 00000100:00100000:3.0:1788843453.346721:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134371200:0@lo:41: 00000100:00100000:0.0:1788843453.349918:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:0.0:1788843453.598934:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843454.619321:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843455.644238:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843456.430822:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843456.430879:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843456.430907:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843456.431347:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843456.431385:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843456.431413:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116494336 00000100:00100000:2.0:1788843456.431421:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116494336 00000100:00100000:2.0:1788843456.431472:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116494464 00000100:00100000:2.0:1788843456.431475:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116494464 00000100:00100000:2.0:1788843456.431496:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 19 00000100:00100000:2.0:1788843456.431505:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2390:x1875738116494336:12345-192.168.203.33@tcp:400: 00000100:00100000:2.0:1788843456.431570:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2390:x1875738116494336:12345-192.168.203.33@tcp:400: Request processed in 67us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843456.431578:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 19 00000100:00100000:2.0:1788843456.431593:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 20 00000100:00100000:2.0:1788843456.431599:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2390:x1875738116494464:12345-192.168.203.33@tcp:400: 00000100:00100000:2.0:1788843456.431634:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2390:x1875738116494464:12345-192.168.203.33@tcp:400: Request processed in 35us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843456.431640:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 20 00000100:00100000:2.0:1788843456.431659:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116494080 00000100:00100000:2.0:1788843456.431664:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116494080 00000100:00100000:2.0:1788843456.431691:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116494208 00000100:00100000:2.0:1788843456.431694:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116494208 00000100:00100000:2.0:1788843456.431713:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 61 00000100:00100000:2.0:1788843456.431719:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2390:x1875738116494080:12345-192.168.203.33@tcp:400: 00000100:00100000:2.0:1788843456.431746:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2390:x1875738116494080:12345-192.168.203.33@tcp:400: Request processed in 27us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843456.431752:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 61 00000100:00100000:2.0:1788843456.431764:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 62 00000100:00100000:2.0:1788843456.431770:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2390:x1875738116494208:12345-192.168.203.33@tcp:400: 00000100:00100000:2.0:1788843456.431792:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2390:x1875738116494208:12345-192.168.203.33@tcp:400: Request processed in 23us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843456.431798:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 62 00000100:00080000:2.0:1788843456.431816:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788843456.431820:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788843456.431822:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788843456.431824:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843456.434516:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116493952 00000100:00100000:0.0:1788843456.434530:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116493952 00000100:00100000:0.0:1788843456.434593:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 200 00000100:00100000:0.0:1788843456.434603:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+10:2390:x1875738116493952:12345-192.168.203.33@tcp:400: 00000100:00100000:0.0:1788843456.435784:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+10:2390:x1875738116493952:12345-192.168.203.33@tcp:400: Request processed in 1175us (4868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843456.435796:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 200 00000020:00000080:2.0:1788843456.520298:0:10322:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff435c4220 20000000:00000080:2.0:1788843456.520316:0:10322:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bd10fad4c00 uarg=0000000000000000 20000000:01000000:2.0:1788843456.520359:0:10322:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788843456.520362:0:10322:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788843456.520365:0:10322:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788843456.520370:0:10322:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788843456.520382:0:10322:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788843456.520440:0:10322:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788843456.520443:0:10322:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788843456.521089:0:10323:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1788843456.521448:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1788843456.521479:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1788843456.521496:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:2.0:1788843456.521508:0:10322:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788843456.521511:0:10322:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788843456.525041:0:10324:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1788843456.525585:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1788843456.525616:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1788843456.525632:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:2.0:1788843456.525721:0:10322:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788843456.525725:0:10322:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788843456.526373:0:10325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1788843456.526558:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1788843456.526582:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1788843456.526597:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:2.0:1788843456.526608:0:10322:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788843456.526610:0:10322:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788843456.527381:0:10326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1788843456.527799:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1788843456.527898:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1788843456.527918:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:2.0:1788843456.527996:0:10322:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788843456.527999:0:10322:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788843456.530243:0:10327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1788843456.530717:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1788843456.530752:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1788843456.530769:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 10000000:01000000:2.0:1788843456.530784:0:10322:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788843456.530803:0:10322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd1153e6a00/0xa762dfcbd58d103d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.530821:0:10322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd100031200/0xa762dfcbd58d0ed8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0ed1 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.531384:0:10322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd1153e6000/0xa762dfcbd58d0f02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0efb expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.531401:0:10322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0f41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0f3a expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.531408:0:10322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd1153e7400/0xa762dfcbd58d0f4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0f48 expref: 23 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.531415:0:10322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd13fb35400/0xa762dfcbd58d0f5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0f56 expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.531422:0:10322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd100030a00/0xa762dfcbd58d0f79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0f72 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.531429:0:10322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d0fa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0f9c expref: 23 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.531436:0:10322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd1153e6600/0xa762dfcbd58d0fbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0fb8 expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.531443:0:10322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd1153e7800/0xa762dfcbd58d0fe9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0fe2 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.531454:0:10322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d0ff7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490759 expref: 9 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.531462:0:10322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd1153e6800/0xa762dfcbd58d0ffe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490760 expref: 9 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.531471:0:10322:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd1153e6a00/0xa762dfcbd58d103d lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843456.532077:0:10322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd1153e6800/0xa762dfcbd58d0ffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490760 expref: 9 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843456.532102:0:10322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd1153e6800/0xa762dfcbd58d0ffe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490760 expref: 9 pid: 6500 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843456.532117:0:10322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007935500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1875738134371456:192.168.203.33@tcp:104: 00010000:00010000:3.0:1788843456.532583:0:10322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d0ff7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490759 expref: 9 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843456.532594:0:10322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d0ff7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490759 expref: 9 pid: 6498 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843456.532603:0:10322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007934a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1875738134371584:192.168.203.33@tcp:104: 00010000:00010000:3.0:1788843456.532637:0:10322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd1153e7800/0xa762dfcbd58d0fe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0fe2 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843456.532645:0:10322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd1153e7800/0xa762dfcbd58d0fe9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0fe2 expref: 23 pid: 6500 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843456.532653:0:10322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f984380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1875738134371712:0@lo:104: 00000100:00100000:3.0:1788843456.532709:0:10322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788843456.532756:0:10322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd1153e6600/0xa762dfcbd58d0fbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0fb8 expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843456.532765:0:10322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd1153e6600/0xa762dfcbd58d0fbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0fb8 expref: 23 pid: 6501 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843456.532773:0:10322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007998700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1875738134371840:0@lo:104: 00000100:00100000:3.0:1788843456.532794:0:10322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788843456.532842:0:10322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d0fa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0f9c expref: 23 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843456.532851:0:10322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d0fa3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0f9c expref: 23 pid: 6498 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843456.532860:0:10322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1875738134371968:0@lo:104: 00000100:00100000:3.0:1788843456.532882:0:10322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788843456.532899:0:10322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd100030a00/0xa762dfcbd58d0f79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0f72 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843456.532907:0:10322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd100030a00/0xa762dfcbd58d0f79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0f72 expref: 23 pid: 6500 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843456.532915:0:10322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1875738134372096:0@lo:104: 00000100:00100000:3.0:1788843456.532951:0:10322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788843456.532969:0:10322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd13fb35400/0xa762dfcbd58d0f5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0f56 expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843456.532978:0:10322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd13fb35400/0xa762dfcbd58d0f5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0f56 expref: 23 pid: 6501 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843456.532986:0:10322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007998e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1875738134372224:0@lo:104: 00010000:00010000:3.0:1788843456.533007:0:10322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd1153e7400/0xa762dfcbd58d0f4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0f48 expref: 23 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843456.533015:0:10322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd1153e7400/0xa762dfcbd58d0f4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0f48 expref: 23 pid: 6498 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843456.533022:0:10322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007999500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1875738134372352:0@lo:104: 00010000:00010000:3.0:1788843456.533051:0:10322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0f41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0f3a expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843456.533059:0:10322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0f41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0f3a expref: 23 pid: 6501 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843456.533067:0:10322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007999f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1875738134372480:0@lo:104: 00010000:00010000:3.0:1788843456.533087:0:10322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd1153e6000/0xa762dfcbd58d0f02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0efb expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843456.533095:0:10322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd1153e6000/0xa762dfcbd58d0f02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0efb expref: 23 pid: 6500 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843456.533102:0:10322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007998a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1875738134372608:0@lo:104: 00010000:00010000:3.0:1788843456.533120:0:10322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd100031200/0xa762dfcbd58d0ed8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0ed1 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843456.533127:0:10322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd100031200/0xa762dfcbd58d0ed8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0ed1 expref: 23 pid: 6500 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843456.533135:0:10322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1875738134372736:0@lo:104: 00000100:00100000:3.0:1788843456.533185:0:10322:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788843456.533384:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788843456.533403:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843456.533416:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843456.533424:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843456.533432:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843456.533440:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843456.533448:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134371712 00000100:00100000:0.0:1788843456.533455:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134371712 00000100:00100000:0.0:1788843456.533491:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134371840 00000100:00100000:0.0:1788843456.533494:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134371840 00000100:00100000:0.0:1788843456.533505:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134371968 00000100:00100000:0.0:1788843456.533507:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134371968 00000100:00100000:0.0:1788843456.533515:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134372096 00000100:00100000:0.0:1788843456.533517:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134372096 00000100:00100000:0.0:1788843456.533524:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134372224 00000100:00100000:0.0:1788843456.533532:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134372224 00000100:00100000:0.0:1788843456.533561:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134372352 00000100:00100000:0.0:1788843456.533564:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134372352 00000100:00100000:0.0:1788843456.533574:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134372480 00000100:00100000:0.0:1788843456.533576:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134372480 00000100:00100000:0.0:1788843456.533584:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134372608 00000100:00100000:0.0:1788843456.533586:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134372608 00000100:00100000:0.0:1788843456.533594:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134372736 00000100:00100000:0.0:1788843456.533596:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134372736 00000100:00100000:0.0:1788843456.533608:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788843456.533616:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00799ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+11:10322:x1875738134371712:12345-0@lo:104: 00010000:00010000:0.0:1788843456.533629:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0fe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0fe9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.533684:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788843456.533690:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00799ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+11:10322:x1875738134371712:12345-0@lo:104: Request processed in 75us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843456.533697:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788843456.533714:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788843456.533720:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00799b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+10:10322:x1875738134371840:12345-0@lo:104: 00010000:00010000:0.0:1788843456.533728:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d0fb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0fbf expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.533760:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788843456.533765:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00799b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+10:10322:x1875738134371840:12345-0@lo:104: Request processed in 46us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843456.533771:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788843456.533783:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788843456.533789:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007999180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+9:10322:x1875738134371968:12345-0@lo:104: 00010000:00010000:0.0:1788843456.533805:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6e00/0xa762dfcbd58d0f9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0fa3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843456.533943:0:10322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f984380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1875738134371712:0@lo:104: 00000100:00100000:3.0:1788843456.533953:0:10322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007998700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1875738134371840:0@lo:104: 00010000:00010000:0.0:1788843456.534063:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788843456.534068:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007999180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+9:10322:x1875738134371968:12345-0@lo:104: Request processed in 280us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843456.534075:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788843456.534088:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788843456.534093:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd006749850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+8:10322:x1875738134372096:12345-0@lo:104: 00010000:00010000:0.0:1788843456.534101:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d0f72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0f79 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.534127:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788843456.534132:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd006749850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+8:10322:x1875738134372096:12345-0@lo:104: Request processed in 40us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843456.534138:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788843456.534198:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788843456.534205:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+7:10322:x1875738134372224:12345-0@lo:104: 00010000:00010000:0.0:1788843456.534212:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae800/0xa762dfcbd58d0f56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0f5d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.534240:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788843456.534245:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+7:10322:x1875738134372224:12345-0@lo:104: Request processed in 42us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843456.534250:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788843456.534260:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788843456.534265:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+6:10322:x1875738134372352:12345-0@lo:104: 00010000:00010000:0.0:1788843456.534278:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7200/0xa762dfcbd58d0f48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0f4f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.534317:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788843456.534323:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+6:10322:x1875738134372352:12345-0@lo:104: Request processed in 58us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843456.534329:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788843456.534340:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788843456.534346:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+5:10322:x1875738134372480:12345-0@lo:104: 00010000:00010000:0.0:1788843456.534353:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd100031600/0xa762dfcbd58d0f3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0f41 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.534380:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1788843456.534384:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+5:10322:x1875738134372480:12345-0@lo:104: Request processed in 40us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843456.534389:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788843456.534399:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788843456.534404:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+4:10322:x1875738134372608:12345-0@lo:104: 00010000:00010000:0.0:1788843456.534410:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34800/0xa762dfcbd58d0efb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0f02 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.534432:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:0.0:1788843456.534437:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+4:10322:x1875738134372608:12345-0@lo:104: Request processed in 34us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843456.534442:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788843456.534453:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788843456.534459:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+3:10322:x1875738134372736:12345-0@lo:104: 00010000:00010000:0.0:1788843456.534472:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae200/0xa762dfcbd58d0ed1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0ed8 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.534499:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:0.0:1788843456.534504:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+3:10322:x1875738134372736:12345-0@lo:104: Request processed in 46us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843456.534510:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1788843456.534528:0:6495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1788843456.534533:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0fe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0fe9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.534540:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e6200 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:0.0:1788843456.534545:0:6495:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0fe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0fe9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.534554:0:6495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0fe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0fe9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843456.534560:0:6495:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0fe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0fe9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843456.534566:0:6495:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788843456.534599:0:6495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0fe2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0fe9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.534606:0:6495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843456.534626:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0fe2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0fe9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.534633:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6200/0xa762dfcbd58d0fe2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0fe9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.534667:0:6495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788843456.534671:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d0fb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0fbf expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.534676:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e7a00 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:0.0:1788843456.534679:0:6495:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d0fb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0fbf expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.534686:0:6495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d0fb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0fbf expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843456.534692:0:6495:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d0fb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0fbf expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843456.534696:0:6495:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788843456.534710:0:6495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d0fb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0fbf expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.534717:0:6495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843456.534722:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d0fb8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0fbf expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.534727:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7a00/0xa762dfcbd58d0fb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0fbf expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.534736:0:6495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788843456.534739:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6e00/0xa762dfcbd58d0f9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0fa3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.534755:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e6e00 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:0.0:1788843456.534758:0:6495:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6e00/0xa762dfcbd58d0f9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0fa3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.534765:0:6495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6e00/0xa762dfcbd58d0f9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0fa3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843456.534771:0:6495:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6e00/0xa762dfcbd58d0f9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0fa3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843456.534776:0:6495:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788843456.534789:0:6495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6e00/0xa762dfcbd58d0f9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0fa3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.534795:0:6495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843456.534812:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6e00/0xa762dfcbd58d0f9c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0fa3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.534817:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6e00/0xa762dfcbd58d0f9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0fa3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843456.534949:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134372864:0@lo:103: 00000100:00100000:1.0:1788843456.534996:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843456.535030:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788843456.535036:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134372992:0@lo:103: 00000100:00100000:1.0:1788843456.535057:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843456.535082:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134372864 00000100:00100000:1.0:1788843456.535088:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134372864 00010000:00010000:1.0:1788843456.535112:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd1153e7800/0xa762dfcbd58d0fe9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0fe2 expref: 24 pid: 6500 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843456.535133:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134372992 00000100:00100000:1.0:1788843456.535136:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134372992 00010000:00010000:1.0:1788843456.535180:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd1153e6600/0xa762dfcbd58d0fbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0fb8 expref: 25 pid: 6501 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843456.535199:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788843456.535206:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13332dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+25:3632:x1875738134372864:12345-0@lo:103: 00010000:00010000:1.0:1788843456.535217:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843456.535222:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd1153e7800/0xa762dfcbd58d0fe9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0fe2 expref: 25 pid: 6500 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843456.535233:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd1153e7800/0xa762dfcbd58d0fe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0fe2 expref: 25 pid: 6500 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843456.535247:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1153e7800/0xa762dfcbd58d0fe9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0fe2 expref: 25 pid: 6500 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843456.535261:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843456.535290:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13332dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3632:x1875738134372864:12345-0@lo:103: Request processed in 85us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843456.535297:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788843456.535334:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788843456.535341:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:3632:x1875738134372992:12345-0@lo:103: 00010000:00010000:1.0:1788843456.535348:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843456.535353:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd1153e6600/0xa762dfcbd58d0fbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0fb8 expref: 23 pid: 6501 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843456.535362:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd1153e6600/0xa762dfcbd58d0fbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0fb8 expref: 23 pid: 6501 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843456.535372:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1153e6600/0xa762dfcbd58d0fbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0fb8 expref: 23 pid: 6501 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843456.535458:0:10322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1875738134371968:0@lo:104: 00000100:00100000:3.0:1788843456.535470:0:10322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1875738134372096:0@lo:104: 00000100:00100000:3.0:1788843456.535479:0:10322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007998e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1875738134372224:0@lo:104: 00000100:00100000:3.0:1788843456.535487:0:10322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007999500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1875738134372352:0@lo:104: 00000100:00100000:3.0:1788843456.535505:0:10322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007999f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1875738134372480:0@lo:104: 00000100:00100000:3.0:1788843456.535515:0:10322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007998a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1875738134372608:0@lo:104: 00000100:00100000:3.0:1788843456.535524:0:10322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1875738134372736:0@lo:104: 00010000:00010000:1.0:1788843456.536428:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843456.536473:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:3632:x1875738134372992:12345-0@lo:103: Request processed in 1130us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843456.536483:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788843456.536537:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134372992:0@lo:103: 00000100:00100000:1.0:1788843456.536547:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134372864:0@lo:103: 00010000:00010000:0.0:1788843456.536913:0:6495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788843456.536921:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d0f72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0f79 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.536998:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb34200 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:0.0:1788843456.537002:0:6495:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d0f72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0f79 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.537028:0:6495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d0f72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0f79 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843456.537036:0:6495:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d0f72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0f79 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843456.537042:0:6495:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788843456.537123:0:6495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d0f72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0f79 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.537130:0:6495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843456.537170:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d0f72 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0f79 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.537178:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d0f72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0f79 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.537189:0:6495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788843456.537192:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae800/0xa762dfcbd58d0f56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0f5d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.537197:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7ae800 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:0.0:1788843456.537199:0:6495:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae800/0xa762dfcbd58d0f56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0f5d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.537205:0:6495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae800/0xa762dfcbd58d0f56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0f5d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843456.537211:0:6495:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae800/0xa762dfcbd58d0f56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0f5d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843456.537221:0:6495:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788843456.537408:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788843456.537679:0:6495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae800/0xa762dfcbd58d0f56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0f5d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.537686:0:6495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843456.537707:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae800/0xa762dfcbd58d0f56 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0f5d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.537714:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae800/0xa762dfcbd58d0f56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0f5d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.537723:0:6495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788843456.537726:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd100031600/0xa762dfcbd58d0f3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0f41 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.537731:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd100031600 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:0.0:1788843456.537734:0:6495:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd100031600/0xa762dfcbd58d0f3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0f41 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.537740:0:6495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd100031600/0xa762dfcbd58d0f3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0f41 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843456.537747:0:6495:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd100031600/0xa762dfcbd58d0f3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0f41 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843456.537859:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134373376:0@lo:103: 00000100:00100000:2.0:1788843456.537906:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1788843456.538067:0:6495:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788843456.539819:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843456.539906:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843456.540401:0:10322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007935500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1875738134371456:192.168.203.33@tcp:104: 00000100:00100000:3.0:1788843456.540415:0:10322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007934a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1875738134371584:192.168.203.33@tcp:104: 00010000:00010000:3.0:1788843456.540468:0:10322:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd1153e6a00/0xa762dfcbd58d103d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.541635:0:6495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd100031600/0xa762dfcbd58d0f3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0f41 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.541656:0:6495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843456.541695:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd100031600/0xa762dfcbd58d0f3a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0f41 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.541703:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd100031600/0xa762dfcbd58d0f3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0f41 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.541721:0:6495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788843456.541726:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34800/0xa762dfcbd58d0efb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0f02 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.541731:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb34800 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:0.0:1788843456.541735:0:6495:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34800/0xa762dfcbd58d0efb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0f02 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.541744:0:6495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34800/0xa762dfcbd58d0efb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0f02 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843456.541750:0:6495:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34800/0xa762dfcbd58d0efb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0f02 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843456.541757:0:6495:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788843456.541794:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788843456.541811:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134373504:0@lo:103: 00000100:00100000:2.0:1788843456.541877:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843456.542628:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134373376 00000100:00100000:1.0:1788843456.542636:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134373376 00010000:00010000:1.0:1788843456.542678:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd13fb35400/0xa762dfcbd58d0f5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0f56 expref: 22 pid: 6501 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843456.542698:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116494720 00000100:00100000:1.0:1788843456.542701:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116494720 00010000:00010000:1.0:1788843456.542714:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d0ff7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490759 expref: 10 pid: 6498 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843456.542724:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116494592 00000100:00100000:1.0:1788843456.542726:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116494592 00010000:00010000:1.0:1788843456.542735:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd1153e6800/0xa762dfcbd58d0ffe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490760 expref: 11 pid: 6500 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843456.542746:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134373504 00000100:00100000:1.0:1788843456.542748:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134373504 00010000:00010000:1.0:1788843456.542758:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0f41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0f3a expref: 23 pid: 6501 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843456.542773:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788843456.542781:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e877100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:3632:x1875738134373376:12345-0@lo:103: 00010000:00010000:1.0:1788843456.542803:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843456.542809:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd13fb35400/0xa762dfcbd58d0f5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0f56 expref: 23 pid: 6501 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843456.542819:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd13fb35400/0xa762dfcbd58d0f5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0f56 expref: 23 pid: 6501 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843456.542848:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd13fb35400/0xa762dfcbd58d0f5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0f56 expref: 23 pid: 6501 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843456.542861:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843456.542916:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e877100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:3632:x1875738134373376:12345-0@lo:103: Request processed in 135us (5009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843456.542924:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788843456.543077:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134373376:0@lo:103: 00000100:00100000:1.0:1788843456.545734:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 27 00000100:00100000:1.0:1788843456.545757:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e875880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7928f422-fe0e-4906-b099-11067616e1bb+11:2389:x1875738116494720:12345-192.168.203.33@tcp:103: 00010000:00010000:1.0:1788843456.545779:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843456.545789:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d0ff7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490759 expref: 11 pid: 6498 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843456.545804:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d0ff7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490759 expref: 11 pid: 6498 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843456.545833:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d0ff7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490759 expref: 11 pid: 6498 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843456.545852:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843456.545921:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e875880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7928f422-fe0e-4906-b099-11067616e1bb+10:2389:x1875738116494720:12345-192.168.203.33@tcp:103: Request processed in 176us (6110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843456.545955:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 27 00000100:00100000:1.0:1788843456.545970:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 28 00000100:00100000:1.0:1788843456.545977:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e874a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7928f422-fe0e-4906-b099-11067616e1bb+9:2389:x1875738116494592:12345-192.168.203.33@tcp:103: 00010000:00010000:1.0:1788843456.545986:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843456.545992:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd1153e6800/0xa762dfcbd58d0ffe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490760 expref: 9 pid: 6500 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843456.546002:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd1153e6800/0xa762dfcbd58d0ffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490760 expref: 9 pid: 6500 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843456.546012:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1153e6800/0xa762dfcbd58d0ffe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490760 expref: 9 pid: 6500 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843456.546021:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843456.546041:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e874a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7928f422-fe0e-4906-b099-11067616e1bb+8:2389:x1875738116494592:12345-192.168.203.33@tcp:103: Request processed in 64us (6135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843456.546046:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 28 00000100:00100000:1.0:1788843456.546059:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788843456.546066:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:3632:x1875738134373504:12345-0@lo:103: 00010000:00010000:1.0:1788843456.546074:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843456.546078:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0f41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0f3a expref: 21 pid: 6501 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843456.546087:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0f41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0f3a expref: 21 pid: 6501 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843456.546097:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d0f41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0f3a expref: 21 pid: 6501 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843456.546113:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843456.546202:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:3632:x1875738134373504:12345-0@lo:103: Request processed in 135us (4323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843456.546209:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788843456.546281:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134373504:0@lo:103: 00010000:00010000:2.0:1788843456.546553:0:10328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788843456.552425:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134373120:0@lo:103: 00000100:00100000:0.0:1788843456.552499:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843456.552586:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788843456.552593:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134373248:0@lo:103: 00000100:00100000:0.0:1788843456.552614:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788843456.552685:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7200/0xa762dfcbd58d0f48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0f4f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843456.552697:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e7200 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:1.0:1788843456.552700:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7200/0xa762dfcbd58d0f48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0f4f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843456.552709:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7200/0xa762dfcbd58d0f48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0f4f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788843456.552715:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7200/0xa762dfcbd58d0f48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0f4f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843456.552721:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788843456.553081:0:6495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34800/0xa762dfcbd58d0efb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0f02 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.553089:0:6495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843456.553117:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34800/0xa762dfcbd58d0efb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0f02 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.553125:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34800/0xa762dfcbd58d0efb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0f02 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843456.553178:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134373632:0@lo:103: 00000100:00100000:0.0:1788843456.553205:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843456.553241:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134373120 00000100:00100000:2.0:1788843456.553248:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134373120 00010000:00010000:2.0:1788843456.553290:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d0fa3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0f9c expref: 20 pid: 6498 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843456.553315:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134373248 00000100:00100000:2.0:1788843456.553318:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134373248 00010000:00010000:2.0:1788843456.553328:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd100030a00/0xa762dfcbd58d0f79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0f72 expref: 21 pid: 6500 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843456.553343:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788843456.553350:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:3630:x1875738134373120:12345-0@lo:103: 00010000:00010000:2.0:1788843456.553363:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843456.553368:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d0fa3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0f9c expref: 21 pid: 6498 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.553380:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d0fa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0f9c expref: 21 pid: 6498 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.553408:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1153e7e00/0xa762dfcbd58d0fa3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0f9c expref: 21 pid: 6498 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.553422:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843456.553456:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:3630:x1875738134373120:12345-0@lo:103: Request processed in 106us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843456.553463:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788843456.553481:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788843456.553486:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13332e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+19:3630:x1875738134373248:12345-0@lo:103: 00010000:00010000:2.0:1788843456.553493:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843456.553498:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd100030a00/0xa762dfcbd58d0f79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0f72 expref: 19 pid: 6500 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.553505:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd100030a00/0xa762dfcbd58d0f79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0f72 expref: 19 pid: 6500 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.553514:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd100030a00/0xa762dfcbd58d0f79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0f72 expref: 19 pid: 6500 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.553523:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843456.553544:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13332e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:3630:x1875738134373248:12345-0@lo:103: Request processed in 57us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843456.553549:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:1.0:1788843456.553666:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7200/0xa762dfcbd58d0f48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0f4f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843456.553674:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788843456.553681:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7200/0xa762dfcbd58d0f48 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0f4f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843456.553687:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd1153e7200/0xa762dfcbd58d0f48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0f4f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843456.553708:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843456.553710:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843456.553711:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843456.554107:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134373248:0@lo:103: 00000100:00100000:0.0:1788843456.554117:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134373120:0@lo:103: 00000100:00100000:0.0:1788843456.554136:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788843456.554174:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134373760:0@lo:103: 00000100:00100000:0.0:1788843456.554202:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788843456.554261:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843456.554263:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843456.554265:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843456.554416:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843456.554420:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843456.554421:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843456.554458:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae200/0xa762dfcbd58d0ed1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0ed8 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843456.554468:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7ae200 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:3.0:1788843456.554472:0:10328:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae200/0xa762dfcbd58d0ed1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0ed8 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843456.554480:0:10328:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae200/0xa762dfcbd58d0ed1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0ed8 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843456.554488:0:10328:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae200/0xa762dfcbd58d0ed1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0ed8 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843456.554494:0:10328:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788843456.554518:0:10328:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae200/0xa762dfcbd58d0ed1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0ed8 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843456.554524:0:10328:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843456.554543:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae200/0xa762dfcbd58d0ed1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0ed8 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843456.554562:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd10f7ae200/0xa762dfcbd58d0ed1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0ed8 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843456.554576:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843456.554578:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843456.554579:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843456.554617:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134373888:0@lo:103: 00000100:00100000:0.0:1788843456.555372:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843456.555442:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134373632 00000100:00100000:2.0:1788843456.555451:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134373632 00010000:00010000:2.0:1788843456.555480:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd1153e6000/0xa762dfcbd58d0f02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0efb expref: 18 pid: 6500 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843456.555515:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134373760 00000100:00100000:2.0:1788843456.555525:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134373760 00010000:00010000:2.0:1788843456.555538:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd1153e7400/0xa762dfcbd58d0f4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0f48 expref: 19 pid: 6498 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843456.555560:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788843456.555567:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e879f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+19:3630:x1875738134373632:12345-0@lo:103: 00010000:00010000:2.0:1788843456.555578:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843456.555584:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd1153e6000/0xa762dfcbd58d0f02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0efb expref: 19 pid: 6500 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.555594:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd1153e6000/0xa762dfcbd58d0f02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0efb expref: 19 pid: 6500 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.555609:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1153e6000/0xa762dfcbd58d0f02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0efb expref: 19 pid: 6500 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.555623:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843456.555671:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e879f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:3630:x1875738134373632:12345-0@lo:103: Request processed in 104us (2465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843456.555678:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788843456.555693:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788843456.555699:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:3630:x1875738134373760:12345-0@lo:103: 00010000:00010000:2.0:1788843456.555706:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843456.555710:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd1153e7400/0xa762dfcbd58d0f4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0f48 expref: 17 pid: 6498 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.555719:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd1153e7400/0xa762dfcbd58d0f4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0f48 expref: 17 pid: 6498 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.555729:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1153e7400/0xa762dfcbd58d0f4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0f48 expref: 17 pid: 6498 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.555744:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843456.555768:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:3630:x1875738134373760:12345-0@lo:103: Request processed in 70us (1565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843456.555774:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788843456.557980:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134373760:0@lo:103: 00000100:00100000:0.0:1788843456.557998:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134373632:0@lo:103: 00000100:00100000:2.0:1788843456.558051:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134373888 00000100:00100000:2.0:1788843456.558059:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134373888 00010000:00010000:2.0:1788843456.558092:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd100031200/0xa762dfcbd58d0ed8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0ed1 expref: 16 pid: 6500 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843456.558128:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788843456.558180:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:3632:x1875738134373888:12345-0@lo:103: 00010000:00010000:2.0:1788843456.558196:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843456.558200:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd100031200/0xa762dfcbd58d0ed8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0ed1 expref: 16 pid: 6500 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.558210:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd100031200/0xa762dfcbd58d0ed8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0ed1 expref: 16 pid: 6500 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.558226:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd100031200/0xa762dfcbd58d0ed8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0ed1 expref: 16 pid: 6500 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.558242:0:6492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd1153e6a00/0xa762dfcbd58d103d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.558249:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1153e6a00/0xa762dfcbd58d103d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.558264:0:6492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd1153e6a00/0xa762dfcbd58d103d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.558290:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd1153e6a00/0xa762dfcbd58d103d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.558298:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd1153e6a00/0xa762dfcbd58d103d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.558306:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd1153e6a00/0xa762dfcbd58d103d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.558312:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e6a00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843456.558316:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd1153e6a00/0xa762dfcbd58d103d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.558324:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd1153e6a00/0xa762dfcbd58d103d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.558343:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd1153e6a00/0xa762dfcbd58d103d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843456.558354:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843456.558408:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:3632:x1875738134373888:12345-0@lo:103: Request processed in 272us (3037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843456.558415:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788843456.558534:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134373888:0@lo:103: 00010000:00010000:0.0:1788843456.558559:0:10322:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd1153e6a00/0xa762dfcbd58d103d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.558567:0:10322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd1153e6a00/0xa762dfcbd58d103d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.558574:0:10322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1153e6a00/0xa762dfcbd58d103d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843456.668398:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843456.923887:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788843456.923915:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134374016:0@lo:13: 00000100:00100000:2.0:1788843456.924018:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843456.924173:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134374016 00000100:00100000:3.0:1788843456.924190:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134374016 00000100:00100000:3.0:1788843456.924261:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788843456.924274:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134374016:12345-0@lo:13: 00002000:00000024:3.0:1788843456.924303:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843456.924350:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134374016:12345-0@lo:13: Request processed in 80us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843456.924357:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1788843456.924961:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788843456.924997:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0079b8000 x1875738134374016/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843472 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843456.925037:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134374016:0@lo:13: 00000100:00100000:0.0:1788843456.925921:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134374144:0@lo:400: 00000100:00100000:0.0:1788843456.925970:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843456.925996:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134374656:0@lo:400: 00000100:00100000:0.0:1788843456.926014:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843456.926026:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134375168:0@lo:400: 00000100:00100000:0.0:1788843456.926042:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843456.926058:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788843456.926074:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134374272:0@lo:400: 00000100:00100000:0.0:1788843456.926096:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843456.926108:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134374784:0@lo:400: 00000100:00100000:0.0:1788843456.926123:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843456.926172:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134375296:0@lo:400: 00000100:00100000:0.0:1788843456.926486:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843456.926522:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134374144 00000100:00100000:0.0:1788843456.926529:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134374144 00000100:00100000:0.0:1788843456.926559:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134374656 00000100:00100000:0.0:1788843456.926561:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134374656 00000100:00100000:0.0:1788843456.926580:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134375168 00000100:00100000:0.0:1788843456.926583:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134375168 00000100:00100000:0.0:1788843456.926592:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134374784 00000100:00100000:0.0:1788843456.926594:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134374784 00000100:00100000:0.0:1788843456.926608:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788843456.926615:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134374144:12345-0@lo:400: 00000100:00100000:0.0:1788843456.926672:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134374144:12345-0@lo:400: Request processed in 57us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843456.926680:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788843456.926698:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788843456.926704:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134374656:12345-0@lo:400: 00000100:00100000:0.0:1788843456.926747:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134374656:12345-0@lo:400: Request processed in 43us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843456.926753:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788843456.926765:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788843456.926770:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134375168:12345-0@lo:400: 00000100:00100000:0.0:1788843456.926798:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134375168:12345-0@lo:400: Request processed in 28us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843456.926803:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788843456.926813:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788843456.926819:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134374784:12345-0@lo:400: 00000100:00100000:0.0:1788843456.926843:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134374784:12345-0@lo:400: Request processed in 25us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843456.926849:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1788843456.926976:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788843456.926980:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788843456.927003:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00799a300 x1875738134374784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843456.927014:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134374784:0@lo:400: 00000100:00100000:0.0:1788843456.927024:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134374144:0@lo:400: 00000100:00100000:0.0:1788843456.927031:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134374656:0@lo:400: 00010000:00080000:0.0:1788843456.927040:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00799b800 x1875738134375168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843456.927048:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134375168:0@lo:400: 00000100:00100000:3.0:1788843456.927274:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134374272 00000100:00100000:3.0:1788843456.927280:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134374272 00000100:00100000:3.0:1788843456.927316:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788843456.927323:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134374272:12345-0@lo:400: 00000100:00100000:3.0:1788843456.927361:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134374272:12345-0@lo:400: Request processed in 40us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843456.927367:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788843456.927527:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134374272:0@lo:400: 00000100:00100000:2.0:1788843456.927723:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134375296 00000100:00100000:2.0:1788843456.927729:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134375296 00000100:00100000:2.0:1788843456.927775:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788843456.927783:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134375296:12345-0@lo:400: 00000100:00100000:2.0:1788843456.927822:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134375296:12345-0@lo:400: Request processed in 41us (1337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843456.927827:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788843456.929137:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134374528:0@lo:400: 00000100:00100000:1.0:1788843456.929232:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843456.929261:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1875738134375040:0@lo:400: 00000100:00100000:1.0:1788843456.929286:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843456.929311:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788843456.929318:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134374400:0@lo:400: 00000100:00100000:1.0:1788843456.929338:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843456.929355:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134374912:0@lo:400: 00000100:00100000:1.0:1788843456.929379:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843456.929397:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134375424:0@lo:400: 00000100:00100000:1.0:1788843456.929417:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843456.929690:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134374912 00000100:00100000:1.0:1788843456.929699:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134374912 00000100:00100000:1.0:1788843456.929744:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134375424 00000100:00100000:1.0:1788843456.929748:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134375424 00000100:00100000:1.0:1788843456.929765:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788843456.929782:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134374912:12345-0@lo:400: 00000100:00100000:1.0:1788843456.929832:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134374912:12345-0@lo:400: Request processed in 51us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843456.929839:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788843456.929853:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788843456.929859:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134375424:12345-0@lo:400: 00000100:00100000:0.0:1788843456.930211:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134374528 00000100:00100000:0.0:1788843456.930222:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134374528 00000100:00100000:0.0:1788843456.930257:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788843456.930263:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134374528:12345-0@lo:400: 00000100:00100000:0.0:1788843456.930310:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134374528:12345-0@lo:400: Request processed in 47us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843456.930315:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788843456.930359:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134375040 00000100:00100000:0.0:1788843456.930363:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134375040 00000100:00100000:0.0:1788843456.930388:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134374400 00000100:00100000:0.0:1788843456.930391:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134374400 00000100:00100000:0.0:1788843456.930408:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788843456.930413:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875738134375040:12345-0@lo:400: 00000100:00100000:0.0:1788843456.930443:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875738134375040:12345-0@lo:400: Request processed in 30us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843456.930449:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788843456.930460:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788843456.930465:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134374400:12345-0@lo:400: 00000100:00100000:0.0:1788843456.930490:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134374400:12345-0@lo:400: Request processed in 26us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843456.930495:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788843456.930570:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134374400:0@lo:400: 00010000:00080000:0.0:1788843456.930584:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007998700 x1875738134374912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843456.930594:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134374912:0@lo:400: 00000100:00100000:0.0:1788843456.930604:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134374528:0@lo:400: 00000100:00100000:0.0:1788843456.930612:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1875738134375040:0@lo:400: 00010000:00080000:0.0:1788843456.930775:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00799b480 x1875738134375296/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843456.930785:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134375296:0@lo:400: 00000100:00080000:3.0:1788843456.930962:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788843456.930967:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788843456.930969:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788843456.933825:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134375424:12345-0@lo:400: Request processed in 3958us (4399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843456.933838:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1788843456.935204:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007999880 x1875738134375424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843456.935222:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134375424:0@lo:400: 00000100:00100000:3.0:1788843457.434504:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788843457.434531:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134375552:0@lo:13: 00000100:00100000:3.0:1788843457.434609:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843457.434820:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134375680:0@lo:13: 00000100:00100000:3.0:1788843457.434824:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134375808:0@lo:13: 00000100:00100000:0.0:1788843457.434861:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843457.434926:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134375552 00000100:00100000:2.0:1788843457.434934:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134375552 00000100:00100000:1.0:1788843457.434952:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134375680 00000100:00100000:1.0:1788843457.434959:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134375680 00000100:00100000:2.0:1788843457.434981:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788843457.434994:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134375552:12345-0@lo:13: 00000100:00100000:1.0:1788843457.435000:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788843457.435012:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134375680:12345-0@lo:13: 00002000:00000024:2.0:1788843457.435018:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1788843457.435032:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788843457.440383:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134375552:12345-0@lo:13: Request processed in 5383us (5764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843457.440399:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1788843457.440727:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f8d2300 x1875738134375552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843473 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843457.440754:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134375552:0@lo:13: 00000100:00100000:1.0:1788843457.445796:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134375680:12345-0@lo:13: Request processed in 10771us (10917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843457.445812:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1788843457.447556:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0059df480 x1875738134375680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843473 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843457.447584:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134375680:0@lo:13: 00000100:00100000:3.0:1788843457.449600:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843457.450115:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134375808 00000100:00100000:1.0:1788843457.450124:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134375808 00000100:00100000:1.0:1788843457.450274:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788843457.450287:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134375808:12345-0@lo:13: 00002000:00000024:1.0:1788843457.450315:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788843457.450407:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134375808:12345-0@lo:13: Request processed in 124us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843457.450414:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1788843457.450490:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd13e877100 x1875738134375808/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843473 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843457.450513:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134375808:0@lo:13: 00000100:00100000:2.0:1788843457.454078:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843457.454238:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116494848 00000100:00100000:0.0:1788843457.454253:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116494848 00000100:00100000:0.0:1788843457.454326:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 201 00000100:00100000:0.0:1788843457.454338:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+8:6164:x1875738116494848:12345-192.168.203.33@tcp:101: 00010000:00010000:0.0:1788843457.454361:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843457.454386:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd10fa3c600/0xa762dfcbd58d1044 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf24d95f224907d0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843457.454422:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd10fa3c600/0xa762dfcbd58d1044 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224907d0 expref: 9 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843457.454444:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd10fa3c600/0xa762dfcbd58d1044 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224907d0 expref: 9 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843457.454456:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3c600, rc 0) 00000100:00100000:0.0:1788843457.454556:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+9:6164:x1875738116494848:12345-192.168.203.33@tcp:101: Request processed in 220us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843457.454564:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 201 00000100:00100000:2.0:1788843457.463026:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843457.470575:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116494976 00000100:00100000:0.0:1788843457.470598:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116494976 00000100:00100000:0.0:1788843457.471122:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 202 00000100:00100000:0.0:1788843457.471177:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+9:6164:x1875738116494976:12345-192.168.203.33@tcp:501: 00000100:00100000:0.0:1788843457.471395:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+9:6164:x1875738116494976:12345-192.168.203.33@tcp:501: Request processed in 262us (8380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843457.471404:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 202 00000100:00100000:1.0:1788843457.474726:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843457.478083:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116495104 00000100:00100000:2.0:1788843457.478104:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116495104 00000100:00100000:2.0:1788843457.478209:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 203 00000100:00100000:2.0:1788843457.478222:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+9:6164:x1875738116495104:12345-192.168.203.33@tcp:503: 00000100:00100000:2.0:1788843457.478415:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+9:6164:x1875738116495104:12345-192.168.203.33@tcp:503: Request processed in 195us (3702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843457.478423:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 203 00000100:00100000:1.0:1788843457.489984:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843457.490276:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116495232 00000100:00100000:2.0:1788843457.490289:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116495232 00000100:00100000:2.0:1788843457.490362:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 204 00000100:00100000:2.0:1788843457.490373:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+9:6638:x1875738116495232:12345-192.168.203.33@tcp:502: 00000100:00100000:2.0:1788843457.490571:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+9:6638:x1875738116495232:12345-192.168.203.33@tcp:502: Request processed in 199us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843457.490579:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 204 00000100:00100000:1.0:1788843457.494372:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843457.494474:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116495360 00000100:00100000:3.0:1788843457.494486:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116495360 00000100:00100000:3.0:1788843457.494555:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 205 00000100:00100000:3.0:1788843457.494567:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+9:6638:x1875738116495360:12345-192.168.203.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788843457.494766:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+9:6638:x1875738116495360:12345-192.168.203.33@tcp:502:llog_process_th.0 Request processed in 200us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843457.494776:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 205 00000100:00100000:1.0:1788843457.497886:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843457.498539:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116495488 00000100:00100000:0.0:1788843457.498554:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116495488 00000100:00100000:1.0:1788843457.498901:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 206 00000100:00100000:1.0:1788843457.498915:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+9:6164:x1875738116495488:12345-192.168.203.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843457.498936:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843457.498960:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd13fb35200/0xa762dfcbd58d104b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf24d95f224907d7 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843457.498997:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd13fb35200/0xa762dfcbd58d104b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224907d7 expref: 10 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843457.499009:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd13fb35200/0xa762dfcbd58d104b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224907d7 expref: 10 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843457.499019:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fb35200, rc 0) 00000100:00100000:1.0:1788843457.499104:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+10:6164:x1875738116495488:12345-192.168.203.33@tcp:101:ll_cfg_requeue.0 Request processed in 191us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843457.499112:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 206 00000100:00100000:2.0:1788843457.501413:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843457.501599:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116495616 00000100:00100000:0.0:1788843457.501615:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116495616 00000100:00100000:0.0:1788843457.501727:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 207 00000100:00100000:0.0:1788843457.501739:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+10:6164:x1875738116495616:12345-192.168.203.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843457.501899:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+10:6164:x1875738116495616:12345-192.168.203.33@tcp:501:ll_cfg_requeue.0 Request processed in 162us (500us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788843457.501907:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 207 10000000:01000000:2.0:1788843457.691196:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788843457.691208:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd006461000 from 48 10000000:01000000:2.0:1788843457.691216:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788843457.691287:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d1052 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843457.691301:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d1052 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843457.691314:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d1052 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843457.691343:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e875880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134375936:0@lo:101: 00000100:00100000:2.0:1788843457.691430:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788843457.691542:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843457.692257:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007014900 going to sleep for 11 seconds 00000100:00100000:0.0:1788843457.692814:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134375936 00000100:00100000:0.0:1788843457.692958:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134375936 00000100:00100000:0.0:1788843457.693078:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788843457.693108:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+15:6503:x1875738134375936:12345-0@lo:101: 00010000:00010000:0.0:1788843457.693129:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843457.693189:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd10fa3c000/0xa762dfcbd58d1059 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d1052 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843457.693249:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd10fa3c000/0xa762dfcbd58d1059 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d1052 expref: 16 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843457.693263:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd10fa3c000/0xa762dfcbd58d1059 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d1052 expref: 16 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843457.693275:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3c000, rc 0) 00000100:00100000:0.0:1788843457.693415:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:6503:x1875738134375936:12345-0@lo:101: Request processed in 308us (1983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843457.693422:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788843457.694353:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e875880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134375936:0@lo:101: 00010000:00010000:3.0:1788843457.694385:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d1052 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d1059 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843457.694398:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d1052 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d1059 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843457.694789:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134376064:0@lo:501: 00000100:00100000:3.0:1788843457.694975:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843457.695615:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788843457.695902:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134376064 00000100:00100000:2.0:1788843457.695912:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134376064 00000100:00100000:0.0:1788843457.696264:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788843457.696282:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:6503:x1875738134376064:12345-0@lo:501: 00000100:00100000:0.0:1788843457.696501:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:6503:x1875738134376064:12345-0@lo:501: Request processed in 218us (1519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843457.696509:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788843457.697015:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134376064:0@lo:501: 00000100:00100000:3.0:1788843457.697265:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134376192:0@lo:503: 00000100:00100000:3.0:1788843457.697343:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843457.697391:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788843457.697473:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134376192 00000100:00100000:1.0:1788843457.697481:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134376192 00000100:00100000:1.0:1788843457.697533:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788843457.697541:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:6503:x1875738134376192:12345-0@lo:503: 00000100:00100000:1.0:1788843457.698001:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:6503:x1875738134376192:12345-0@lo:503: Request processed in 458us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843457.698009:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788843457.698484:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134376192:0@lo:503: 00000100:00100000:3.0:1788843457.699518:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10341:1875738134376320:0@lo:502: 00000100:00100000:3.0:1788843457.699603:0:10341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843457.699975:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134376320 00000100:00100000:1.0:1788843457.699984:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134376320 00000100:00100000:1.0:1788843457.700035:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788843457.700045:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:10341:x1875738134376320:12345-0@lo:502: 00000100:00100000:1.0:1788843457.701555:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:10341:x1875738134376320:12345-0@lo:502: Request processed in 1388us (1830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843457.701572:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788843457.702030:0:10341:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0078936c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843457.702067:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10341:1875738134376320:0@lo:502: 00000100:00100000:3.0:1788843457.702384:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10341:1875738134376448:0@lo:502: 00000100:00100000:3.0:1788843457.702571:0:10341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843457.702802:0:10341:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1106d0600 going to sleep for 11 seconds 00000100:00100000:2.0:1788843457.702994:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134376448 00000100:00100000:2.0:1788843457.703004:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134376448 00000100:00100000:2.0:1788843457.703394:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788843457.703407:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:10341:x1875738134376448:12345-0@lo:502: 00000100:00100000:2.0:1788843457.703579:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:10341:x1875738134376448:12345-0@lo:502: Request processed in 175us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843457.703587:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788843457.704029:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10341:1875738134376448:0@lo:502: 00000040:00080000:3.0:1788843457.704071:0:10341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788843457.704466:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788843457.704505:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788843457.704519:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d1052 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d1059 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843457.704532:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d1052 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d1059 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843457.704543:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788843457.704546:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1788843457.704550:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788843457.704592:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35c00/0xa762dfcbd58d1060 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843457.704601:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35c00/0xa762dfcbd58d1060 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843457.704611:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35c00/0xa762dfcbd58d1060 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843457.705117:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134376576:0@lo:101: 00000100:00100000:1.0:1788843457.705237:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843457.705812:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1092b8840 going to sleep for 11 seconds 00000100:00100000:0.0:1788843457.706022:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134376576 00000100:00100000:0.0:1788843457.706033:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134376576 00000100:00100000:0.0:1788843457.706191:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788843457.706204:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+16:6503:x1875738134376576:12345-0@lo:101: 00010000:00010000:0.0:1788843457.706224:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843457.706245:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd10fa3de00/0xa762dfcbd58d1067 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d1060 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843457.706279:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd10fa3de00/0xa762dfcbd58d1067 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d1060 expref: 17 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843457.706291:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd10fa3de00/0xa762dfcbd58d1067 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d1060 expref: 17 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843457.706316:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3de00, rc 0) 00000100:00100000:0.0:1788843457.706382:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:6503:x1875738134376576:12345-0@lo:101: Request processed in 180us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843457.706388:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788843457.707397:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134376576:0@lo:101: 00010000:00010000:1.0:1788843457.707800:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35c00/0xa762dfcbd58d1060 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d1067 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843457.707825:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35c00/0xa762dfcbd58d1060 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d1067 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843457.708042:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134376704:0@lo:501: 00000100:00100000:1.0:1788843457.708227:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843457.708277:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1092b8840 going to sleep for 11 seconds 00000100:00100000:2.0:1788843457.708378:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134376704 00000100:00100000:2.0:1788843457.708387:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134376704 00000100:00100000:0.0:1788843457.708604:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788843457.708619:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:6503:x1875738134376704:12345-0@lo:501: 00000100:00100000:0.0:1788843457.709316:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:6503:x1875738134376704:12345-0@lo:501: Request processed in 698us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843457.709325:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788843457.709785:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134376704:0@lo:501: 00000100:00100000:1.0:1788843457.709977:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134376832:0@lo:503: 00000100:00100000:1.0:1788843457.710045:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843457.710270:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1092b8840 going to sleep for 11 seconds 00000100:00100000:3.0:1788843457.710768:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134376832 00000100:00100000:3.0:1788843457.710779:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134376832 00000100:00100000:3.0:1788843457.711015:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788843457.711028:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:6503:x1875738134376832:12345-0@lo:503: 00000100:00100000:3.0:1788843457.711643:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:6503:x1875738134376832:12345-0@lo:503: Request processed in 615us (1595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843457.711664:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788843457.712010:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134376832:0@lo:503: 00000100:00100000:3.0:1788843457.714321:0:10342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10342:1875738134376960:0@lo:502: 00000100:00100000:3.0:1788843457.715057:0:10342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843457.715278:0:10342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788843457.715394:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134376960 00000100:00100000:2.0:1788843457.715405:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134376960 00000100:00100000:2.0:1788843457.715525:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788843457.715537:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:10342:x1875738134376960:12345-0@lo:502: 00000100:00100000:2.0:1788843457.715899:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:10342:x1875738134376960:12345-0@lo:502: Request processed in 363us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843457.715908:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788843457.716324:0:10342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10342:1875738134376960:0@lo:502: 00000020:01000000:3.0:1788843457.716373:0:10342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788843457.716394:0:10342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843457.716397:0:10342:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788843457.716405:0:10342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788843457.716446:0:10342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10342:1875738134377088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843457.716508:0:10342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843457.720119:0:10342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788843457.720775:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134377088 00000100:00100000:0.0:1788843457.720789:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134377088 00000100:00100000:0.0:1788843457.720999:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788843457.721016:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:10342:x1875738134377088:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843457.721288:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:10342:x1875738134377088:12345-0@lo:502:llog_process_th.0 Request processed in 276us (4779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843457.721296:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788843457.721618:0:10342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10342:1875738134377088:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788843457.721670:0:10342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843457.721679:0:10342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843457.721681:0:10342:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788843457.721687:0:10342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1788843457.722191:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1788843457.722220:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788843457.722233:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35c00/0xa762dfcbd58d1060 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d1067 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843457.722247:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35c00/0xa762dfcbd58d1060 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d1067 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843457.722258:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788843457.722261:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd10c0f0000 from 48 10000000:01000000:0.0:1788843457.722275:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788843457.722324:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d600/0xa762dfcbd58d106e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843457.722334:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d600/0xa762dfcbd58d106e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843457.722344:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d600/0xa762dfcbd58d106e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843457.722368:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134377216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788843457.722430:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843457.722617:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007475300 going to sleep for 11 seconds 00000100:00100000:3.0:1788843457.722808:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134377216 00000100:00100000:3.0:1788843457.722826:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134377216 00000100:00100000:3.0:1788843457.722867:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788843457.722875:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+17:6503:x1875738134377216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843457.723010:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843457.723027:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd10f7ae200/0xa762dfcbd58d1075 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d106e expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843457.723061:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd10f7ae200/0xa762dfcbd58d1075 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d106e expref: 18 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843457.723073:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd10f7ae200/0xa762dfcbd58d1075 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d106e expref: 18 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843457.723177:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10f7ae200, rc 0) 00000100:00100000:3.0:1788843457.723242:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:6503:x1875738134377216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 367us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843457.723249:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788843457.726278:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134377216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843457.726322:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d600/0xa762dfcbd58d106e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d1075 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843457.726338:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d600/0xa762dfcbd58d106e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d1075 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843457.726471:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134377344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843457.726566:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843457.726623:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007475300 going to sleep for 11 seconds 00000100:00100000:3.0:1788843457.726846:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134377344 00000100:00100000:3.0:1788843457.726855:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134377344 00000100:00100000:3.0:1788843457.726926:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788843457.726938:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:6503:x1875738134377344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843457.727125:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:6503:x1875738134377344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 189us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843457.727133:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788843457.727796:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134377344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843457.728048:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134377472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843457.729395:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843457.730228:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007475300 going to sleep for 11 seconds 00000100:00100000:3.0:1788843457.731024:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134377472 00000100:00100000:3.0:1788843457.731041:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134377472 00000100:00100000:3.0:1788843457.731794:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788843457.731828:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:6503:x1875738134377472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788843457.732398:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:6503:x1875738134377472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 589us (3010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843457.732408:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788843457.732550:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134377472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843457.739976:0:10343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079baa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10343:1875738134377600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843457.741051:0:10343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843457.741128:0:10343:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0074759c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843457.742696:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134377600 00000100:00100000:2.0:1788843457.742715:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134377600 00000100:00100000:2.0:1788843457.742803:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788843457.743243:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:10343:x1875738134377600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843457.743484:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:10343:x1875738134377600:12345-0@lo:502:llog_process_th.0 Request processed in 668us (2439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843457.743493:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788843457.744594:0:10343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079baa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10343:1875738134377600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843457.744714:0:10343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079baa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10343:1875738134377728:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843457.744784:0:10343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843457.745504:0:10343:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0074759c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843457.749044:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134377728 00000100:00100000:3.0:1788843457.749069:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134377728 00000100:00100000:3.0:1788843457.749541:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788843457.749556:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:10343:x1875738134377728:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843457.751316:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:10343:x1875738134377728:12345-0@lo:502:llog_process_th.0 Request processed in 1752us (6520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843457.751332:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788843457.751536:0:10343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079baa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10343:1875738134377728:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788843457.751586:0:10343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788843457.751981:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788843457.752007:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788843457.752021:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d600/0xa762dfcbd58d106e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d1075 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843457.752051:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d600/0xa762dfcbd58d106e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d1075 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843457.752063:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788843457.752066:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1788843457.752070:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788843457.752224:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946000/0xa762dfcbd58d107c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843457.752233:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd007946000/0xa762dfcbd58d107c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843457.752242:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd007946000/0xa762dfcbd58d107c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843457.752267:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e874a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134377856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788843457.752332:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843457.752417:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007014780 going to sleep for 11 seconds 00000100:00100000:3.0:1788843457.752560:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134377856 00000100:00100000:3.0:1788843457.752569:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134377856 00000100:00100000:1.0:1788843457.757118:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788843457.757349:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+18:6503:x1875738134377856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843457.757376:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843457.757401:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007947a00/0xa762dfcbd58d1083 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d107c expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843457.757442:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007947a00/0xa762dfcbd58d1083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d107c expref: 19 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843457.757456:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007947a00/0xa762dfcbd58d1083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d107c expref: 19 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843457.757487:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007947a00, rc 0) 00000100:00100000:2.0:1788843457.757600:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+19:6503:x1875738134377856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 465us (5266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843457.757608:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788843457.757832:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e874a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134377856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843457.757859:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd007946000/0xa762dfcbd58d107c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d1083 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843457.757870:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd007946000/0xa762dfcbd58d107c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d1083 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843457.757981:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134377984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843457.758022:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843457.758068:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0074759c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843457.758363:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134377984 00000100:00100000:2.0:1788843457.758372:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134377984 00000100:00100000:2.0:1788843457.758423:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788843457.758432:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+19:6503:x1875738134377984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843457.758600:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+19:6503:x1875738134377984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 168us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843457.758608:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788843457.758858:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134377984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788843457.759010:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134378112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788843457.759065:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843457.759107:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd105a65900 going to sleep for 11 seconds 00000100:00100000:2.0:1788843457.760057:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134378112 00000100:00100000:2.0:1788843457.760070:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134378112 00000100:00100000:2.0:1788843457.760274:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788843457.760284:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+19:6503:x1875738134378112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843457.760432:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+19:6503:x1875738134378112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843457.760440:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788843457.760807:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134378112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788843457.765748:0:10344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10344:1875738134378240:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843457.765995:0:10344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843457.766462:0:10344:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd105a65900 going to sleep for 11 seconds 00000100:00100000:2.0:1788843457.766724:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134378240 00000100:00100000:2.0:1788843457.766733:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134378240 00000100:00100000:2.0:1788843457.766962:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788843457.766975:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+19:10344:x1875738134378240:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843457.767405:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+19:10344:x1875738134378240:12345-0@lo:502:llog_process_th.0 Request processed in 429us (1408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843457.767415:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788843457.767607:0:10344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10344:1875738134378240:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788843457.767726:0:10344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843457.767738:0:10344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843457.767741:0:10344:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788843457.767750:0:10344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788843457.767788:0:10344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10344:1875738134378368:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843457.767965:0:10344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843457.768051:0:10344:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd111699540 going to sleep for 11 seconds 00000100:00100000:2.0:1788843457.768193:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134378368 00000100:00100000:2.0:1788843457.768199:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134378368 00000100:00100000:2.0:1788843457.768237:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788843457.768246:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+19:10344:x1875738134378368:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843457.768330:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+19:10344:x1875738134378368:12345-0@lo:502:llog_process_th.0 Request processed in 85us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843457.768337:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788843457.768518:0:10344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10344:1875738134378368:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788843457.768539:0:10344:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843457.768545:0:10344:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843457.768547:0:10344:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788843457.768552:0:10344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:2.0:1788843457.768936:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788843457.768968:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788843457.768981:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946000/0xa762dfcbd58d107c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d1083 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843457.768995:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007946000/0xa762dfcbd58d107c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d1083 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843457.769007:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788843457.769010:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd12e2b3800 from 48 10000000:01000000:2.0:1788843457.769013:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788843457.769048:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d108a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843457.769057:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d108a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843457.769067:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d108a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843457.769366:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e874a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134378496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788843457.769419:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843457.769483:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007014c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788843457.769591:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134378496 00000100:00100000:1.0:1788843457.769598:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134378496 00000100:00100000:1.0:1788843457.769652:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788843457.769662:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+19:6503:x1875738134378496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843457.769676:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843457.769693:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd13fb35000/0xa762dfcbd58d1091 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d108a expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843457.769722:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd13fb35000/0xa762dfcbd58d1091 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d108a expref: 20 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843457.769734:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd13fb35000/0xa762dfcbd58d1091 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d108a expref: 20 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843457.769745:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fb35000, rc 0) 00000100:00100000:1.0:1788843457.769783:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:6503:x1875738134378496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843457.769796:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788843457.770283:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e874a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134378496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843457.770303:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d108a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d1091 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843457.770316:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d108a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d1091 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843457.770388:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e874a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134378624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843457.770420:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843457.770511:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007014c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788843457.770531:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134378624 00000100:00100000:2.0:1788843457.770535:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134378624 00000100:00100000:2.0:1788843457.770571:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788843457.770580:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:6503:x1875738134378624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843457.770922:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:6503:x1875738134378624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 340us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843457.770930:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788843457.774573:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e874a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134378624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788843457.774773:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134378752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788843457.774899:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843457.775058:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd111699cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843457.779990:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134378752 00000100:00100000:2.0:1788843457.780012:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134378752 00000100:00100000:2.0:1788843457.780764:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788843457.780781:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:6503:x1875738134378752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843457.781024:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:6503:x1875738134378752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 246us (6124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843457.781122:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134378752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788843457.782399:0:10345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10345:1875738134378880:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843457.782508:0:10345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843457.782553:0:10345:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd111699c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788843457.785358:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134378880 00000100:00100000:0.0:1788843457.785380:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134378880 00000100:00100000:0.0:1788843457.785443:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788843457.785457:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:10345:x1875738134378880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843457.785718:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788843457.785769:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:10345:x1875738134378880:12345-0@lo:502:llog_process_th.0 Request processed in 249us (3195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843457.785786:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788843457.787979:0:10345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10345:1875738134378880:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843457.788100:0:10345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10345:1875738134379008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843457.788214:0:10345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843457.788256:0:10345:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd109144000 going to sleep for 11 seconds 00000100:00100000:2.0:1788843457.788499:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134379008 00000100:00100000:2.0:1788843457.788509:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134379008 00000100:00100000:2.0:1788843457.788583:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788843457.788594:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:10345:x1875738134379008:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843457.788751:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:10345:x1875738134379008:12345-0@lo:502:llog_process_th.0 Request processed in 158us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843457.788759:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788843457.789011:0:10345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10345:1875738134379008:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788843457.789050:0:10345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788843457.789384:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788843457.789415:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788843457.789429:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d108a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d1091 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843457.789468:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d108a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d1091 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843457.789482:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788843457.789485:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1788843457.789489:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788843457.789528:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aec00/0xa762dfcbd58d1098 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843457.789538:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aec00/0xa762dfcbd58d1098 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843457.789549:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aec00/0xa762dfcbd58d1098 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843457.789570:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134379136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788843457.789620:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843457.789668:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd11ae64a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788843457.789991:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134379136 00000100:00100000:1.0:1788843457.789999:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134379136 00000100:00100000:1.0:1788843457.790054:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788843457.790065:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:6503:x1875738134379136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843457.790088:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843457.790106:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd13fb34400/0xa762dfcbd58d109f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d1098 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843457.790203:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd13fb34400/0xa762dfcbd58d109f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d1098 expref: 21 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843457.790215:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd13fb34400/0xa762dfcbd58d109f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d1098 expref: 21 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843457.790227:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fb34400, rc 0) 00000100:00100000:1.0:1788843457.790293:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:6503:x1875738134379136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 230us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843457.790300:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788843457.790517:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134379136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843457.790533:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aec00/0xa762dfcbd58d1098 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d109f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843457.790544:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aec00/0xa762dfcbd58d1098 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d109f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843457.790612:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134379264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843457.790654:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843457.790690:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd11ae64a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788843457.790839:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134379264 00000100:00100000:1.0:1788843457.790844:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134379264 00000100:00100000:1.0:1788843457.790867:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788843457.790874:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:6503:x1875738134379264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788843457.791043:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:6503:x1875738134379264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 169us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843457.791050:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788843457.792092:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134379264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843457.792188:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134379392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788843457.792261:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843457.792303:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd11ae64a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788843457.792502:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134379392 00000100:00100000:0.0:1788843457.792510:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134379392 00000100:00100000:0.0:1788843457.792557:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788843457.792567:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:6503:x1875738134379392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843457.792701:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:6503:x1875738134379392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843457.792708:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788843457.793026:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134379392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788843457.796790:0:10346:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10346:1875738134379520:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843457.797016:0:10346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843457.797800:0:10346:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd11ae64600 going to sleep for 11 seconds 00000100:00100000:0.0:1788843457.797926:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134379520 00000100:00100000:0.0:1788843457.797939:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134379520 00000100:00100000:0.0:1788843457.798021:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788843457.798383:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:10346:x1875738134379520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843457.798793:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:10346:x1875738134379520:12345-0@lo:502:llog_process_th.0 Request processed in 760us (1775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843457.798802:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788843457.802655:0:10346:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10346:1875738134379520:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788843457.802723:0:10346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788843457.802738:0:10346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843457.802740:0:10346:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788843457.802749:0:10346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788843457.802795:0:10346:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10346:1875738134379648:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843457.802997:0:10346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843457.803063:0:10346:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893600 going to sleep for 11 seconds 00000100:00100000:0.0:1788843457.804200:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134379648 00000100:00100000:0.0:1788843457.804214:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134379648 00000100:00100000:0.0:1788843457.804278:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788843457.804288:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:10346:x1875738134379648:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843457.804466:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:10346:x1875738134379648:12345-0@lo:502:llog_process_th.0 Request processed in 178us (1468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843457.804475:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788843457.804954:0:10346:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10346:1875738134379648:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788843457.804996:0:10346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843457.805004:0:10346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843457.805007:0:10346:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788843457.805013:0:10346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1788843457.807124:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1788843457.807235:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788843457.807251:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aec00/0xa762dfcbd58d1098 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d109f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843457.807286:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aec00/0xa762dfcbd58d1098 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d109f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843457.807300:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788843457.807304:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd118db4800 from 48 10000000:01000000:0.0:1788843457.807307:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788843457.807358:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d400/0xa762dfcbd58d10a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843457.807368:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d400/0xa762dfcbd58d10a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843457.807379:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d400/0xa762dfcbd58d10a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843457.807409:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079b8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134379776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788843457.807491:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843457.807550:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007475b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788843457.807936:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134379776 00000100:00100000:2.0:1788843457.807947:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134379776 00000100:00100000:2.0:1788843457.808011:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788843457.808022:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:6503:x1875738134379776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843457.808046:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843457.808063:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007946400/0xa762dfcbd58d10ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d10a6 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843457.808094:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007946400/0xa762dfcbd58d10ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d10a6 expref: 22 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843457.808105:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007946400/0xa762dfcbd58d10ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d10a6 expref: 22 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843457.808115:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007946400, rc 0) 00000100:00100000:2.0:1788843457.808211:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:6503:x1875738134379776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843457.808220:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788843457.808513:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079b8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134379776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843457.808531:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d400/0xa762dfcbd58d10a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d10ad expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843457.808559:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d400/0xa762dfcbd58d10a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d10ad expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843457.808641:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134379904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843457.808687:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843457.808719:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893600 going to sleep for 11 seconds 00000100:00100000:2.0:1788843457.808963:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134379904 00000100:00100000:2.0:1788843457.808969:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134379904 00000100:00100000:2.0:1788843457.809009:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788843457.809018:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:6503:x1875738134379904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843457.809215:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:6503:x1875738134379904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 198us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843457.809233:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788843457.809666:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134379904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843457.809706:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e875880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134380032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843457.809753:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843457.809783:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00747c000 going to sleep for 11 seconds 00000100:00100000:3.0:1788843457.809937:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134380032 00000100:00100000:3.0:1788843457.809942:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134380032 00000100:00100000:3.0:1788843457.809976:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788843457.809983:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:6503:x1875738134380032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788843457.810075:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:6503:x1875738134380032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843457.810081:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788843457.810298:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e875880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134380032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843457.813325:0:10347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e875880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10347:1875738134380160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843457.813434:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843457.813487:0:10347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00747cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788843457.813620:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134380160 00000100:00100000:3.0:1788843457.813629:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134380160 00000100:00100000:3.0:1788843457.813700:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788843457.813712:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:10347:x1875738134380160:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843457.813886:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:10347:x1875738134380160:12345-0@lo:502:llog_process_th.0 Request processed in 176us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843457.813895:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788843457.814186:0:10347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e875880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10347:1875738134380160:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843457.814246:0:10347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079b9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10347:1875738134380288:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843457.814284:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843457.814316:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134380288 00000100:00100000:0.0:1788843457.814320:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134380288 00000100:00100000:0.0:1788843457.814347:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788843457.814354:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:10347:x1875738134380288:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843457.814422:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:10347:x1875738134380288:12345-0@lo:502:llog_process_th.0 Request processed in 67us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843457.814436:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788843457.814472:0:10347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007475780 going to sleep for 11 seconds 00000100:00100000:0.0:1788843457.814484:0:10347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079b9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10347:1875738134380288:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788843457.814502:0:10347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788843457.815611:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788843457.815669:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788843457.815688:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d400/0xa762dfcbd58d10a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d10ad expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843457.815702:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d400/0xa762dfcbd58d10a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d10ad expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843457.815732:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788843457.815736:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1788843457.815739:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788843457.815785:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aea00/0xa762dfcbd58d10b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843457.815794:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aea00/0xa762dfcbd58d10b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843457.815805:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aea00/0xa762dfcbd58d10b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843457.815836:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007999c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134380416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788843457.815901:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843457.815948:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788843457.815999:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134380416 00000100:00100000:3.0:1788843457.816007:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134380416 00000100:00100000:3.0:1788843457.816049:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788843457.816059:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:6503:x1875738134380416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843457.816073:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843457.816088:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd10f7af800/0xa762dfcbd58d10bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d10b4 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843457.816117:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd10f7af800/0xa762dfcbd58d10bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d10b4 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843457.816129:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd10f7af800/0xa762dfcbd58d10bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d10b4 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843457.816193:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10f7af800, rc 0) 00000100:00100000:3.0:1788843457.816234:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:6503:x1875738134380416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843457.816240:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788843457.816279:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007999c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134380416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843457.816292:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aea00/0xa762dfcbd58d10b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d10bb expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843457.816302:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aea00/0xa762dfcbd58d10b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d10bb expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843457.816359:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007999c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134380544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843457.816388:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843457.816396:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788843457.816410:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134380544 00000100:00100000:3.0:1788843457.816414:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134380544 00000100:00100000:3.0:1788843457.816429:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788843457.816435:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:6503:x1875738134380544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843457.816562:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:6503:x1875738134380544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843457.816569:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788843457.816589:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007999c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134380544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843457.816615:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007999c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134380672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788843457.816653:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843457.816669:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788843457.816684:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134380672 00000100:00100000:3.0:1788843457.816688:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134380672 00000100:00100000:3.0:1788843457.816701:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788843457.816706:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:6503:x1875738134380672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788843457.816785:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:6503:x1875738134380672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843457.816792:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788843457.816825:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007999c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134380672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788843457.817058:0:10348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007999c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10348:1875738134380800:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843457.817093:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843457.817111:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134380800 00000100:00100000:3.0:1788843457.817115:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134380800 00000100:00100000:3.0:1788843457.817137:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788843457.817183:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:10348:x1875738134380800:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843457.817277:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:10348:x1875738134380800:12345-0@lo:502:llog_process_th.0 Request processed in 94us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843457.817282:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788843457.817316:0:10348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893180 going to sleep for 11 seconds 00000100:00100000:3.0:1788843457.817328:0:10348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007999c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10348:1875738134380800:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788843457.817350:0:10348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788843457.817360:0:10348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843457.817363:0:10348:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788843457.817371:0:10348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788843457.817395:0:10348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007999c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10348:1875738134380928:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843457.817427:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843457.817452:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134380928 00000100:00100000:3.0:1788843457.817456:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134380928 00000100:00100000:3.0:1788843457.817472:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788843457.817479:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:10348:x1875738134380928:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843457.817536:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:10348:x1875738134380928:12345-0@lo:502:llog_process_th.0 Request processed in 56us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843457.817543:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788843457.817567:0:10348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893180 going to sleep for 11 seconds 00000100:00100000:3.0:1788843457.817579:0:10348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007999c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10348:1875738134380928:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788843457.817595:0:10348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843457.817599:0:10348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843457.817601:0:10348:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788843457.817606:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788843457.817662:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:3.0:1788843457.817679:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788843457.817689:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aea00/0xa762dfcbd58d10b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d10bb expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843457.817700:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aea00/0xa762dfcbd58d10b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d10bb expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843457.817711:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788843457.817714:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9bd13339b370 from 1 10000000:01000000:3.0:1788843457.817717:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788843457.817742:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aee00/0xa762dfcbd58d10c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843457.817751:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aee00/0xa762dfcbd58d10c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843457.817771:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aee00/0xa762dfcbd58d10c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843457.817784:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007999c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134381056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788843457.817810:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843457.817823:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893180 going to sleep for 11 seconds 00000100:00100000:3.0:1788843457.817834:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134381056 00000100:00100000:3.0:1788843457.817837:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134381056 00000100:00100000:3.0:1788843457.817854:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788843457.817860:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:6503:x1875738134381056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843457.817868:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843457.817880:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd10f7ae800/0xa762dfcbd58d10c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d10c2 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843457.817902:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd10f7ae800/0xa762dfcbd58d10c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d10c2 expref: 24 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843457.817912:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd10f7ae800/0xa762dfcbd58d10c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d10c2 expref: 24 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843457.817920:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10f7ae800, rc 0) 00000100:00100000:3.0:1788843457.817947:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:6503:x1875738134381056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843457.817953:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788843457.817981:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007999c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134381056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843457.817992:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aee00/0xa762dfcbd58d10c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d10c9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843457.818008:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aee00/0xa762dfcbd58d10c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d10c9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843457.818051:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007999c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134381184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843457.818077:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843457.818089:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893180 going to sleep for 11 seconds 00000100:00100000:3.0:1788843457.818099:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134381184 00000100:00100000:3.0:1788843457.818102:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134381184 00000100:00100000:3.0:1788843457.818119:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788843457.818124:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:6503:x1875738134381184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843457.818231:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:6503:x1875738134381184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (153us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788843457.818237:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788843457.818262:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007999c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134381184:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788843457.818286:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788843457.818291:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aee00/0xa762dfcbd58d10c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d10c9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843457.818297:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aee00/0xa762dfcbd58d10c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d10c9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843458.458495:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788843458.458540:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134381312:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788843458.458636:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843458.458723:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134381312 00000100:00100000:2.0:1788843458.458733:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134381312 00000100:00100000:2.0:1788843458.458795:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788843458.458807:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134381312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788843458.458849:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788843458.458902:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134381312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843458.458910:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788843458.458969:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134381312:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788843458.459608:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788843458.459623:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134381440:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788843458.459672:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843458.461858:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134381440 00000100:00100000:1.0:1788843458.461878:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134381440 00000100:00100000:1.0:1788843458.461958:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788843458.461970:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00799bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134381440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788843458.462029:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788843458.462136:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00799bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134381440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 168us (2464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843458.462173:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788843458.462234:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134381440:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788843458.714970:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788843458.741458:0:10385:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe68a87c10 20000000:00000080:3.0:1788843458.741489:0:10385:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bd10fe02400 uarg=0000000000000000 20000000:01000000:3.0:1788843458.741543:0:10385:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788843458.741551:0:10385:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788843458.741557:0:10385:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788843458.742403:0:10386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1788843458.742606:0:10385:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1788843458.750748:0:10385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1788843458.752288:0:10385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1788843458.752342:0:10385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1788843458.752367:0:10385:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788843458.752393:0:10385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd10f7ae600/0xa762dfcbd58d10d0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843458.752416:0:10385:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd10f7ae400/0xa762dfcbd58d0d6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0d65 expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843458.752424:0:10385:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd118f71400/0xa762dfcbd58d0d7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0d73 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843458.752430:0:10385:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd1153e7000/0xa762dfcbd58d0dce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0dc7 expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843458.752436:0:10385:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd100031400/0xa762dfcbd58d0ef4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d0eed expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843458.752446:0:10385:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd10fa3cc00/0xa762dfcbd58d100c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490798 expref: 9 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843458.752454:0:10385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd10f7ae600/0xa762dfcbd58d10d0 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843458.752504:0:10385:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd10fa3cc00/0xa762dfcbd58d100c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490798 expref: 9 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843458.752546:0:10385:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd10fa3cc00/0xa762dfcbd58d100c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490798 expref: 9 pid: 6498 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843458.752564:0:10385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007999880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10385:1875738134381568:192.168.203.33@tcp:104: 00010000:00010000:3.0:1788843458.752701:0:10385:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd100031400/0xa762dfcbd58d0ef4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0eed expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843458.752710:0:10385:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd100031400/0xa762dfcbd58d0ef4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0eed expref: 23 pid: 6501 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843458.752720:0:10385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10385:1875738134381696:0@lo:104: 00000100:00100000:3.0:1788843458.752766:0:10385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788843458.754284:0:10385:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd1153e7000/0xa762dfcbd58d0dce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0dc7 expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843458.754306:0:10385:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd1153e7000/0xa762dfcbd58d0dce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0dc7 expref: 23 pid: 6501 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843458.754323:0:10385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007998e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10385:1875738134381824:0@lo:104: 00000100:00100000:3.0:1788843458.754392:0:10385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788843458.756510:0:10385:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd118f71400/0xa762dfcbd58d0d7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0d73 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843458.756534:0:10385:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd118f71400/0xa762dfcbd58d0d7a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0d73 expref: 23 pid: 6500 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843458.756551:0:10385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007998700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10385:1875738134381952:0@lo:104: 00010000:00010000:3.0:1788843458.756610:0:10385:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd10f7ae400/0xa762dfcbd58d0d6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d0d65 expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843458.756635:0:10385:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd10f7ae400/0xa762dfcbd58d0d6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d0d65 expref: 23 pid: 6501 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843458.756644:0:10385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007999500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10385:1875738134382080:0@lo:104: 00000100:00100000:3.0:1788843458.756667:0:10385:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd118d47e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788843458.757372:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788843458.757408:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843458.757427:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843458.757438:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134381696 00000100:00100000:0.0:1788843458.757446:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134381696 00000100:00100000:0.0:1788843458.757498:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134381824 00000100:00100000:0.0:1788843458.757502:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134381824 00000100:00100000:0.0:1788843458.757513:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134381952 00000100:00100000:0.0:1788843458.757515:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134381952 00000100:00100000:0.0:1788843458.757525:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134382080 00000100:00100000:0.0:1788843458.757527:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134382080 00000100:00100000:0.0:1788843458.757542:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788843458.757552:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007998380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+6:10385:x1875738134381696:12345-0@lo:104: 00010000:00010000:0.0:1788843458.757569:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34000/0xa762dfcbd58d0eed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0ef4 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843458.757659:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788843458.757666:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007998380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+6:10385:x1875738134381696:12345-0@lo:104: Request processed in 116us (4900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843458.757673:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788843458.757693:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788843458.757700:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fb75450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+5:10385:x1875738134381824:12345-0@lo:104: 00010000:00010000:0.0:1788843458.757708:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd100030200/0xa762dfcbd58d0dc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0dce expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843458.757774:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788843458.757780:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fb75450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+5:10385:x1875738134381824:12345-0@lo:104: Request processed in 81us (3389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843458.757786:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788843458.757821:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00010000:00010000:2.0:1788843458.757891:0:10328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788843458.757900:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34000/0xa762dfcbd58d0eed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0ef4 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843458.757919:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb34000 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:2.0:1788843458.757924:0:10328:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34000/0xa762dfcbd58d0eed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0ef4 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843458.757933:0:10328:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34000/0xa762dfcbd58d0eed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0ef4 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843458.757941:0:10328:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34000/0xa762dfcbd58d0eed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0ef4 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843458.757947:0:10328:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788843458.757981:0:10328:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34000/0xa762dfcbd58d0eed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0ef4 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843458.757988:0:10328:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788843458.758013:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34000/0xa762dfcbd58d0eed lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0ef4 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843458.758020:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34000/0xa762dfcbd58d0eed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0ef4 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843458.758033:0:10328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843458.758036:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd100030200/0xa762dfcbd58d0dc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0dce expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843458.758042:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd100030200 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:2.0:1788843458.758044:0:10328:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd100030200/0xa762dfcbd58d0dc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0dce expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843458.758072:0:10328:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd100030200/0xa762dfcbd58d0dc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0dce expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843458.758077:0:10328:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd100030200/0xa762dfcbd58d0dc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0dce expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843458.758082:0:10328:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788843458.758097:0:10328:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd100030200/0xa762dfcbd58d0dc7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0dce expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843458.758102:0:10328:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788843458.758109:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd100030200/0xa762dfcbd58d0dc7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0dce expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843458.758116:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd100030200/0xa762dfcbd58d0dc7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0dce expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843458.758127:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843458.758129:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843458.758131:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843458.758297:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e874a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134382336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843458.758339:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843458.758379:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788843458.758385:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134382208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843458.758406:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843458.758434:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134382336 00000100:00100000:2.0:1788843458.758439:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134382336 00010000:00010000:2.0:1788843458.758465:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd1153e7000/0xa762dfcbd58d0dce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0dc7 expref: 24 pid: 6501 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843458.758500:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134382208 00000100:00100000:2.0:1788843458.758504:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134382208 00010000:00010000:2.0:1788843458.758516:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd100031400/0xa762dfcbd58d0ef4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0eed expref: 25 pid: 6501 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843458.758537:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788843458.758543:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+25:3631:x1875738134382336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788843458.758556:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843458.758562:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd1153e7000/0xa762dfcbd58d0dce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0dc7 expref: 25 pid: 6501 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843458.758572:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd1153e7000/0xa762dfcbd58d0dce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0dc7 expref: 25 pid: 6501 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843458.758596:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843458.758623:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+25:3631:x1875738134382336:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843458.758630:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788843458.758642:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788843458.758647:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3631:x1875738134382208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788843458.758653:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843458.758657:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd100031400/0xa762dfcbd58d0ef4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0eed expref: 24 pid: 6501 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843458.758664:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd100031400/0xa762dfcbd58d0ef4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0eed expref: 24 pid: 6501 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843458.758674:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843458.758695:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3631:x1875738134382208:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843458.758702:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788843458.758741:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134382208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843458.758749:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e874a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134382336:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788843458.759066:0:10385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd100031400/0xa762dfcbd58d0ef4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0eed expref: 23 pid: 6501 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843458.759083:0:10385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10385:1875738134381696:0@lo:104: 00010000:00010000:3.0:1788843458.759094:0:10385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1153e7000/0xa762dfcbd58d0dce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0dc7 expref: 22 pid: 6501 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843458.759103:0:10385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007998e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10385:1875738134381824:0@lo:104: 00000100:00100000:0.0:1788843458.759208:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+4:10385:x1875738134381952:12345-0@lo:104: 00010000:00010000:0.0:1788843458.759221:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd118f71e00/0xa762dfcbd58d0d73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0d7a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843458.759277:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788843458.759282:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+4:10385:x1875738134381952:12345-0@lo:104: Request processed in 1456us (1875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843458.759289:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788843458.759310:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788843458.759317:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+3:10385:x1875738134382080:12345-0@lo:104: 00010000:00010000:0.0:1788843458.759324:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd118f70200/0xa762dfcbd58d0d65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0d6c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843458.759357:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788843458.759363:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+3:10385:x1875738134382080:12345-0@lo:104: Request processed in 47us (1935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843458.759368:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1788843458.759386:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788843458.759391:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd118f71e00/0xa762dfcbd58d0d73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0d7a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843458.759410:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd118f71e00 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:0.0:1788843458.759414:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd118f71e00/0xa762dfcbd58d0d73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0d7a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843458.759423:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd118f71e00/0xa762dfcbd58d0d73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0d7a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843458.759430:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd118f71e00/0xa762dfcbd58d0d73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0d7a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843458.759436:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788843458.759470:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd118f71e00/0xa762dfcbd58d0d73 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0d7a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843458.759476:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843458.759497:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd118f71e00/0xa762dfcbd58d0d73 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0d7a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843458.759503:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd118f71e00/0xa762dfcbd58d0d73 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0d7a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843458.759514:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843458.759517:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd118f70200/0xa762dfcbd58d0d65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d0d6c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843458.759522:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd118f70200 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:0.0:1788843458.759524:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd118f70200/0xa762dfcbd58d0d65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d0d6c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843458.759542:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd118f70200/0xa762dfcbd58d0d65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d0d6c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843458.759547:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd118f70200/0xa762dfcbd58d0d65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d0d6c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843458.759552:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788843458.759565:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd118f70200/0xa762dfcbd58d0d65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0d6c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843458.759570:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843458.759576:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd118f70200/0xa762dfcbd58d0d65 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0d6c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843458.759583:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd118f70200/0xa762dfcbd58d0d65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d0d6c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843458.759598:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843458.759600:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843458.759601:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843458.759616:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843458.759630:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134382464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788843458.759664:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843458.759687:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788843458.759693:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134382592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788843458.759716:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843458.759743:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134382464 00000100:00100000:0.0:1788843458.759748:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134382464 00010000:00010000:0.0:1788843458.759766:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd118f71400/0xa762dfcbd58d0d7a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0d73 expref: 22 pid: 6500 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843458.759794:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134382592 00000100:00100000:0.0:1788843458.759797:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134382592 00010000:00010000:0.0:1788843458.759809:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd10f7ae400/0xa762dfcbd58d0d6c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0d65 expref: 23 pid: 6501 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843458.759820:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788843458.760019:0:10385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007998700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10385:1875738134381952:0@lo:104: 00000100:00100000:3.0:1788843458.760029:0:10385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007999500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10385:1875738134382080:0@lo:104: 00000100:00100000:0.0:1788843458.760123:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:3632:x1875738134382464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788843458.760137:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843458.760176:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd118f71400/0xa762dfcbd58d0d7a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0d73 expref: 23 pid: 6500 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843458.760185:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd118f71400/0xa762dfcbd58d0d7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0d73 expref: 23 pid: 6500 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843458.760199:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd118f71400/0xa762dfcbd58d0d7a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0d73 expref: 23 pid: 6500 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843458.760210:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843458.760244:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:3632:x1875738134382464:12345-0@lo:103:ldlm_bl.0 Request processed in 418us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843458.760251:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788843458.760265:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788843458.760271:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13332cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:3632:x1875738134382592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788843458.760278:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843458.760281:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd10f7ae400/0xa762dfcbd58d0d6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d0d65 expref: 21 pid: 6501 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843458.760289:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd10f7ae400/0xa762dfcbd58d0d6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d0d65 expref: 21 pid: 6501 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843458.760307:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd10f7ae400/0xa762dfcbd58d0d6c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d0d65 expref: 21 pid: 6501 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843458.760316:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843458.760340:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13332cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:3632:x1875738134382592:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843458.760346:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788843458.760445:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:3.0:1788843458.760446:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134382592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843458.760460:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134382464:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788843458.760541:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843458.781399:0:10385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007999880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10385:1875738134381568:192.168.203.33@tcp:104: 00010000:00010000:3.0:1788843458.781453:0:10385:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd10f7ae600/0xa762dfcbd58d10d0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843458.786629:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843458.786737:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116495744 00000100:00100000:2.0:1788843458.786750:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116495744 00010000:00010000:2.0:1788843458.786803:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd10fa3cc00/0xa762dfcbd58d100c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490798 expref: 10 pid: 6498 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843458.786864:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 39 00000100:00100000:2.0:1788843458.786876:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7928f422-fe0e-4906-b099-11067616e1bb+10:2390:x1875738116495744:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843458.786896:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843458.786903:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd10fa3cc00/0xa762dfcbd58d100c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490798 expref: 10 pid: 6498 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843458.786919:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd10fa3cc00/0xa762dfcbd58d100c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490798 expref: 10 pid: 6498 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843458.786940:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd10fa3cc00/0xa762dfcbd58d100c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490798 expref: 10 pid: 6498 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843458.786961:0:6492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd10f7ae600/0xa762dfcbd58d10d0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843458.786972:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd10f7ae600/0xa762dfcbd58d10d0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843458.787011:0:6492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd10f7ae600/0xa762dfcbd58d10d0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843458.787019:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd10f7ae600/0xa762dfcbd58d10d0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843458.787027:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd10f7ae600/0xa762dfcbd58d10d0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843458.787033:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd10f7ae600/0xa762dfcbd58d10d0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843458.787040:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7ae600 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843458.787045:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd10f7ae600/0xa762dfcbd58d10d0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843458.787063:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd10f7ae600/0xa762dfcbd58d10d0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843458.787080:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd10f7ae600/0xa762dfcbd58d10d0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843458.787091:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843458.787219:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7928f422-fe0e-4906-b099-11067616e1bb+9:2390:x1875738116495744:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 344us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843458.787228:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 39 00010000:00010000:3.0:1788843458.787400:0:10385:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd10f7ae600/0xa762dfcbd58d10d0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843458.787409:0:10385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd10f7ae600/0xa762dfcbd58d10d0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843458.787423:0:10385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd10f7ae600/0xa762dfcbd58d10d0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843459.116129:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843459.116316:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116495872 00000100:00100000:3.0:1788843459.116327:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116495872 00000100:00100000:3.0:1788843459.116375:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 250 00000100:00100000:3.0:1788843459.116385:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+9:6164:x1875738116495872:12345-192.168.203.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843459.116405:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843459.116456:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd10f7ae600/0xa762dfcbd58d10d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf24d95f224907de expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843459.116492:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd10f7ae600/0xa762dfcbd58d10d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224907de expref: 10 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843459.116505:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd10f7ae600/0xa762dfcbd58d10d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224907de expref: 10 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843459.116517:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10f7ae600, rc 0) 00000100:00100000:3.0:1788843459.116596:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+10:6164:x1875738116495872:12345-192.168.203.33@tcp:101:ll_cfg_requeue.0 Request processed in 211us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843459.116605:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 250 00000100:00100000:1.0:1788843459.126676:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843459.126830:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116496000 00000100:00100000:2.0:1788843459.126841:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116496000 00000100:00100000:2.0:1788843459.126903:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 251 00000100:00100000:2.0:1788843459.126927:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+10:6164:x1875738116496000:12345-192.168.203.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843459.127080:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+10:6164:x1875738116496000:12345-192.168.203.33@tcp:501:ll_cfg_requeue.0 Request processed in 155us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843459.127088:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 251 00000100:00100000:1.0:1788843459.129226:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843459.129800:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116496128 00000100:00100000:0.0:1788843459.129810:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116496128 00000100:00100000:0.0:1788843459.129866:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 252 00000100:00100000:0.0:1788843459.129877:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1153f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+10:6164:x1875738116496128:12345-192.168.203.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843459.130041:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1153f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+10:6164:x1875738116496128:12345-192.168.203.33@tcp:503:ll_cfg_requeue.0 Request processed in 165us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843459.130050:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 252 00000100:00100000:1.0:1788843459.134380:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843459.134706:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116496256 00000100:00100000:2.0:1788843459.134715:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116496256 00000100:00100000:2.0:1788843459.134770:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 253 00000100:00100000:2.0:1788843459.134781:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1032f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+10:6691:x1875738116496256:12345-192.168.203.33@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788843459.134945:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1032f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+10:6691:x1875738116496256:12345-192.168.203.33@tcp:502:llog_process_th.0 Request processed in 165us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843459.134954:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 253 00000100:00100000:1.0:1788843459.139587:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843459.141605:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116496384 00000100:00100000:0.0:1788843459.141630:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116496384 00000100:00100000:0.0:1788843459.141721:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 254 00000100:00100000:0.0:1788843459.141736:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1032f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+10:6691:x1875738116496384:12345-192.168.203.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788843459.141960:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1032f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+10:6691:x1875738116496384:12345-192.168.203.33@tcp:502:llog_process_th.0 Request processed in 226us (2389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843459.141970:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 254 10000000:01000000:0.0:1788843459.483340:0:6503:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788843459.483354:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd006461000 from 4 10000000:01000000:0.0:1788843459.483362:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788843459.483430:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d800/0xa762dfcbd58d10de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843459.483456:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d800/0xa762dfcbd58d10de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843459.483472:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d800/0xa762dfcbd58d10de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843459.483507:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134382720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788843459.483606:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843459.486018:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00772ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788843459.486057:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134382720 00000100:00100000:0.0:1788843459.486067:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134382720 00000100:00100000:0.0:1788843459.486132:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788843459.486171:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1032f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:6503:x1875738134382720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843459.486192:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843459.486216:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd10fa3cc00/0xa762dfcbd58d10e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d10de expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843459.486251:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd10fa3cc00/0xa762dfcbd58d10e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d10de expref: 21 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843459.486264:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd10fa3cc00/0xa762dfcbd58d10e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d10de expref: 21 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843459.486275:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3cc00, rc 0) 00000100:00100000:0.0:1788843459.486356:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1032f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:6503:x1875738134382720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (2750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843459.486365:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788843459.487776:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134382720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843459.488753:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d800/0xa762dfcbd58d10de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d10e5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843459.488773:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d800/0xa762dfcbd58d10de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d10e5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843459.488979:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134382848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788843459.489059:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843459.489114:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd111699cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843459.489544:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134382848 00000100:00100000:3.0:1788843459.489554:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134382848 00000100:00100000:1.0:1788843459.489726:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788843459.489739:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:6503:x1875738134382848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788843459.490091:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:6503:x1875738134382848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 354us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843459.490099:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788843459.492433:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134382848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788843459.492589:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134382976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788843459.492699:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843459.492755:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd111699cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843459.492936:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134382976 00000100:00100000:2.0:1788843459.492945:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134382976 00000100:00100000:2.0:1788843459.493012:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788843459.493022:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:6503:x1875738134382976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843459.493192:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:6503:x1875738134382976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843459.493200:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788843459.493389:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134382976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843459.494216:0:10406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10406:1875738134383104:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843459.494276:0:10406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843459.494315:0:10406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd11ae64a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788843459.494509:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134383104 00000100:00100000:1.0:1788843459.494517:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134383104 00000100:00100000:1.0:1788843459.494553:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788843459.494561:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:10406:x1875738134383104:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843459.494700:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:10406:x1875738134383104:12345-0@lo:502:llog_process_th.0 Request processed in 139us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843459.494707:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788843459.494928:0:10406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10406:1875738134383104:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788843459.494964:0:10406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788843459.494983:0:10406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843459.494986:0:10406:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788843459.494994:0:10406:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd006461000 00000020:00000080:2.0:1788843459.494997:0:10406:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788843459.495093:0:10406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10406:1875738134383232:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843459.495133:0:10406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843459.495184:0:10406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13308d000 going to sleep for 11 seconds 00000100:00100000:1.0:1788843459.495344:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134383232 00000100:00100000:1.0:1788843459.495349:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134383232 00000100:00100000:1.0:1788843459.495384:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788843459.495392:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:10406:x1875738134383232:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843459.497222:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:10406:x1875738134383232:12345-0@lo:502:llog_process_th.0 Request processed in 1820us (2078us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843459.497236:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788843459.497347:0:10406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10406:1875738134383232:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788843459.497392:0:10406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843459.497401:0:10406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843459.497404:0:10406:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788843459.497410:0:10406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788843459.497709:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788843459.497743:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788843459.497758:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d800/0xa762dfcbd58d10de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d10e5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843459.497771:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d800/0xa762dfcbd58d10de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d10e5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843459.497783:0:6503:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788843459.497786:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd10c0f0000 from 4 10000000:01000000:1.0:1788843459.497790:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788843459.497980:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34a00/0xa762dfcbd58d10ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843459.498002:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34a00/0xa762dfcbd58d10ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843459.498011:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34a00/0xa762dfcbd58d10ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843459.498038:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134383360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788843459.498087:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843459.498171:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007014cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843459.498261:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134383360 00000100:00100000:2.0:1788843459.498271:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134383360 00000100:00100000:2.0:1788843459.498321:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788843459.498332:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e092050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:6503:x1875738134383360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843459.498349:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843459.498365:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d10f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d10ec expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843459.498395:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d10f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d10ec expref: 22 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843459.498408:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d10f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d10ec expref: 22 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843459.498418:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007946a00, rc 0) 00000100:00100000:2.0:1788843459.499599:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e092050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:6503:x1875738134383360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1258us (1502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843459.499690:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788843459.499894:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134383360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843459.499921:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34a00/0xa762dfcbd58d10ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d10f3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843459.499934:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34a00/0xa762dfcbd58d10ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d10f3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843459.500024:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134383488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788843459.500063:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843459.500109:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007014cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843459.500189:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134383488 00000100:00100000:2.0:1788843459.500197:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134383488 00000100:00100000:2.0:1788843459.502220:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788843459.502240:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:6503:x1875738134383488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843459.502439:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:6503:x1875738134383488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 205us (2375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843459.502446:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788843459.503475:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134383488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843459.503642:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134383616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843459.503712:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843459.506690:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00772ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1788843459.508554:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134383616 00000100:00100000:1.0:1788843459.508574:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134383616 00000100:00100000:1.0:1788843459.508680:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788843459.508691:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:6503:x1875738134383616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788843459.508885:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:6503:x1875738134383616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (5172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843459.508893:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788843459.509587:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134383616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843459.509850:0:10409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079bb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10409:1875738134383744:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843459.509906:0:10409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843459.509941:0:10409:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00772ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788843459.510238:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134383744 00000100:00100000:1.0:1788843459.510244:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134383744 00000100:00100000:1.0:1788843459.510277:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788843459.510286:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:10409:x1875738134383744:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843459.510402:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:10409:x1875738134383744:12345-0@lo:502:llog_process_th.0 Request processed in 116us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843459.510409:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788843459.510566:0:10409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079bb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10409:1875738134383744:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788843459.510591:0:10409:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843459.510604:0:10409:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843459.510606:0:10409:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788843459.510699:0:10409:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd10c0f0000 00000020:00000080:0.0:1788843459.510702:0:10409:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788843459.511381:0:10409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079bb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10409:1875738134383872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843459.513002:0:10409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843459.513068:0:10409:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00772ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1788843459.515594:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134383872 00000100:00100000:2.0:1788843459.515626:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134383872 00000100:00100000:2.0:1788843459.515694:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788843459.515707:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:10409:x1875738134383872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843459.516064:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:10409:x1875738134383872:12345-0@lo:502:llog_process_th.0 Request processed in 358us (3069us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843459.516072:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788843459.517777:0:10409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079bb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10409:1875738134383872:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788843459.517989:0:10409:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843459.518001:0:10409:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843459.518003:0:10409:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788843459.518013:0:10409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788843459.518927:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788843459.518962:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788843459.518977:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34a00/0xa762dfcbd58d10ec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d10f3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843459.518992:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34a00/0xa762dfcbd58d10ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d10f3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843459.519006:0:6503:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788843459.519009:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd12e2b3800 from 4 10000000:01000000:2.0:1788843459.519013:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788843459.519061:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946c00/0xa762dfcbd58d10fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843459.519078:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd007946c00/0xa762dfcbd58d10fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843459.519091:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd007946c00/0xa762dfcbd58d10fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843459.519122:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134384000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788843459.519235:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843459.519284:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00747cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788843459.519310:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134384000 00000100:00100000:2.0:1788843459.519319:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134384000 00000100:00100000:2.0:1788843459.519374:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788843459.519384:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:6503:x1875738134384000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843459.519399:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843459.519413:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007946800/0xa762dfcbd58d1101 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d10fa expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843459.521457:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007946800/0xa762dfcbd58d1101 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d10fa expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843459.521483:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007946800/0xa762dfcbd58d1101 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d10fa expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843459.521495:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007946800, rc 0) 00000100:00100000:2.0:1788843459.521604:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:6503:x1875738134384000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2219us (2367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843459.521736:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788843459.522749:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134384000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843459.522782:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd007946c00/0xa762dfcbd58d10fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d1101 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843459.522796:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd007946c00/0xa762dfcbd58d10fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d1101 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843459.522992:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134384128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843459.523055:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843459.523103:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00747cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788843459.523761:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134384128 00000100:00100000:1.0:1788843459.523774:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134384128 00000100:00100000:1.0:1788843459.523914:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788843459.523927:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:6503:x1875738134384128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788843459.524125:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:6503:x1875738134384128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 200us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843459.524134:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788843459.524889:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134384128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843459.524950:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134384256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843459.525015:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843459.525051:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00747cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788843459.525069:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134384256 00000100:00100000:2.0:1788843459.525074:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134384256 00000100:00100000:2.0:1788843459.525117:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788843459.525126:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:6503:x1875738134384256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843459.525294:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:6503:x1875738134384256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843459.525301:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788843459.525347:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134384256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788843459.535699:0:10411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10411:1875738134384384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843459.535944:0:10411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843459.536019:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134384384 00000100:00100000:1.0:1788843459.536028:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134384384 00000100:00100000:1.0:1788843459.536084:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788843459.536095:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:10411:x1875738134384384:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843459.536281:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:10411:x1875738134384384:12345-0@lo:502:llog_process_th.0 Request processed in 187us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843459.536290:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788843459.536353:0:10411:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd105a65900 going to sleep for 11 seconds 00000100:00100000:1.0:1788843459.536386:0:10411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10411:1875738134384384:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788843459.536424:0:10411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843459.536689:0:10411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843459.536692:0:10411:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788843459.536701:0:10411:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd12e2b3800 00000020:00000080:1.0:1788843459.536704:0:10411:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788843459.537533:0:10411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10411:1875738134384512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843459.537685:0:10411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843459.537741:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134384512 00000100:00100000:1.0:1788843459.537749:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134384512 00000100:00100000:1.0:1788843459.537796:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788843459.538601:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:10411:x1875738134384512:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843459.538985:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:10411:x1875738134384512:12345-0@lo:502:llog_process_th.0 Request processed in 1178us (1371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843459.538995:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788843459.539069:0:10411:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10556aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788843459.539102:0:10411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10411:1875738134384512:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788843459.539214:0:10411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843459.539225:0:10411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843459.539228:0:10411:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788843459.539233:0:10411:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788843459.549086:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788843459.549169:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788843459.549186:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946c00/0xa762dfcbd58d10fa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d1101 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843459.549215:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007946c00/0xa762dfcbd58d10fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d1101 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843459.549228:0:6503:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788843459.549232:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd118db4800 from 4 10000000:01000000:3.0:1788843459.549235:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788843459.549291:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d1108 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843459.549299:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d1108 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843459.549314:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d1108 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843459.549349:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007999880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134384640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788843459.551968:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843459.552040:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd102d369c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843459.552090:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134384640 00000100:00100000:3.0:1788843459.552101:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134384640 00000100:00100000:3.0:1788843459.552208:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788843459.552220:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:6503:x1875738134384640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843459.552244:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843459.552270:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd10f7afe00/0xa762dfcbd58d110f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d1108 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843459.552311:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd10f7afe00/0xa762dfcbd58d110f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d1108 expref: 24 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843459.552341:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd10f7afe00/0xa762dfcbd58d110f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d1108 expref: 24 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843459.552352:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10f7afe00, rc 0) 00000100:00100000:3.0:1788843459.552427:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:6503:x1875738134384640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 210us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843459.553350:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788843459.553901:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007999880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134384640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843459.553934:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d1108 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d110f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843459.553949:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d1108 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d110f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843459.554061:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007999880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134384768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843459.554126:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843459.554224:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd102d369c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843459.554249:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134384768 00000100:00100000:3.0:1788843459.554255:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134384768 00000100:00100000:3.0:1788843459.554298:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788843459.554306:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:6503:x1875738134384768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843459.556972:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:6503:x1875738134384768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2650us (2829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843459.556989:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788843459.568936:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007999880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134384768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843459.569032:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134384896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843459.569176:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843459.569231:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893000 going to sleep for 11 seconds 00000100:00100000:1.0:1788843459.569615:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134384896 00000100:00100000:1.0:1788843459.569625:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134384896 00000100:00100000:1.0:1788843459.569691:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788843459.569703:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:6503:x1875738134384896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788843459.569873:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:6503:x1875738134384896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843459.569882:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788843459.569981:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134384896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788843459.570424:0:10414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007999500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10414:1875738134385024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843459.570507:0:10414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843459.570540:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134385024 00000100:00100000:3.0:1788843459.570545:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134385024 00000100:00100000:3.0:1788843459.570577:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788843459.570585:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:10414:x1875738134385024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843459.570674:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:10414:x1875738134385024:12345-0@lo:502:llog_process_th.0 Request processed in 90us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843459.570682:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788843459.570726:0:10414:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd102d36c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788843459.570739:0:10414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007999500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10414:1875738134385024:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788843459.570766:0:10414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788843459.570778:0:10414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843459.570781:0:10414:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788843459.570790:0:10414:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd118db4800 00000020:00000080:3.0:1788843459.570792:0:10414:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788843459.571662:0:10414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007999500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10414:1875738134385152:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843459.571727:0:10414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843459.571761:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134385152 00000100:00100000:3.0:1788843459.571768:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134385152 00000100:00100000:3.0:1788843459.571800:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788843459.571821:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:10414:x1875738134385152:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843459.571913:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:10414:x1875738134385152:12345-0@lo:502:llog_process_th.0 Request processed in 93us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843459.571920:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788843459.571954:0:10414:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd102d36c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788843459.571975:0:10414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007999500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:10414:1875738134385152:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788843459.571999:0:10414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843459.572007:0:10414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843459.572009:0:10414:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788843459.572014:0:10414:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788843459.572098:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788843459.572124:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788843459.572169:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d1108 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d110f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843459.572182:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d1108 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d110f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843459.738570:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843460.766460:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843461.553078:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843461.553248:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843461.553285:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843461.553655:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116496768 00000100:00100000:0.0:1788843461.553671:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116496768 00000100:00100000:0.0:1788843461.553759:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 69 00000100:00100000:0.0:1788843461.553774:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116496768:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1788843461.553899:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116496768:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 128us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843461.553908:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 69 00000100:00080000:0.0:1788843461.553936:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788843461.554968:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843461.555017:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843461.555229:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116496512 00000100:00100000:3.0:1788843461.555238:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116496512 00000100:00100000:3.0:1788843461.555561:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 275 00000100:00100000:3.0:1788843461.555590:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+10:2387:x1875738116496512:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843461.555690:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+10:2387:x1875738116496512:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 114us (2626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843461.555699:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 275 00000100:00100000:0.0:1788843461.556612:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116496640 00000100:00100000:0.0:1788843461.556628:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116496640 00000100:00100000:0.0:1788843461.556722:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 70 00000100:00100000:0.0:1788843461.556735:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2387:x1875738116496640:12345-192.168.203.33@tcp:400:kworker.0 00000100:00080000:3.0:1788843461.557412:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843461.558115:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2387:x1875738116496640:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 1372us (3164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843461.558166:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 70 00000100:00100000:2.0:1788843461.567704:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116497024 00000100:00100000:2.0:1788843461.567725:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116497024 00000100:00100000:2.0:1788843461.567899:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116496896 00000100:00100000:2.0:1788843461.567904:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116496896 00000100:00100000:0.0:1788843461.567949:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 24 00000100:00100000:0.0:1788843461.567970:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116497024:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1788843461.568087:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116497024:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 126us (14800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843461.568096:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 24 00000100:00080000:3.0:1788843461.569272:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788843461.569283:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788843461.569625:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 25 00000100:00100000:2.0:1788843461.569641:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116496896:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843461.569748:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116496896:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 111us (14729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843461.569755:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 25 00010000:00010000:0.0:1788843461.787223:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843462.042776:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134385280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788843462.042847:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134385536:0@lo:400:kworker.0 00000100:00100000:3.0:1788843462.042893:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843462.043218:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134385408:0@lo:400:kworker.0 00000100:00100000:0.0:1788843462.046890:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843462.047023:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134385792:0@lo:400:kworker.0 00000100:00100000:3.0:1788843462.047162:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134386048:0@lo:400:kworker.0 00000100:00100000:0.0:1788843462.047165:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843462.047186:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134386304:0@lo:400:kworker.0 00000100:00100000:3.0:1788843462.047193:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843462.047213:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1875738134386560:0@lo:400:kworker.0 00000100:00100000:0.0:1788843462.047213:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843462.047236:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134386816:0@lo:400:kworker.0 00000100:00100000:3.0:1788843462.047251:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843462.047266:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843462.047295:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788843462.047304:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134385664:0@lo:400:kworker.0 00000100:00100000:1.0:1788843462.047669:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843462.047727:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134385280 00000100:00100000:1.0:1788843462.047736:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134385280 00000100:00100000:1.0:1788843462.047807:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788843462.047819:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134385280:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788843462.047862:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134385536 00000100:00100000:0.0:1788843462.047866:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134385536 00002000:00000024:1.0:1788843462.047867:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843462.047891:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134385792 00000100:00100000:0.0:1788843462.047893:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134385792 00000100:00100000:0.0:1788843462.047909:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134386048 00000100:00100000:0.0:1788843462.047913:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134386048 00000100:00100000:0.0:1788843462.047934:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134386560 00000100:00100000:1.0:1788843462.047935:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134385280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843462.047936:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134386560 00000100:00100000:1.0:1788843462.047943:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788843462.047955:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788843462.047963:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134385536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843462.047972:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134386304 00000100:00100000:1.0:1788843462.047975:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134386304 00000100:00100000:3.0:1788843462.047986:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843462.048003:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134386816 00000100:00100000:1.0:1788843462.048008:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134386816 00000100:00100000:0.0:1788843462.048008:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134385536:12345-0@lo:400:kworker.0 Request processed in 45us (5114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843462.048015:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788843462.048034:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788843462.048034:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788843462.048041:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134386304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843462.048041:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134385792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843462.048061:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134386176:0@lo:400:kworker.0 00000100:00100000:1.0:1788843462.048086:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134386304:12345-0@lo:400:kworker.0 Request processed in 43us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843462.048086:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134385792:12345-0@lo:400:kworker.0 Request processed in 43us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843462.048094:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788843462.048096:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788843462.048112:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788843462.048113:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788843462.048131:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134386816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843462.048131:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134386048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843462.048181:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843462.048204:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134386048:12345-0@lo:400:kworker.0 Request processed in 83us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843462.048205:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134386816:12345-0@lo:400:kworker.0 Request processed in 87us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843462.048213:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788843462.048229:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134386176 00000100:00100000:3.0:1788843462.048231:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1875738134386688:0@lo:400:kworker.0 00000100:00100000:1.0:1788843462.048231:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788843462.048233:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134386176 00000100:00100000:1.0:1788843462.048252:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134385408 00000100:00100000:1.0:1788843462.048257:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134385408 00000100:00100000:0.0:1788843462.048261:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788843462.048269:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1875738134386560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843462.048290:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843462.048295:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788843462.048307:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3631:x1875738134385408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843462.048345:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134385536:0@lo:400:kworker.0 00000100:00100000:1.0:1788843462.048357:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3631:x1875738134385408:12345-0@lo:400:kworker.0 Request processed in 50us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843462.048366:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788843462.048370:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134386048:0@lo:400:kworker.0 00000100:00100000:0.0:1788843462.048433:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1875738134386560:12345-0@lo:400:kworker.0 Request processed in 161us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843462.048440:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788843462.048451:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134386688 00000100:00100000:3.0:1788843462.048459:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134386688 00000100:00100000:0.0:1788843462.048464:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788843462.048569:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788843462.048799:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134385408:0@lo:400:kworker.0 00000100:00100000:1.0:1788843462.048812:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134385920:0@lo:400:kworker.0 00000100:00100000:1.0:1788843462.048849:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843462.048871:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134386432:0@lo:400:kworker.0 00000100:00100000:1.0:1788843462.048892:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843462.048909:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134386944:0@lo:400:kworker.0 00000100:00100000:1.0:1788843462.048930:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843462.048975:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134385664 00000100:00100000:1.0:1788843462.048980:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134385664 00000100:00100000:1.0:1788843462.049010:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134385920 00000100:00100000:1.0:1788843462.049013:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134385920 00000100:00100000:2.0:1788843462.049409:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1875738134386560:0@lo:400:kworker.0 00000100:00100000:2.0:1788843462.049484:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788843462.049510:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007935500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134385664:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788843462.049547:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788843462.051533:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134386176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843462.051581:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1875738134386688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843462.051701:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1875738134386688:12345-0@lo:400:kworker.0 Request processed in 3122us (3414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843462.051720:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:3.0:1788843462.051798:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00799b100 x1875738134386688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843462.051812:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1875738134386688:0@lo:400:kworker.0 00000100:00100000:0.0:1788843462.052133:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134386176:12345-0@lo:400:kworker.0 Request processed in 3659us (3954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843462.052165:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788843462.052216:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134386432 00000100:00100000:0.0:1788843462.052224:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134386432 00000100:00100000:0.0:1788843462.052278:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134386944 00000100:00100000:0.0:1788843462.052280:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134386944 00000100:00100000:0.0:1788843462.053341:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788843462.053355:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134386432:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788843462.053361:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007998a80 x1875738134386176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843462.053380:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134386176:0@lo:400:kworker.0 00000100:00100000:0.0:1788843462.053456:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134386432:12345-0@lo:400:kworker.0 Request processed in 103us (4560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843462.053464:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788843462.053482:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788843462.053488:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f984380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134386944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843462.053518:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f984380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134386944:12345-0@lo:400:kworker.0 Request processed in 31us (4587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843462.053524:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788843462.053831:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134385792:0@lo:400:kworker.0 00010000:00080000:0.0:1788843462.053853:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00799a300 x1875738134386304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843462.053882:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134386304:0@lo:400:kworker.0 00010000:00080000:0.0:1788843462.053899:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007999180 x1875738134386816/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843462.053909:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134386816:0@lo:400:kworker.0 00010000:00080000:0.0:1788843462.053920:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0079bb800 x1875738134385280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843478 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843462.053936:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134385280:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1788843462.054023:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00799a680 x1875738134386432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843462.054031:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134386432:0@lo:400:kworker.0 00010000:00080000:0.0:1788843462.054041:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007999880 x1875738134386944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843462.054047:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134386944:0@lo:400:kworker.0 00000100:00100000:0.0:1788843462.054192:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007935500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134385664:12345-0@lo:400:kworker.0 Request processed in 4699us (6218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843462.054204:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788843462.054222:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134385664:0@lo:400:kworker.0 00000100:00080000:2.0:1788843462.054784:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788843462.054791:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788843462.054795:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788843462.054824:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788843462.054838:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134385920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843462.054967:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134385920:12345-0@lo:400:kworker.0 Request processed in 132us (6116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843462.054973:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788843462.055026:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134385920:0@lo:400:kworker.0 00000100:00100000:0.0:1788843462.554349:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134387072:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788843462.554426:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843462.554500:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134387072 00000100:00100000:0.0:1788843462.554507:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134387072 00000100:00100000:0.0:1788843462.554557:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788843462.554566:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134387072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788843462.554611:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843462.554657:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134387072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843462.554664:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788843462.554928:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0079bb800 x1875738134387072/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843478 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843462.554948:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134387072:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788843462.555514:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788843462.555536:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134387328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788843462.555612:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134387200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843462.555641:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843462.555675:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843462.555706:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134387328 00000100:00100000:3.0:1788843462.555716:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134387328 00000100:00100000:0.0:1788843462.555731:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134387200 00000100:00100000:0.0:1788843462.555738:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134387200 00000100:00100000:3.0:1788843462.555786:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788843462.555803:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134387328:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788843462.555836:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00002000:00000024:3.0:1788843462.555837:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843462.555850:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134387200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788843462.555872:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843462.559309:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134387328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3498us (3655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843462.559330:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1788843462.561512:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007768000 x1875738134387328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843478 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843462.561564:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134387328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788843462.561810:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134387200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5963us (6135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843462.561821:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788843462.561927:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f987800 x1875738134387200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843478 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843462.561943:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134387200:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788843462.810357:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843463.578347:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843463.578370:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134387456:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788843463.578457:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843463.578535:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134387456 00000100:00100000:1.0:1788843463.578543:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134387456 00000100:00100000:1.0:1788843463.578590:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788843463.578599:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd136c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134387456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788843463.578633:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788843463.578992:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134387584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788843463.579025:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843463.579077:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134387584 00000100:00100000:0.0:1788843463.579081:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134387584 00000100:00100000:0.0:1788843463.579105:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788843463.579124:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134387584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788843463.579198:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788843463.579241:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134387584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843463.579262:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788843463.579435:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134387584:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788843463.579998:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd136c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134387456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1390us (1531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843463.580011:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788843463.580076:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134387456:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788843463.835129:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843464.858493:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788843465.794382:0:10685:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg333-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1788843465.884450:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843466.670422:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843466.670469:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843466.670494:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843466.670517:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843466.670558:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843466.670596:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116497152 00000100:00100000:3.0:1788843466.670609:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116497152 00000100:00100000:3.0:1788843466.670675:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 277 00000100:00100000:3.0:1788843466.670688:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+10:2389:x1875738116497152:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843466.670780:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+10:2389:x1875738116497152:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 94us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843466.670788:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 277 00000100:00100000:3.0:1788843466.670831:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116497280 00000100:00100000:3.0:1788843466.670845:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116497280 00000100:00100000:3.0:1788843466.670892:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116497408 00000100:00100000:3.0:1788843466.670896:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116497408 00000100:00100000:3.0:1788843466.670919:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 77 00000100:00100000:3.0:1788843466.670926:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2390:x1875738116497280:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843466.670963:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2390:x1875738116497280:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 37us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843466.670969:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 77 00000100:00100000:3.0:1788843466.670981:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 78 00000100:00100000:3.0:1788843466.670986:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2389:x1875738116497408:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843466.671009:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2389:x1875738116497408:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 23us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843466.671014:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 78 00000100:00100000:3.0:1788843466.671364:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116497536 00000100:00100000:3.0:1788843466.671369:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116497536 00000100:00100000:3.0:1788843466.671410:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116497664 00000100:00100000:3.0:1788843466.671414:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116497664 00000100:00100000:3.0:1788843466.671441:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 30 00000100:00100000:3.0:1788843466.671449:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2390:x1875738116497536:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843466.671481:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2390:x1875738116497536:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 33us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843466.671487:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 30 00000100:00100000:3.0:1788843466.671500:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 31 00000100:00100000:3.0:1788843466.671507:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2389:x1875738116497664:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843466.671540:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2389:x1875738116497664:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 32us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843466.671553:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 31 00000100:00080000:3.0:1788843466.671753:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788843466.671757:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788843466.671760:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788843466.671763:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788843466.906369:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843467.164000:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788843467.164030:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134387712:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788843467.164184:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843467.168527:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134387712 00000100:00100000:3.0:1788843467.168552:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134387712 00000100:00100000:3.0:1788843467.168657:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788843467.168677:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134387712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788843467.168723:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843467.168846:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134387712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 177us (4704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843467.168855:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1788843467.168926:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0079baa00 x1875738134387712/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843467.168951:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134387712:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788843467.169061:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788843467.169620:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007240700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134388224:0@lo:400:kworker.0 00000100:00100000:1.0:1788843467.169679:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843467.169720:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007241880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134388736:0@lo:400:kworker.0 00000100:00100000:1.0:1788843467.169775:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843467.169802:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134389248:0@lo:400:kworker.0 00000100:00100000:1.0:1788843467.169826:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843467.169851:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788843467.169866:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007242a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134388096:0@lo:400:kworker.0 00000100:00100000:1.0:1788843467.169897:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843467.169914:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007241500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1875738134388608:0@lo:400:kworker.0 00000100:00100000:1.0:1788843467.169935:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843467.169950:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007243100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134389120:0@lo:400:kworker.0 00000100:00100000:1.0:1788843467.169972:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843467.170058:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1875738134387968:0@lo:400:kworker.0 00000100:00100000:2.0:1788843467.170108:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843467.170170:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1875738134388480:0@lo:400:kworker.0 00000100:00100000:2.0:1788843467.170199:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843467.170214:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1875738134388992:0@lo:400:kworker.0 00000100:00100000:2.0:1788843467.170238:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843467.170252:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788843467.170258:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134387840:0@lo:400:kworker.0 00000100:00100000:2.0:1788843467.170287:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843467.170308:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134388352:0@lo:400:kworker.0 00000100:00100000:2.0:1788843467.170331:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843467.170346:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007240a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1875738134388864:0@lo:400:kworker.0 00000100:00100000:2.0:1788843467.170367:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843467.170521:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134388096 00000100:00100000:0.0:1788843467.170530:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134388096 00000100:00100000:0.0:1788843467.170580:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134388352 00000100:00100000:0.0:1788843467.170583:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134388352 00000100:00100000:0.0:1788843467.170600:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788843467.170608:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134388096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843467.170677:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134388096:12345-0@lo:400:kworker.0 Request processed in 68us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843467.170684:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788843467.170705:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788843467.170711:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134388352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843467.170743:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134388352:12345-0@lo:400:kworker.0 Request processed in 33us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843467.170749:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788843467.170794:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007242a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134388096:0@lo:400:kworker.0 00000100:00100000:2.0:1788843467.170881:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134388352:0@lo:400:kworker.0 00000100:00100000:3.0:1788843467.170957:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134388224 00000100:00100000:3.0:1788843467.170962:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134388224 00000100:00100000:3.0:1788843467.170987:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134388608 00000100:00100000:3.0:1788843467.170990:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134388608 00000100:00100000:3.0:1788843467.171022:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134387968 00000100:00100000:3.0:1788843467.171025:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134387968 00000100:00100000:3.0:1788843467.171038:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134388480 00000100:00100000:3.0:1788843467.171040:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134388480 00000100:00100000:3.0:1788843467.171052:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134388992 00000100:00100000:3.0:1788843467.171055:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134388992 00000100:00100000:3.0:1788843467.171066:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134388864 00000100:00100000:3.0:1788843467.171068:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134388864 00000100:00100000:3.0:1788843467.171107:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788843467.171114:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134388224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843467.171188:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134388224:12345-0@lo:400:kworker.0 Request processed in 74us (1509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843467.171195:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788843467.171209:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788843467.171216:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875738134388608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843467.171243:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875738134388608:12345-0@lo:400:kworker.0 Request processed in 29us (1308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843467.171248:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788843467.171260:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788843467.171266:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1875738134387968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843467.171294:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1875738134387968:12345-0@lo:400:kworker.0 Request processed in 28us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843467.171299:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788843467.171311:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788843467.171317:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1875738134388480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843467.171345:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1875738134388480:12345-0@lo:400:kworker.0 Request processed in 28us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843467.171351:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788843467.171361:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788843467.171366:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1875738134388992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843467.171404:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1875738134388992:12345-0@lo:400:kworker.0 Request processed in 38us (1165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843467.171410:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788843467.171428:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788843467.171433:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1875738134388864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843467.171480:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1875738134388864:12345-0@lo:400:kworker.0 Request processed in 46us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843467.171486:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788843467.171509:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134388736 00000100:00100000:3.0:1788843467.171514:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134388736 00000100:00100000:3.0:1788843467.171540:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134389248 00000100:00100000:3.0:1788843467.171543:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134389248 00000100:00100000:3.0:1788843467.171558:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134389120 00000100:00100000:3.0:1788843467.171561:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134389120 00000100:00100000:3.0:1788843467.171576:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788843467.171582:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134388736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843467.171614:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134388736:12345-0@lo:400:kworker.0 Request processed in 32us (1839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843467.171620:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788843467.171630:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788843467.171635:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134389248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843467.171662:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134389248:12345-0@lo:400:kworker.0 Request processed in 27us (1836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843467.171668:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788843467.171678:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788843467.171684:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fda8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134389120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843467.171710:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fda8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134389120:12345-0@lo:400:kworker.0 Request processed in 26us (1737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843467.171716:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788843467.171907:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134387840 00000100:00100000:3.0:1788843467.171919:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134387840 00000100:00100000:3.0:1788843467.171951:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788843467.171957:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3631:x1875738134387840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843467.171988:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3631:x1875738134387840:12345-0@lo:400:kworker.0 Request processed in 32us (1701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843467.171993:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00010000:00080000:0.0:1788843467.172194:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007241500 x1875738134388608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843467.172207:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007241500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1875738134388608:0@lo:400:kworker.0 00010000:00080000:0.0:1788843467.172219:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007243100 x1875738134389120/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843467.172241:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007243100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134389120:0@lo:400:kworker.0 00000100:00100000:0.0:1788843467.172255:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007240700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134388224:0@lo:400:kworker.0 00010000:00080000:0.0:1788843467.172266:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007241880 x1875738134388736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843467.172273:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007241880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134388736:0@lo:400:kworker.0 00010000:00080000:0.0:1788843467.172283:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007243800 x1875738134389248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843467.172290:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134389248:0@lo:400:kworker.0 00000100:00080000:2.0:1788843467.172379:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788843467.172385:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788843467.172388:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788843467.172391:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788843467.172412:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134387840:0@lo:400:kworker.0 00000100:00100000:2.0:1788843467.172425:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007240a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1875738134388864:0@lo:400:kworker.0 00000100:00100000:2.0:1788843467.172437:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1875738134387968:0@lo:400:kworker.0 00000100:00100000:2.0:1788843467.172448:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1875738134388480:0@lo:400:kworker.0 00010000:00080000:2.0:1788843467.172458:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007241f80 x1875738134388992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843467.172480:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1875738134388992:0@lo:400:kworker.0 00000100:00100000:0.0:1788843467.675717:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134389376:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788843467.675825:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843467.676572:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134389632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788843467.676620:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843467.676673:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134389376 00000100:00100000:2.0:1788843467.676683:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134389376 00000100:00100000:2.0:1788843467.676733:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134389632 00000100:00100000:2.0:1788843467.676737:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134389632 00000100:00100000:2.0:1788843467.676768:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788843467.676781:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134389376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788843467.676820:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788843467.678120:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134389376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1332us (2286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843467.678133:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788843467.678188:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788843467.678201:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134389632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788843467.678221:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788843467.678285:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134389632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (1665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843467.678291:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788843467.678343:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fa2fb80 x1875738134389632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843467.678370:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134389632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788843467.678696:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134389504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843467.678745:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843467.679317:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134389504 00000100:00100000:1.0:1788843467.679327:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134389504 00000100:00100000:1.0:1788843467.679370:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788843467.679379:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134389504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788843467.679398:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788843467.679443:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134389504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843467.679449:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788843467.679490:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f8a8a80 x1875738134389504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843467.679508:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134389504:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788843467.679587:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fa2e300 x1875738134389376/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843467.679602:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134389376:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788843467.937318:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843468.716553:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134389760:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788843468.716654:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843468.716752:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134389760 00000100:00100000:0.0:1788843468.716762:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134389760 00000100:00100000:0.0:1788843468.716818:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788843468.716829:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134389760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788843468.716874:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788843468.716930:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134389760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843468.716957:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788843468.717017:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134389760:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788843468.717477:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788843468.717489:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134389888:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788843468.717529:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843468.717572:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134389888 00000100:00100000:3.0:1788843468.717577:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134389888 00000100:00100000:3.0:1788843468.717608:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788843468.717615:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134389888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788843468.717638:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788843468.717677:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134389888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843468.717684:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788843468.717719:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134389888:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788843468.955731:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843469.982302:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843471.004353:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788843471.136362:0:10929:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg333-server.virtnet: executing yml_node 00000100:00100000:1.0:1788843471.789349:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843471.789395:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843471.789423:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843471.789451:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116498048 00000100:00100000:1.0:1788843471.789460:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116498048 00000100:00100000:1.0:1788843471.789515:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116497920 00000100:00100000:1.0:1788843471.789525:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116497920 00000100:00100000:1.0:1788843471.789554:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 85 00000100:00100000:1.0:1788843471.789564:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2388:x1875738116498048:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843471.789636:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2388:x1875738116498048:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 74us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843471.789644:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 85 00000100:00100000:1.0:1788843471.789662:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 86 00000100:00100000:1.0:1788843471.789668:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2388:x1875738116497920:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843471.789693:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2388:x1875738116497920:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 25us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843471.789699:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 86 00000100:00080000:1.0:1788843471.789718:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788843471.789721:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788843471.789870:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116497792 00000100:00100000:2.0:1788843471.789880:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116497792 00000100:00100000:2.0:1788843471.789919:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 279 00000100:00100000:2.0:1788843471.789927:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+10:2388:x1875738116497792:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843471.789960:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+10:2388:x1875738116497792:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 34us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843471.789967:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 279 00000100:00100000:1.0:1788843471.804751:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843471.806834:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116498176 00000100:00100000:3.0:1788843471.806848:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116498176 00000100:00100000:3.0:1788843471.806929:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 18 00000100:00100000:3.0:1788843471.806940:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2386:x1875738116498176:12345-192.168.203.33@tcp:9:kworker.0 00000020:00000080:3.0:1788843471.806977:0:8423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d1021 00000100:00080000:3.0:1788843471.806986:0:8423:0:(import.c:65:import_set_state_nolock()) ffff9bd0059c1000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788843471.807035:0:8423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788843471.807239:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+2:2386:x1875738116498176:12345-192.168.203.33@tcp:9:kworker.0 Request processed in 299us (2493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843471.807254:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 18 00010000:00010000:3.0:1788843471.807313:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788843471.807471:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843471.811711:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843471.811776:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116498304 00000100:00100000:3.0:1788843471.811786:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116498304 00000100:00080000:2.0:1788843471.811881:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788843471.811915:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 19 00000100:00100000:3.0:1788843471.811926:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2386:x1875738116498304:12345-192.168.203.33@tcp:9:kworker.0 00000020:00000080:3.0:1788843471.811963:0:8901:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d1028 00000100:00080000:3.0:1788843471.811973:0:8901:0:(import.c:65:import_set_state_nolock()) ffff9bd141b0b000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788843471.812027:0:8901:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788843471.812219:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+2:2386:x1875738116498304:12345-192.168.203.33@tcp:9:kworker.0 Request processed in 295us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843471.812227:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 19 00010000:00010000:2.0:1788843471.812277:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843472.026747:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843472.293781:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134390400:0@lo:400:kworker.0 00000100:00100000:3.0:1788843472.293850:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843472.293896:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134390912:0@lo:400:kworker.0 00000100:00100000:3.0:1788843472.293922:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843472.293947:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134391424:0@lo:400:kworker.0 00000100:00100000:3.0:1788843472.293967:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843472.293993:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788843472.294000:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134390016:0@lo:400:kworker.0 00000100:00100000:3.0:1788843472.294026:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843472.294159:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134390400 00000100:00100000:1.0:1788843472.294166:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134390400 00000100:00100000:1.0:1788843472.294208:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788843472.294218:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134390400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843472.299132:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134390400:12345-0@lo:400:kworker.0 Request processed in 4907us (5274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843472.299161:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788843472.299833:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134390528:0@lo:400:kworker.0 00000100:00100000:3.0:1788843472.299883:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843472.299918:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134391040:0@lo:400:kworker.0 00000100:00100000:3.0:1788843472.299954:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843472.300027:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134391552:0@lo:400:kworker.0 00000100:00100000:3.0:1788843472.300072:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843472.300110:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134390528 00000100:00100000:0.0:1788843472.300118:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134390528 00000100:00100000:0.0:1788843472.300197:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788843472.300206:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134390528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843472.300258:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134390528:12345-0@lo:400:kworker.0 Request processed in 54us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843472.300265:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788843472.303209:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134390400:0@lo:400:kworker.0 00000100:00100000:3.0:1788843472.303244:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134390528:0@lo:400:kworker.0 00000100:00100000:1.0:1788843472.303442:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134390912 00000100:00100000:1.0:1788843472.303450:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134390912 00000100:00100000:1.0:1788843472.303511:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134391424 00000100:00100000:1.0:1788843472.303515:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134391424 00000100:00100000:1.0:1788843472.303528:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134391040 00000100:00100000:1.0:1788843472.303539:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134391040 00000100:00100000:1.0:1788843472.303558:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134391552 00000100:00100000:1.0:1788843472.303561:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134391552 00000100:00100000:1.0:1788843472.303579:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788843472.303587:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134390912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843472.303661:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134390912:12345-0@lo:400:kworker.0 Request processed in 75us (9738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843472.303668:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788843472.303684:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788843472.303691:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134391424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843472.303718:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134391424:12345-0@lo:400:kworker.0 Request processed in 28us (9750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843472.303724:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788843472.303735:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788843472.303740:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134391040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843472.303767:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134391040:12345-0@lo:400:kworker.0 Request processed in 27us (3812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843472.303773:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788843472.303783:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788843472.303789:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134391552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843472.303816:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134391552:12345-0@lo:400:kworker.0 Request processed in 27us (3743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843472.303822:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1788843472.303837:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788843472.303841:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788843472.303862:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00776a680 x1875738134391040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843472.303886:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134391040:0@lo:400:kworker.0 00010000:00080000:1.0:1788843472.303898:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f955880 x1875738134391552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843472.303907:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134391552:0@lo:400:kworker.0 00010000:00080000:1.0:1788843472.303917:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007768a80 x1875738134390912/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843472.303925:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134390912:0@lo:400:kworker.0 00010000:00080000:1.0:1788843472.303935:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007768000 x1875738134391424/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843472.303942:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134391424:0@lo:400:kworker.0 00000100:00100000:1.0:1788843472.304431:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134390144:0@lo:400:kworker.0 00000100:00100000:1.0:1788843472.304482:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843472.304506:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134390656:0@lo:400:kworker.0 00000100:00100000:1.0:1788843472.304527:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843472.304543:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1875738134391168:0@lo:400:kworker.0 00000100:00100000:1.0:1788843472.304565:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843472.304580:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134391680:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788843472.304600:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843472.304621:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788843472.304627:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134390272:0@lo:400:kworker.0 00000100:00100000:1.0:1788843472.304648:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843472.304676:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134390784:0@lo:400:kworker.0 00000100:00100000:1.0:1788843472.304697:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843472.304711:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1875738134391296:0@lo:400:kworker.0 00000100:00100000:1.0:1788843472.304730:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843472.304751:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134390144 00000100:00100000:1.0:1788843472.304756:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134390144 00000100:00100000:1.0:1788843472.304779:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134390656 00000100:00100000:1.0:1788843472.304781:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134390656 00000100:00100000:1.0:1788843472.304797:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134391168 00000100:00100000:1.0:1788843472.304800:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134391168 00000100:00100000:1.0:1788843472.304811:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134390784 00000100:00100000:1.0:1788843472.304813:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134390784 00000100:00100000:1.0:1788843472.304825:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134391296 00000100:00100000:1.0:1788843472.304827:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134391296 00000100:00100000:1.0:1788843472.304859:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788843472.304866:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134390144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843472.304903:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134390144:12345-0@lo:400:kworker.0 Request processed in 38us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843472.304910:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788843472.304922:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788843472.304928:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134390656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843472.304953:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134390656:12345-0@lo:400:kworker.0 Request processed in 26us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843472.304959:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788843472.304972:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788843472.304978:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1875738134391168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843472.305000:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1875738134391168:12345-0@lo:400:kworker.0 Request processed in 24us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843472.305015:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788843472.305027:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788843472.305032:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134390784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843472.305203:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134390784:12345-0@lo:400:kworker.0 Request processed in 170us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843472.305210:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788843472.305223:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788843472.305228:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1875738134391296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843472.305255:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1875738134391296:12345-0@lo:400:kworker.0 Request processed in 27us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843472.305260:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788843472.305283:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134391680 00000100:00100000:1.0:1788843472.305287:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134391680 00000100:00100000:1.0:1788843472.305310:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788843472.305316:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134391680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788843472.305336:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788843472.305366:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134391680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843472.305372:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788843472.305389:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134390272 00000100:00100000:1.0:1788843472.305393:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134390272 00000100:00100000:1.0:1788843472.305415:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788843472.305421:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134390272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843472.305451:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134390272:12345-0@lo:400:kworker.0 Request processed in 31us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843472.305476:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1788843472.305493:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788843472.305497:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843472.305520:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134390272:0@lo:400:kworker.0 00010000:00080000:1.0:1788843472.305534:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007769f80 x1875738134390784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843472.305544:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134390784:0@lo:400:kworker.0 00010000:00080000:1.0:1788843472.305554:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00776b800 x1875738134391296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843472.305563:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1875738134391296:0@lo:400:kworker.0 00000100:00100000:1.0:1788843472.305573:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134390144:0@lo:400:kworker.0 00000100:00100000:1.0:1788843472.305581:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134390656:0@lo:400:kworker.0 00000100:00100000:1.0:1788843472.305590:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1875738134391168:0@lo:400:kworker.0 00010000:00080000:1.0:1788843472.305599:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0079baa00 x1875738134391680/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843488 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843472.305613:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134391680:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788843472.305920:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134390016 00000100:00100000:3.0:1788843472.305926:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134390016 00000100:00100000:3.0:1788843472.305955:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788843472.305962:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3630:x1875738134390016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843472.306002:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3630:x1875738134390016:12345-0@lo:400:kworker.0 Request processed in 40us (11975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843472.306009:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788843472.306174:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134390016:0@lo:400:kworker.0 00000100:00100000:0.0:1788843472.794688:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134391808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788843472.795413:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843472.797544:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134391936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788843472.797612:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843472.797747:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134391808 00000100:00100000:1.0:1788843472.797756:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134391808 00000100:00100000:1.0:1788843472.797984:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134391936 00000100:00100000:1.0:1788843472.797988:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134391936 00000100:00100000:1.0:1788843472.798007:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788843472.798033:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134391808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788843472.798065:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788843472.798120:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134391808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (2708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843472.798127:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788843472.798171:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788843472.798179:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134391936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788843472.798198:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788843472.798233:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134391936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843472.798240:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1788843472.798285:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f8ab100 x1875738134391808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843488 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843472.798305:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134391808:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788843472.798341:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007241f80 x1875738134391936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843488 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843472.798353:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134391936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788843472.807085:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788843472.807109:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134392064:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788843472.807199:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843472.807317:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134392064 00000100:00100000:3.0:1788843472.807326:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134392064 00000100:00100000:3.0:1788843472.807529:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788843472.807540:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134392064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788843472.807561:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843472.809234:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134392064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1687us (2025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843472.809247:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1788843472.818602:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fe23100 x1875738134392064/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843488 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843472.818636:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134392064:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788843473.050607:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843473.818749:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788843473.818775:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134392192:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788843473.818852:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843473.819033:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134392192 00000100:00100000:3.0:1788843473.819050:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134392192 00000100:00100000:3.0:1788843473.819104:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788843473.819115:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134392192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788843473.819161:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788843473.819222:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134392192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843473.819229:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788843473.819347:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134392320:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788843473.819375:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843473.819436:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134392192:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788843473.819561:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134392320 00000100:00100000:2.0:1788843473.819566:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134392320 00000100:00100000:2.0:1788843473.819599:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788843473.819607:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134392320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788843473.819627:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788843473.819670:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134392320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843473.819677:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788843473.819949:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134392320:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788843474.074318:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843475.098827:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788843476.087363:0:11112:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.111 00010000:00010000:3.0:1788843476.122562:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843476.916792:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843476.916908:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843476.916985:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843476.917118:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116498432 00000100:00100000:2.0:1788843476.917132:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116498432 00000100:00100000:2.0:1788843476.917219:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 281 00000100:00100000:2.0:1788843476.917231:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+10:2388:x1875738116498432:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843476.917320:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+10:2388:x1875738116498432:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 92us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843476.917337:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 281 00000100:00100000:1.0:1788843476.917781:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116498560 00000100:00100000:1.0:1788843476.917789:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116498560 00000100:00100000:1.0:1788843476.917850:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116498688 00000100:00100000:1.0:1788843476.917854:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116498688 00000100:00100000:1.0:1788843476.917878:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 93 00000100:00100000:1.0:1788843476.917886:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2388:x1875738116498560:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843476.917943:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2388:x1875738116498560:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 58us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843476.917950:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 93 00000100:00100000:1.0:1788843476.917965:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 94 00000100:00100000:1.0:1788843476.917971:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2388:x1875738116498688:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843476.917996:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2388:x1875738116498688:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 26us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843476.918003:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 94 00000100:00080000:0.0:1788843476.918248:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788843476.918254:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788843477.151559:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843477.402483:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788843477.402516:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134392448:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788843477.402615:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843477.402750:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134392448 00000100:00100000:0.0:1788843477.402759:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134392448 00000100:00100000:0.0:1788843477.402835:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788843477.402847:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134392448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788843477.402883:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843477.402942:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134392448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843477.402950:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1788843477.403001:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007243800 x1875738134392448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843477.403031:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134392448:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788843477.403114:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788843477.403832:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134392960:0@lo:400:kworker.0 00000100:00100000:2.0:1788843477.403886:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843477.403922:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141a76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134393472:0@lo:400:kworker.0 00000100:00100000:2.0:1788843477.403948:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843477.403968:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141a74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134393984:0@lo:400:kworker.0 00000100:00100000:2.0:1788843477.403989:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843477.404025:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788843477.404032:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134392576:0@lo:400:kworker.0 00000100:00100000:2.0:1788843477.404062:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843477.404095:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134393088:0@lo:400:kworker.0 00000100:00100000:2.0:1788843477.404122:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843477.404166:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141a74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1875738134393600:0@lo:400:kworker.0 00000100:00100000:2.0:1788843477.404188:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843477.404216:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134393472 00000100:00100000:2.0:1788843477.404222:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134393472 00000100:00100000:2.0:1788843477.404268:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134393984 00000100:00100000:2.0:1788843477.404271:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134393984 00000100:00100000:2.0:1788843477.404293:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788843477.404301:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134393472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843477.404347:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134393472:12345-0@lo:400:kworker.0 Request processed in 47us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843477.404354:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788843477.404367:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788843477.404373:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134393984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843477.404413:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134393984:12345-0@lo:400:kworker.0 Request processed in 40us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843477.404420:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788843477.404439:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134392576 00000100:00100000:2.0:1788843477.404442:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134392576 00000100:00100000:2.0:1788843477.404469:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1788843477.404476:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3630:x1875738134392576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843477.404506:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3630:x1875738134392576:12345-0@lo:400:kworker.0 Request processed in 30us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843477.404512:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1788843477.404544:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134393088 00000100:00100000:2.0:1788843477.404547:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134393088 00000100:00100000:2.0:1788843477.404570:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788843477.404577:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134393088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843477.404607:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134393088:12345-0@lo:400:kworker.0 Request processed in 30us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843477.404613:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788843477.404658:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134392576:0@lo:400:kworker.0 00000100:00100000:2.0:1788843477.404670:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134393088:0@lo:400:kworker.0 00010000:00080000:2.0:1788843477.404683:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141a76a00 x1875738134393472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843477.404915:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134392832:0@lo:400:kworker.0 00000100:00100000:0.0:1788843477.404952:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843477.404975:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141a75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1875738134393344:0@lo:400:kworker.0 00000100:00100000:0.0:1788843477.404997:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843477.405027:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141a75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134393856:0@lo:400:kworker.0 00000100:00100000:0.0:1788843477.405050:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843477.405071:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788843477.405087:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134392704:0@lo:400:kworker.0 00000100:00100000:0.0:1788843477.405123:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843477.405165:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141a76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1875738134393216:0@lo:400:kworker.0 00000100:00100000:0.0:1788843477.405187:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843477.405199:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141a75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134393728:0@lo:400:kworker.0 00000100:00100000:0.0:1788843477.405220:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843477.405244:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134393856 00000100:00100000:0.0:1788843477.405249:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134393856 00000100:00100000:0.0:1788843477.405287:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788843477.405293:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134393856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843477.405329:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134393856:12345-0@lo:400:kworker.0 Request processed in 36us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843477.405335:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788843477.405356:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134392832 00000100:00100000:0.0:1788843477.405360:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134392832 00000100:00100000:0.0:1788843477.405384:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788843477.405391:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134392832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843477.405423:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134392832:12345-0@lo:400:kworker.0 Request processed in 33us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843477.405428:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788843477.405446:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134392960 00000100:00100000:0.0:1788843477.405450:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134392960 00000100:00100000:0.0:1788843477.405468:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134393600 00000100:00100000:0.0:1788843477.405471:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134393600 00000100:00100000:0.0:1788843477.405502:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134393344 00000100:00100000:0.0:1788843477.405504:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134393344 00000100:00100000:0.0:1788843477.405515:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134392704 00000100:00100000:0.0:1788843477.405517:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134392704 00000100:00100000:0.0:1788843477.405528:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134393216 00000100:00100000:0.0:1788843477.405538:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134393216 00000100:00100000:0.0:1788843477.405553:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134393728 00000100:00100000:0.0:1788843477.405556:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134393728 00000100:00100000:0.0:1788843477.405568:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788843477.405573:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134392960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843477.405618:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134392960:12345-0@lo:400:kworker.0 Request processed in 45us (1732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843477.405624:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788843477.405635:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788843477.405641:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875738134393600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843477.405669:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875738134393600:12345-0@lo:400:kworker.0 Request processed in 28us (1480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843477.405675:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788843477.405954:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141a76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134393472:0@lo:400:kworker.0 00010000:00080000:2.0:1788843477.405976:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141a74a80 x1875738134393984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843477.406005:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141a74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134393984:0@lo:400:kworker.0 00000100:00100000:2.0:1788843477.406063:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141a74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1875738134393600:0@lo:400:kworker.0 00000100:00100000:2.0:1788843477.406075:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134392960:0@lo:400:kworker.0 00000100:00100000:1.0:1788843477.406719:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788843477.406735:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875738134393344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843477.406793:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875738134393344:12345-0@lo:400:kworker.0 Request processed in 64us (1795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843477.406801:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788843477.406819:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788843477.406826:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134392704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843477.406855:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134392704:12345-0@lo:400:kworker.0 Request processed in 31us (1731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843477.406861:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788843477.406872:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788843477.406879:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875738134393216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843477.406925:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875738134393216:12345-0@lo:400:kworker.0 Request processed in 46us (1737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843477.406931:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788843477.406942:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788843477.406948:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875738134393728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843477.406975:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875738134393728:12345-0@lo:400:kworker.0 Request processed in 27us (1754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843477.406981:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:1.0:1788843477.407005:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788843477.407010:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788843477.407013:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788843477.407026:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788843477.407679:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134392704:0@lo:400:kworker.0 00000100:00100000:2.0:1788843477.407754:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141a76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1875738134393216:0@lo:400:kworker.0 00010000:00080000:2.0:1788843477.407769:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141a75500 x1875738134393728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843477.407779:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141a75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134393728:0@lo:400:kworker.0 00000100:00100000:2.0:1788843477.407793:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134392832:0@lo:400:kworker.0 00010000:00080000:2.0:1788843477.407805:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141a75180 x1875738134393344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843477.407814:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141a75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1875738134393344:0@lo:400:kworker.0 00010000:00080000:2.0:1788843477.407826:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141a75f80 x1875738134393856/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843477.407834:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141a75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134393856:0@lo:400:kworker.0 00000100:00100000:2.0:1788843477.916385:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134394112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788843477.916453:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843477.916780:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134394368:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788843477.916840:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843477.916907:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788843477.916913:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134394240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843477.916932:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843477.916969:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134394112 00000100:00100000:3.0:1788843477.916978:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134394112 00000100:00100000:3.0:1788843477.917034:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134394368 00000100:00100000:3.0:1788843477.917036:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134394368 00000100:00100000:3.0:1788843477.917047:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134394240 00000100:00100000:3.0:1788843477.917049:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134394240 00000100:00100000:3.0:1788843477.917063:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788843477.917071:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134394112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788843477.917098:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843477.917160:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134394112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843477.917167:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788843477.917194:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788843477.917200:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134394368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788843477.917216:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843477.917242:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134394368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843477.917248:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788843477.917266:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788843477.917272:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134394240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788843477.917280:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843477.917299:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134394240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 28us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843477.917304:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1788843477.917338:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f955880 x1875738134394240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843477.917560:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134394240:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788843477.917580:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007768700 x1875738134394368/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843477.917593:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134394368:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1788843477.917678:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fe23100 x1875738134394112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843477.917705:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134394112:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1788843477.919802:0:9500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f25f61b6-5faf-4e05-81a4-dea3dba05dc5 00000020:00000080:3.0:1788843477.919813:0:9500:0:(genops.c:885:class_export_put()) final put ffff9bd141b0c000/f25f61b6-5faf-4e05-81a4-dea3dba05dc5 00000020:00000080:0.0:1788843477.919884:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd141b0c000/f25f61b6-5faf-4e05-81a4-dea3dba05dc5 for lustre-OST0001 00000020:00000080:0.0:1788843477.919949:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd141b0b000 for lustre-OST0001 00000001:00100000:2.0:1788843477.920041:0:8417:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f25f61b6-5faf-4e05-81a4-dea3dba05dc5 00000020:00000080:2.0:1788843477.920046:0:8417:0:(genops.c:885:class_export_put()) final put ffff9bd0059c4000/f25f61b6-5faf-4e05-81a4-dea3dba05dc5 00000020:00000080:0.0:1788843477.920105:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd0059c4000/f25f61b6-5faf-4e05-81a4-dea3dba05dc5 for lustre-OST0000 00000020:00000080:0.0:1788843477.920130:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd0059c1000 for lustre-OST0000 00010000:00010000:3.0:1788843478.170303:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788843478.434903:0:11210:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.111 00000100:00100000:0.0:1788843478.943252:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788843478.943283:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134394496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788843478.943372:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843478.943452:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134394496 00000100:00100000:0.0:1788843478.943462:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134394496 00000100:00100000:0.0:1788843478.943531:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788843478.943540:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134394496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788843478.943593:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788843478.943646:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134394496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843478.943663:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788843478.943723:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134394496:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788843478.944934:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788843478.944951:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134394624:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788843478.945023:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843478.945265:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134394624 00000100:00100000:1.0:1788843478.945273:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134394624 00000100:00100000:1.0:1788843478.945364:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788843478.945375:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134394624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788843478.945407:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788843478.945462:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134394624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843478.945469:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788843478.945701:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134394624:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788843479.194919:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843480.219681:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788843481.049122:0:11307:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.111 00010000:00010000:2.0:1788843481.242358:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843482.032385:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843482.032516:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116498816 00000100:00100000:3.0:1788843482.032530:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116498816 00000100:00100000:3.0:1788843482.032598:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 283 00000100:00100000:3.0:1788843482.032610:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+10:2388:x1875738116498816:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843482.032976:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+10:2388:x1875738116498816:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 367us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843482.033014:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 283 00000100:00100000:1.0:1788843482.033302:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843482.033953:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116499072 00000100:00100000:3.0:1788843482.033964:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116499072 00000100:00100000:3.0:1788843482.034051:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 101 00000100:00100000:3.0:1788843482.034060:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141a76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2388:x1875738116499072:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843482.034138:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141a76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2388:x1875738116499072:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 79us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843482.034168:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 101 00000100:00080000:0.0:1788843482.034754:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788843482.049336:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843482.049419:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116498944 00000100:00100000:3.0:1788843482.049433:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116498944 00000100:00100000:3.0:1788843482.049533:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 102 00000100:00100000:3.0:1788843482.049547:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141a74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2387:x1875738116498944:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843482.049666:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141a74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2387:x1875738116498944:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 122us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843482.049675:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 102 00000100:00080000:0.0:1788843482.050051:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788843482.266299:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843482.522398:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134395008:0@lo:400:kworker.0 00000100:00100000:3.0:1788843482.522519:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843482.522579:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134395520:0@lo:400:kworker.0 00000100:00100000:3.0:1788843482.522611:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843482.522656:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007934700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134396032:0@lo:400:kworker.0 00000100:00100000:3.0:1788843482.522695:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843482.522952:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788843482.522960:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134395136:0@lo:400:kworker.0 00000100:00100000:3.0:1788843482.523011:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843482.523032:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134395648:0@lo:400:kworker.0 00000100:00100000:3.0:1788843482.523058:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843482.523083:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134396160:0@lo:400:kworker.0 00000100:00100000:3.0:1788843482.523106:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843482.523173:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134395520 00000100:00100000:3.0:1788843482.523182:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134395520 00000100:00100000:3.0:1788843482.523243:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134396032 00000100:00100000:3.0:1788843482.523247:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134396032 00000100:00100000:3.0:1788843482.523260:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134395136 00000100:00100000:3.0:1788843482.523262:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134395136 00000100:00100000:3.0:1788843482.523280:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788843482.523290:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134395520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843482.523352:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134395520:12345-0@lo:400:kworker.0 Request processed in 63us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843482.523360:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788843482.523380:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788843482.523386:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134396032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843482.523418:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134396032:12345-0@lo:400:kworker.0 Request processed in 32us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843482.523424:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788843482.523437:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788843482.523443:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134395136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843482.524892:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134394880:0@lo:400:kworker.0 00000100:00100000:2.0:1788843482.524960:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843482.525000:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1875738134395392:0@lo:400:kworker.0 00000100:00100000:2.0:1788843482.525024:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843482.525035:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1875738134395904:0@lo:400:kworker.0 00000100:00100000:2.0:1788843482.525054:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843482.525084:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1788843482.525090:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134394752:0@lo:400:kworker.0 00000100:00100000:2.0:1788843482.525121:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843482.525166:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134395264:0@lo:400:kworker.0 00000100:00100000:2.0:1788843482.525201:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843482.525224:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134395776:0@lo:400:kworker.0 00000100:00100000:0.0:1788843482.525242:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134395008 00000100:00100000:0.0:1788843482.525253:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134395008 00000100:00100000:2.0:1788843482.525263:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843482.525289:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007935180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134396288:0@lo:400:kworker.0 00000100:00100000:0.0:1788843482.525301:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134395264 00000100:00100000:0.0:1788843482.525306:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134395264 00000100:00100000:2.0:1788843482.525318:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843482.525328:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788843482.525340:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134395008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843482.525354:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134394752 00000100:00100000:2.0:1788843482.525359:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134394752 00000100:00100000:2.0:1788843482.525397:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788843482.525407:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3633:x1875738134394752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843482.525410:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134395008:12345-0@lo:400:kworker.0 Request processed in 69us (2887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843482.525419:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788843482.525449:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3633:x1875738134394752:12345-0@lo:400:kworker.0 Request processed in 45us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843482.525453:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788843482.525463:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134395264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843482.525465:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788843482.525506:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134395264:12345-0@lo:400:kworker.0 Request processed in 45us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843482.525507:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134395648 00000100:00100000:2.0:1788843482.525513:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134395648 00000100:00100000:0.0:1788843482.525518:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788843482.525542:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134396160 00000100:00100000:2.0:1788843482.525546:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134395776 00000100:00100000:0.0:1788843482.525547:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134396160 00000100:00100000:2.0:1788843482.525550:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134395776 00000100:00100000:2.0:1788843482.525579:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134396288 00000100:00100000:2.0:1788843482.525582:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134396288 00000100:00100000:0.0:1788843482.525585:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788843482.525596:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134395648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843482.525604:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788843482.525625:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134396160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843482.525635:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134395648:12345-0@lo:400:kworker.0 Request processed in 40us (2574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843482.525642:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788843482.525659:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788843482.525668:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134396160:12345-0@lo:400:kworker.0 Request processed in 55us (2560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843482.525678:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134395776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843482.525688:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788843482.525705:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788843482.525727:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134395776:12345-0@lo:400:kworker.0 Request processed in 52us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843482.525734:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1788843482.525756:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788843482.525761:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788843482.525763:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788843482.525818:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788843482.525827:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134396416:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788843482.525857:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843482.525887:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134396416 00000100:00100000:0.0:1788843482.525891:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134396416 00000100:00100000:0.0:1788843482.525918:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788843482.525925:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134396416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788843482.525949:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843482.525997:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134396416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843482.526003:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1788843482.526044:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007240380 x1875738134396416/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843482.526066:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134396416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788843482.526102:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134395136:12345-0@lo:400:kworker.0 Request processed in 2657us (3089us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843482.526111:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788843482.526137:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134394880 00000100:00100000:3.0:1788843482.526155:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134394880 00000100:00100000:3.0:1788843482.526175:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134395392 00000100:00100000:3.0:1788843482.526178:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134395392 00000100:00100000:3.0:1788843482.526203:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134395904 00000100:00100000:3.0:1788843482.526206:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134395904 00000100:00100000:3.0:1788843482.526224:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788843482.526231:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134394880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843482.526267:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134394880:12345-0@lo:400:kworker.0 Request processed in 37us (1308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843482.526272:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788843482.526283:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788843482.526289:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875738134395392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843482.526317:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875738134395392:12345-0@lo:400:kworker.0 Request processed in 28us (1292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843482.526322:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788843482.526333:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788843482.526339:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875738134395904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843482.526366:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875738134395904:12345-0@lo:400:kworker.0 Request processed in 27us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843482.526371:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1788843482.526403:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843482.526439:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134395136:0@lo:400:kworker.0 00010000:00080000:3.0:1788843482.526453:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007768e00 x1875738134395648/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843482.526461:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134395648:0@lo:400:kworker.0 00010000:00080000:3.0:1788843482.526483:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007937100 x1875738134396160/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843482.526492:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134396160:0@lo:400:kworker.0 00000100:00100000:3.0:1788843482.526505:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134395008:0@lo:400:kworker.0 00010000:00080000:3.0:1788843482.526515:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00776a680 x1875738134395520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843482.526523:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134395520:0@lo:400:kworker.0 00010000:00080000:3.0:1788843482.526533:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007934700 x1875738134396032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843482.526541:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007934700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134396032:0@lo:400:kworker.0 00000100:00100000:2.0:1788843482.527161:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134396288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843482.527208:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134396288:12345-0@lo:400:kworker.0 Request processed in 1498us (1890us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843482.527216:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788843482.527257:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134394752:0@lo:400:kworker.0 00000100:00100000:2.0:1788843482.527275:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134395264:0@lo:400:kworker.0 00010000:00080000:2.0:1788843482.527359:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00776aa00 x1875738134395776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843482.527369:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134395776:0@lo:400:kworker.0 00010000:00080000:2.0:1788843482.527382:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007935180 x1875738134396288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843482.527449:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007935180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134396288:0@lo:400:kworker.0 00000100:00100000:2.0:1788843482.527474:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134394880:0@lo:400:kworker.0 00000100:00100000:2.0:1788843482.527485:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1875738134395392:0@lo:400:kworker.0 00000100:00100000:2.0:1788843482.527496:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1875738134395904:0@lo:400:kworker.0 00000001:02000400:0.0:1788843482.703543:0:11355:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 8 00:58:00 EDT 2026 00000100:00100000:3.0:1788843483.034899:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134396672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843483.035006:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843483.035069:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134396672 00000100:00100000:3.0:1788843483.035074:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134396544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788843483.035079:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134396672 00000100:00100000:3.0:1788843483.035099:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843483.035133:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134396544 00000100:00100000:0.0:1788843483.035137:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134396544 00000100:00100000:3.0:1788843483.035161:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788843483.035172:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134396672:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788843483.035172:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788843483.035191:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007934700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134396544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788843483.035201:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1788843483.035208:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843483.035250:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007934700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134396544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843483.035257:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788843483.036120:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134396800:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788843483.036243:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843483.038212:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134396800 00000100:00100000:1.0:1788843483.038232:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134396800 00000100:00100000:1.0:1788843483.038305:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788843483.038318:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f985180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134396800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788843483.038370:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788843483.038467:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f985180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134396800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 151us (2223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843483.038475:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1788843483.038534:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0079a6d80 x1875738134396800/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843499 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843483.038560:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134396800:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788843483.038787:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134396672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3614us (3778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843483.038796:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1788843483.038840:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f8d1880 x1875738134396672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843499 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843483.038870:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134396672:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788843483.038887:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007240380 x1875738134396544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843499 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843483.038900:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134396544:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788843483.291609:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843484.058962:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134396928:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788843484.059071:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843484.059217:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134397056:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788843484.059253:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843484.059277:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134396928 00000100:00100000:0.0:1788843484.059286:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134396928 00000100:00100000:0.0:1788843484.062344:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134397056 00000100:00100000:0.0:1788843484.062362:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134397056 00000100:00100000:2.0:1788843484.069152:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788843484.069178:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134396928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788843484.069232:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788843484.069349:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134396928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 180us (10278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843484.069357:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788843484.069388:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788843484.069396:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134397056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788843484.069417:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788843484.069464:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134397056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (10210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843484.069470:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788843484.069893:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134397056:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788843484.074377:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134396928:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788843484.314541:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843485.338391:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843486.363323:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843487.148396:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843487.148452:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843487.148494:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843487.148534:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116499456 00000100:00100000:3.0:1788843487.148546:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116499456 00000100:00100000:3.0:1788843487.148608:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116499328 00000100:00100000:3.0:1788843487.148611:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116499328 00000100:00100000:3.0:1788843487.148634:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 109 00000100:00100000:3.0:1788843487.148644:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116499456:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843487.148738:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116499456:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 95us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843487.148747:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 109 00000100:00100000:3.0:1788843487.148766:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 110 00000100:00100000:3.0:1788843487.148773:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2387:x1875738116499328:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843487.148798:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2387:x1875738116499328:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 27us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843487.148820:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 110 00000100:00080000:3.0:1788843487.148838:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788843487.148843:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788843487.148970:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116499200 00000100:00100000:2.0:1788843487.148984:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116499200 00000100:00100000:2.0:1788843487.149021:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 285 00000100:00100000:2.0:1788843487.149029:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+10:2387:x1875738116499200:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843487.149057:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+10:2387:x1875738116499200:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 30us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843487.149064:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 285 00010000:00010000:2.0:1788843487.388197:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843487.643315:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134397184:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788843487.643416:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843487.643558:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134397184 00000100:00100000:0.0:1788843487.643570:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134397184 00000100:00100000:0.0:1788843487.643649:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788843487.643661:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141a77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134397184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788843487.643700:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843487.643752:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141a77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134397184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843487.643760:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1788843487.643827:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788843487.643861:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f986d80 x1875738134397184/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843503 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843487.643883:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134397184:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788843487.646162:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134397440:0@lo:400:kworker.0 00000100:00100000:2.0:1788843487.646248:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843487.646289:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134397952:0@lo:400:kworker.0 00000100:00100000:2.0:1788843487.646312:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843487.646329:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1875738134398464:0@lo:400:kworker.0 00000100:00100000:2.0:1788843487.646351:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843487.646378:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788843487.646384:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134397568:0@lo:400:kworker.0 00000100:00100000:2.0:1788843487.646412:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843487.646432:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134398080:0@lo:400:kworker.0 00000100:00100000:2.0:1788843487.646453:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843487.646469:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134398592:0@lo:400:kworker.0 00000100:00100000:2.0:1788843487.646508:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843487.646556:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134397440 00000100:00100000:2.0:1788843487.646565:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134397440 00000100:00100000:2.0:1788843487.646608:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134397952 00000100:00100000:2.0:1788843487.646611:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134397952 00000100:00100000:2.0:1788843487.646632:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134398464 00000100:00100000:2.0:1788843487.646635:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134398464 00000100:00100000:2.0:1788843487.646648:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134398080 00000100:00100000:2.0:1788843487.646649:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134398080 00000100:00100000:2.0:1788843487.646668:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788843487.646677:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134397440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843487.646733:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134397440:12345-0@lo:400:kworker.0 Request processed in 57us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843487.646741:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788843487.646763:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788843487.646769:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134397952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843487.646794:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134397952:12345-0@lo:400:kworker.0 Request processed in 26us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843487.646922:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788843487.646932:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1875738134398464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843487.646978:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1875738134398464:12345-0@lo:400:kworker.0 Request processed in 48us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843487.646985:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788843487.646998:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788843487.647003:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134398080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843487.647027:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134398080:12345-0@lo:400:kworker.0 Request processed in 24us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843487.647032:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788843487.647051:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134397312:0@lo:400:kworker.0 00000100:00100000:1.0:1788843487.647088:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843487.647111:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134397824:0@lo:400:kworker.0 00000100:00100000:1.0:1788843487.647132:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843487.647177:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1875738134398336:0@lo:400:kworker.0 00000100:00100000:1.0:1788843487.647199:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843487.647218:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788843487.647223:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1875738134397696:0@lo:400:kworker.0 00000100:00100000:1.0:1788843487.647245:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843487.647257:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134398208:0@lo:400:kworker.0 00000100:00100000:1.0:1788843487.647277:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843487.647297:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134398720:0@lo:400:kworker.0 00000100:00100000:1.0:1788843487.647316:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843487.647344:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134397312 00000100:00100000:1.0:1788843487.647350:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134397312 00000100:00100000:1.0:1788843487.647383:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788843487.647391:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3631:x1875738134397312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843487.647424:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3631:x1875738134397312:12345-0@lo:400:kworker.0 Request processed in 35us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843487.647430:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788843487.647461:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134397568 00000100:00100000:1.0:1788843487.647464:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134397568 00000100:00100000:1.0:1788843487.647485:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134397824 00000100:00100000:1.0:1788843487.647487:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134397824 00000100:00100000:1.0:1788843487.647498:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788843487.647504:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134397568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843487.647532:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134397568:12345-0@lo:400:kworker.0 Request processed in 29us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843487.647544:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788843487.647554:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788843487.647559:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141a77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134397824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843487.647589:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141a77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134397824:12345-0@lo:400:kworker.0 Request processed in 30us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843487.647595:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788843487.647613:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134398592 00000100:00100000:1.0:1788843487.647617:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134398592 00000100:00100000:1.0:1788843487.647645:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134398208 00000100:00100000:1.0:1788843487.647648:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134398208 00000100:00100000:1.0:1788843487.647660:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134398720 00000100:00100000:1.0:1788843487.647662:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134398720 00000100:00100000:1.0:1788843487.647675:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788843487.647680:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134398592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843487.647709:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134398592:12345-0@lo:400:kworker.0 Request processed in 29us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843487.647715:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788843487.647723:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788843487.647728:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141a77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134398208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843487.647747:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141a77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134398208:12345-0@lo:400:kworker.0 Request processed in 19us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843487.647752:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788843487.647760:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788843487.647765:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141a75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134398720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843487.647783:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141a75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134398720:12345-0@lo:400:kworker.0 Request processed in 19us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843487.647810:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1788843487.647842:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788843487.647846:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788843487.647849:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788843487.647851:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843487.647859:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134398336 00000100:00100000:1.0:1788843487.647862:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134398336 00000100:00100000:1.0:1788843487.647879:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134397696 00000100:00100000:1.0:1788843487.647881:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134397696 00000100:00100000:1.0:1788843487.647890:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788843487.647895:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141a75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1875738134398336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843487.647921:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141a75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1875738134398336:12345-0@lo:400:kworker.0 Request processed in 26us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843487.647926:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788843487.647934:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788843487.647939:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141a74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1875738134397696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843487.647979:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141a74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1875738134397696:12345-0@lo:400:kworker.0 Request processed in 39us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843487.647985:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:1.0:1788843487.647998:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843487.648037:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1875738134397696:0@lo:400:kworker.0 00010000:00080000:1.0:1788843487.648052:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0079a5f80 x1875738134398208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843487.648064:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134398208:0@lo:400:kworker.0 00010000:00080000:1.0:1788843487.648073:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0079a7800 x1875738134398720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843487.648092:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134398720:0@lo:400:kworker.0 00000100:00100000:1.0:1788843487.648103:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134397312:0@lo:400:kworker.0 00000100:00100000:1.0:1788843487.648113:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134397824:0@lo:400:kworker.0 00000100:00100000:1.0:1788843487.648123:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1875738134398336:0@lo:400:kworker.0 00000100:00100000:2.0:1788843487.648428:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788843487.648487:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134397568:0@lo:400:kworker.0 00010000:00080000:2.0:1788843487.648502:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0079a5500 x1875738134398080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843487.648512:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134398080:0@lo:400:kworker.0 00010000:00080000:2.0:1788843487.648523:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0079a4380 x1875738134398592/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843487.648532:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134398592:0@lo:400:kworker.0 00000100:00100000:2.0:1788843487.648542:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134397440:0@lo:400:kworker.0 00000100:00100000:2.0:1788843487.648552:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134397952:0@lo:400:kworker.0 00010000:00080000:2.0:1788843487.648562:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0079a6680 x1875738134398464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843487.648570:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1875738134398464:0@lo:400:kworker.0 00000100:00100000:1.0:1788843488.154895:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f984380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134398848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788843488.155004:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843488.155082:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134398976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843488.155107:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843488.155249:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788843488.155260:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134399104:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788843488.155293:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843488.155334:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134398848 00000100:00100000:3.0:1788843488.155344:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134398848 00000100:00100000:3.0:1788843488.155388:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134398976 00000100:00100000:3.0:1788843488.155391:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134398976 00000100:00100000:3.0:1788843488.155403:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134399104 00000100:00100000:3.0:1788843488.155405:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134399104 00000100:00100000:3.0:1788843488.155430:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788843488.155440:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141a76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134398848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788843488.155474:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843488.155523:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141a76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134398848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843488.155727:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788843488.155750:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788843488.155758:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141a74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134398976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788843488.155770:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843488.155800:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141a74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134398976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843488.155806:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788843488.155817:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788843488.155824:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134399104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788843488.155855:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843488.155887:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134399104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843488.155893:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1788843488.155931:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00776aa00 x1875738134399104/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843504 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843488.155970:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134399104:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788843488.156010:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f984380 x1875738134398848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843504 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843488.156023:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f984380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134398848:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788843488.156034:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00776b800 x1875738134398976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843504 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843488.156044:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134398976:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788843488.410306:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843489.180391:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788843489.180423:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134399232:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788843489.180524:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843489.180620:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134399232 00000100:00100000:2.0:1788843489.180631:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134399232 00000100:00100000:2.0:1788843489.180696:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788843489.180707:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134399232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788843489.180747:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788843489.180799:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134399232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843489.180813:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788843489.180926:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134399232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788843489.181719:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134399360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788843489.181773:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843489.181987:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134399360 00000100:00100000:0.0:1788843489.181994:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134399360 00000100:00100000:0.0:1788843489.182042:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788843489.182052:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134399360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788843489.182086:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788843489.182136:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134399360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843489.182170:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788843489.182210:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134399360:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788843489.434349:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843490.459304:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843491.484413:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843492.268136:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843492.268201:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843492.268227:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843492.268257:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116499584 00000100:00100000:0.0:1788843492.268265:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116499584 00000100:00100000:0.0:1788843492.268310:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 287 00000100:00100000:0.0:1788843492.268319:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+10:2389:x1875738116499584:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1788843492.268384:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+10:2389:x1875738116499584:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 65us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843492.268391:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 287 00000100:00100000:3.0:1788843492.268511:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116499712 00000100:00100000:3.0:1788843492.268516:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116499712 00000100:00100000:3.0:1788843492.268744:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116499840 00000100:00100000:3.0:1788843492.268748:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116499840 00000100:00100000:3.0:1788843492.268774:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 117 00000100:00100000:3.0:1788843492.268781:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2389:x1875738116499712:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843492.268814:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2389:x1875738116499712:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 34us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843492.268819:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 117 00000100:00100000:3.0:1788843492.268836:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 118 00000100:00100000:3.0:1788843492.268850:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2389:x1875738116499840:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843492.268876:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2389:x1875738116499840:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 27us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843492.268883:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 118 00000100:00080000:3.0:1788843492.268901:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788843492.268904:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788843492.510801:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843492.762517:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843492.762619:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788843492.762649:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1875738134399872:0@lo:400:kworker.0 00000100:00100000:1.0:1788843492.762747:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843492.762850:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134399872 00000100:00100000:1.0:1788843492.762860:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134399872 00000100:00100000:1.0:1788843492.762936:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788843492.762948:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141a77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1875738134399872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843492.763009:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141a77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1875738134399872:12345-0@lo:400:kworker.0 Request processed in 63us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843492.763017:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788843492.763079:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1875738134399872:0@lo:400:kworker.0 00000100:00100000:2.0:1788843492.764031:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134399488:0@lo:400:kworker.0 00000100:00100000:2.0:1788843492.764117:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843492.764303:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134399488 00000100:00100000:2.0:1788843492.764313:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134399488 00000100:00100000:2.0:1788843492.764383:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788843492.764394:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3630:x1875738134399488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843492.764615:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3630:x1875738134399488:12345-0@lo:400:kworker.0 Request processed in 223us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843492.764623:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788843492.764677:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134399488:0@lo:400:kworker.0 00000100:00100000:2.0:1788843492.765926:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134400000:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788843492.765992:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843492.766048:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134400000 00000100:00100000:2.0:1788843492.766056:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134400000 00000100:00100000:2.0:1788843492.766123:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788843492.766132:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134400000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788843492.766192:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788843492.766253:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134400000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843492.766261:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1788843492.766280:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788843492.766316:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007764700 x1875738134400000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843508 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843492.766499:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134400000:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788843492.767355:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134399616:0@lo:400:kworker.0 00000100:00100000:0.0:1788843492.767437:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843492.767475:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134400128:0@lo:400:kworker.0 00000100:00100000:0.0:1788843492.767532:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843492.767555:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1875738134400640:0@lo:400:kworker.0 00000100:00100000:0.0:1788843492.767579:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843492.767601:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788843492.767610:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e87a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134399744:0@lo:400:kworker.0 00000100:00100000:0.0:1788843492.767642:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843492.767660:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134400256:0@lo:400:kworker.0 00000100:00100000:0.0:1788843492.767687:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843492.767706:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1875738134400768:0@lo:400:kworker.0 00000100:00100000:0.0:1788843492.767729:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843492.767790:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134399616 00000100:00100000:0.0:1788843492.767798:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134399616 00000100:00100000:0.0:1788843492.767845:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134400640 00000100:00100000:0.0:1788843492.767849:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134400640 00000100:00100000:0.0:1788843492.767881:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134400256 00000100:00100000:0.0:1788843492.767884:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134400256 00000100:00100000:0.0:1788843492.767898:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134400768 00000100:00100000:0.0:1788843492.767900:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134400768 00000100:00100000:0.0:1788843492.767929:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788843492.767938:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134399616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843492.767994:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134399616:12345-0@lo:400:kworker.0 Request processed in 56us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843492.768002:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788843492.768021:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788843492.768028:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1875738134400640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843492.768061:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1875738134400640:12345-0@lo:400:kworker.0 Request processed in 34us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843492.768078:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788843492.768096:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788843492.768102:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134400256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843492.768134:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134400256:12345-0@lo:400:kworker.0 Request processed in 32us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843492.768160:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788843492.768173:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788843492.768180:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1875738134400768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843492.768196:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134400128 00000100:00100000:1.0:1788843492.768202:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134400128 00000100:00100000:0.0:1788843492.768212:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1875738134400768:12345-0@lo:400:kworker.0 Request processed in 32us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843492.768220:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:0.0:1788843492.768242:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788843492.768246:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843492.768252:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134399744 00000100:00100000:1.0:1788843492.768257:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134399744 00000100:00100000:1.0:1788843492.768277:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788843492.768284:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134400256:0@lo:400:kworker.0 00000100:00100000:1.0:1788843492.768287:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134400128:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788843492.768308:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd1203d1880 x1875738134400768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843492.768319:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1875738134400768:0@lo:400:kworker.0 00000100:00100000:0.0:1788843492.768331:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134399616:0@lo:400:kworker.0 00000100:00100000:1.0:1788843492.768344:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134400128:12345-0@lo:400:kworker.0 Request processed in 58us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843492.768348:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134400128:0@lo:400:kworker.0 00000100:00100000:1.0:1788843492.768356:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788843492.768364:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1875738134400640:0@lo:400:kworker.0 00000100:00100000:1.0:1788843492.768375:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788843492.768383:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1331e7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134399744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843492.768513:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134400384:0@lo:400:kworker.0 00000100:00100000:2.0:1788843492.768565:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843492.768594:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134400896:0@lo:400:kworker.0 00000100:00100000:2.0:1788843492.768626:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843492.768651:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788843492.768658:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134400512:0@lo:400:kworker.0 00000100:00100000:2.0:1788843492.768681:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843492.768701:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134401024:0@lo:400:kworker.0 00000100:00100000:2.0:1788843492.768724:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843492.768755:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134400896 00000100:00100000:2.0:1788843492.768759:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134400896 00000100:00100000:2.0:1788843492.768801:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134400512 00000100:00100000:2.0:1788843492.768805:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134400512 00000100:00100000:2.0:1788843492.768824:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134401024 00000100:00100000:2.0:1788843492.768827:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134401024 00000100:00100000:2.0:1788843492.768845:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788843492.768851:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134400896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843492.768897:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134400896:12345-0@lo:400:kworker.0 Request processed in 47us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843492.768902:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788843492.768931:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788843492.768938:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134400512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843492.768968:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134400512:12345-0@lo:400:kworker.0 Request processed in 32us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843492.768986:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788843492.768999:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788843492.769006:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134401024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843492.769037:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134401024:12345-0@lo:400:kworker.0 Request processed in 33us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843492.769043:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1788843492.769067:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788843492.769071:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788843492.769100:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd1203d3480 x1875738134400512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843492.769111:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134400512:0@lo:400:kworker.0 00010000:00080000:2.0:1788843492.769121:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd1203d1500 x1875738134401024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843492.769179:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134400384 00000100:00100000:0.0:1788843492.769183:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134400384 00000100:00100000:2.0:1788843492.769218:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134401024:0@lo:400:kworker.0 00010000:00080000:2.0:1788843492.769233:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd1203d2680 x1875738134400896/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843492.769241:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134400896:0@lo:400:kworker.0 00000100:00100000:0.0:1788843492.769273:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788843492.769289:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134400384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843492.769483:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134400384:12345-0@lo:400:kworker.0 Request processed in 121us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843492.769490:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:0.0:1788843492.769565:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788843492.769640:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd1203d3100 x1875738134400384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843492.769651:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134400384:0@lo:400:kworker.0 00000100:00100000:1.0:1788843492.771184:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1331e7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134399744:12345-0@lo:400:kworker.0 Request processed in 2789us (3527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843492.771199:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788843492.772178:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e87a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134399744:0@lo:400:kworker.0 00000100:00100000:0.0:1788843493.275378:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134401152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788843493.275479:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843493.275583:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788843493.275590:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134401280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788843493.275615:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843493.275892:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134401152 00000100:00100000:3.0:1788843493.275902:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134401152 00000100:00100000:3.0:1788843493.275966:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134401280 00000100:00100000:3.0:1788843493.275969:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134401280 00000100:00100000:3.0:1788843493.275984:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788843493.275993:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134401152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788843493.276018:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843493.276072:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134401152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843493.276079:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788843493.276097:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788843493.276102:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134401280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788843493.276118:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843493.276165:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134401280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843493.276171:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1788843493.276221:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0059dd880 x1875738134401280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843509 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843493.276242:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134401280:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788843493.276275:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00776b800 x1875738134401152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843509 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843493.276287:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134401152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788843493.276780:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134401408:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788843493.276821:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843493.276861:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134401408 00000100:00100000:2.0:1788843493.276873:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134401408 00000100:00100000:2.0:1788843493.276898:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788843493.276904:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134401408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788843493.276929:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788843493.276958:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134401408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843493.276964:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1788843493.276991:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007764e00 x1875738134401408/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843509 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843493.277003:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134401408:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788843493.532349:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843494.298407:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134401536:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788843494.298509:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843494.299033:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134401664:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788843494.299074:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843494.299191:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134401536 00000100:00100000:1.0:1788843494.299200:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134401536 00000100:00100000:1.0:1788843494.299263:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134401664 00000100:00100000:1.0:1788843494.299267:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134401664 00000100:00100000:1.0:1788843494.299285:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788843494.299296:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134401536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788843494.299341:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788843494.299392:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134401536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843494.299400:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788843494.299418:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788843494.299425:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141a75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134401664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788843494.299443:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788843494.299497:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141a75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134401664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843494.299504:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788843494.299760:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134401536:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788843494.299818:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134401664:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788843494.557662:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843495.578620:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843496.605654:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843497.390581:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843497.390666:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843497.390707:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843497.390779:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116500224 00000100:00100000:2.0:1788843497.390791:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116500224 00000100:00100000:2.0:1788843497.390872:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116500096 00000100:00100000:2.0:1788843497.390876:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116500096 00000100:00100000:2.0:1788843497.390912:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 125 00000100:00100000:2.0:1788843497.390924:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141a75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2389:x1875738116500224:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843497.391017:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141a75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2389:x1875738116500224:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 95us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843497.391025:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 125 00000100:00100000:2.0:1788843497.391044:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 126 00000100:00100000:2.0:1788843497.391050:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141a75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2389:x1875738116500096:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843497.391076:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141a75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2389:x1875738116500096:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 26us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843497.391082:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 126 00000100:00080000:1.0:1788843497.391127:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788843497.391133:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788843497.391320:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116499968 00000100:00100000:0.0:1788843497.391325:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116499968 00000100:00100000:0.0:1788843497.391391:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 289 00000100:00100000:0.0:1788843497.391400:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+10:2389:x1875738116499968:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1788843497.391428:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+10:2389:x1875738116499968:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 31us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843497.391435:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 289 00010000:00010000:2.0:1788843497.626638:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788843497.718658:0:11984:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 00:58:15 (1788843495) === 00000100:00100000:0.0:1788843497.884593:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788843497.884634:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134401792:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788843497.884734:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843497.884821:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134401792 00000100:00100000:0.0:1788843497.884832:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134401792 00000100:00100000:0.0:1788843497.884921:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788843497.884933:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134401792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788843497.884968:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843497.885018:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134401792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843497.885025:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1788843497.885050:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788843497.885086:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0059dd180 x1875738134401792/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843513 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843497.885108:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134401792:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788843497.885555:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141a76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134401920:0@lo:400:kworker.0 00000100:00100000:2.0:1788843497.885603:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843497.885644:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134402432:0@lo:400:kworker.0 00000100:00100000:2.0:1788843497.885673:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843497.885695:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1875738134402944:0@lo:400:kworker.0 00000100:00100000:2.0:1788843497.885719:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843497.885740:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788843497.885746:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141a74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134402048:0@lo:400:kworker.0 00000100:00100000:2.0:1788843497.885768:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843497.885786:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134402560:0@lo:400:kworker.0 00000100:00100000:2.0:1788843497.885807:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843497.885823:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134403072:0@lo:400:kworker.0 00000100:00100000:2.0:1788843497.885842:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843497.885867:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141a76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134402304:0@lo:400:kworker.0 00000100:00100000:2.0:1788843497.885903:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843497.885915:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134402816:0@lo:400:kworker.0 00000100:00100000:2.0:1788843497.885938:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843497.885955:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134403328:0@lo:400:kworker.0 00000100:00100000:2.0:1788843497.885976:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843497.885994:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788843497.885999:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141a74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134402176:0@lo:400:kworker.0 00000100:00100000:2.0:1788843497.886023:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843497.886041:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1875738134402688:0@lo:400:kworker.0 00000100:00100000:2.0:1788843497.886105:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843497.886116:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134403200:0@lo:400:kworker.0 00000100:00100000:2.0:1788843497.886137:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843497.886200:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134402432 00000100:00100000:2.0:1788843497.886206:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134402432 00000100:00100000:2.0:1788843497.886243:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134402176 00000100:00100000:2.0:1788843497.886245:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134402176 00000100:00100000:2.0:1788843497.886260:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788843497.886267:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134402432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843497.886318:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134402432:12345-0@lo:400:kworker.0 Request processed in 51us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843497.886324:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788843497.886341:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788843497.886347:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134402176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843497.886381:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134402176:12345-0@lo:400:kworker.0 Request processed in 35us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843497.886387:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788843497.886406:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134402944 00000100:00100000:2.0:1788843497.886409:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134402944 00000100:00100000:2.0:1788843497.886441:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134402048 00000100:00100000:2.0:1788843497.886444:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134402048 00000100:00100000:2.0:1788843497.886454:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134402560 00000100:00100000:2.0:1788843497.886457:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134402560 00000100:00100000:2.0:1788843497.886471:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134403072 00000100:00100000:2.0:1788843497.886474:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134403072 00000100:00100000:2.0:1788843497.886487:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134402304 00000100:00100000:2.0:1788843497.886489:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134402304 00000100:00100000:2.0:1788843497.886499:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134402688 00000100:00100000:2.0:1788843497.886501:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134402688 00000100:00100000:2.0:1788843497.886525:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788843497.886531:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875738134402944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843497.886564:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875738134402944:12345-0@lo:400:kworker.0 Request processed in 33us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843497.886570:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788843497.886583:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788843497.886588:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134402048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843497.886616:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134402048:12345-0@lo:400:kworker.0 Request processed in 28us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843497.886622:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788843497.886634:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788843497.886641:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134402560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843497.886666:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134402560:12345-0@lo:400:kworker.0 Request processed in 26us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843497.886671:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788843497.886682:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788843497.886688:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134403072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843497.886712:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134403072:12345-0@lo:400:kworker.0 Request processed in 25us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843497.886718:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788843497.886729:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788843497.886735:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134402304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843497.886760:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134402304:12345-0@lo:400:kworker.0 Request processed in 25us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843497.886765:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788843497.886785:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788843497.886790:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875738134402688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843497.886818:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875738134402688:12345-0@lo:400:kworker.0 Request processed in 28us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843497.886824:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788843497.886859:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134402816 00000100:00100000:2.0:1788843497.886863:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134402816 00000100:00100000:2.0:1788843497.886903:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134403328 00000100:00100000:2.0:1788843497.886905:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134403328 00000100:00100000:2.0:1788843497.886917:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134403200 00000100:00100000:2.0:1788843497.886919:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134403200 00000100:00100000:2.0:1788843497.886931:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788843497.886937:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134402816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843497.886970:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134402816:12345-0@lo:400:kworker.0 Request processed in 33us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843497.886976:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788843497.886987:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788843497.886993:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134403328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843497.887020:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134403328:12345-0@lo:400:kworker.0 Request processed in 27us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843497.887025:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788843497.887035:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788843497.887040:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134403200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843497.887064:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134403200:12345-0@lo:400:kworker.0 Request processed in 25us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843497.887070:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788843497.887127:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141a74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134402176:0@lo:400:kworker.0 00010000:00080000:2.0:1788843497.887183:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f956300 x1875738134402688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843497.887194:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1875738134402688:0@lo:400:kworker.0 00010000:00080000:2.0:1788843497.887205:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f954380 x1875738134403200/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843497.887213:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134403200:0@lo:400:kworker.0 00000100:00100000:2.0:1788843497.887223:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141a76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134402304:0@lo:400:kworker.0 00010000:00080000:2.0:1788843497.887231:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f955500 x1875738134402816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843497.887238:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134402816:0@lo:400:kworker.0 00010000:00080000:2.0:1788843497.887247:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f8d0e00 x1875738134403328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843497.887255:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134403328:0@lo:400:kworker.0 00000100:00100000:2.0:1788843497.887297:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141a74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134402048:0@lo:400:kworker.0 00000100:00100000:2.0:1788843497.887308:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134402560:0@lo:400:kworker.0 00010000:00080000:2.0:1788843497.887318:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f957480 x1875738134403072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843497.887326:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134403072:0@lo:400:kworker.0 00000100:00100000:2.0:1788843497.887337:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134402432:0@lo:400:kworker.0 00000100:00100000:2.0:1788843497.887349:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1875738134402944:0@lo:400:kworker.0 00000100:00100000:1.0:1788843497.888086:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134401920 00000100:00100000:1.0:1788843497.888096:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134401920 00000100:00100000:1.0:1788843497.888182:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788843497.888192:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3630:x1875738134401920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843497.888265:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3630:x1875738134401920:12345-0@lo:400:kworker.0 Request processed in 75us (2661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843497.888272:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788843497.888319:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141a76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134401920:0@lo:400:kworker.0 00000100:00080000:0.0:1788843497.888492:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788843497.888498:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788843497.888502:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788843497.888504:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843498.163120:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843498.166569:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116500352 00000100:00100000:1.0:1788843498.166592:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116500352 00000100:00100000:1.0:1788843498.166856:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 291 00000100:00100000:1.0:1788843498.166871:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+10:8710:x1875738116500352:12345-192.168.203.33@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788843498.166903:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843498.166930:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd13fb34000/0xa762dfcbd58d1116 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf24d95f224907e5 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843498.166967:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd13fb34000/0xa762dfcbd58d1116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224907e5 expref: 11 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843498.167006:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd13fb34000/0xa762dfcbd58d1116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224907e5 expref: 11 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843498.167018:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fb34000, rc 0) 00000100:00100000:1.0:1788843498.167767:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+11:8710:x1875738116500352:12345-192.168.203.33@tcp:101:mount.lustre.0 Request processed in 895us (4660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843498.167777:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 291 00000100:00100000:0.0:1788843498.178612:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843498.178796:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116500480 00000100:00100000:1.0:1788843498.178809:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116500480 00000100:00100000:1.0:1788843498.178890:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 292 00000100:00100000:1.0:1788843498.178902:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+11:8710:x1875738116500480:12345-192.168.203.33@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788843498.185902:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+11:8710:x1875738116500480:12345-192.168.203.33@tcp:501:mount.lustre.0 Request processed in 6976us (7280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843498.185921:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 292 00000100:00100000:2.0:1788843498.193826:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843498.193947:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116500608 00000100:00100000:0.0:1788843498.193961:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116500608 00000100:00100000:0.0:1788843498.194035:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 293 00000100:00100000:0.0:1788843498.194048:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+11:8710:x1875738116500608:12345-192.168.203.33@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788843498.194384:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+11:8710:x1875738116500608:12345-192.168.203.33@tcp:503:mount.lustre.0 Request processed in 336us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843498.194403:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 293 00000100:00100000:0.0:1788843498.204133:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843498.204310:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116500736 00000100:00100000:1.0:1788843498.204324:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116500736 00000100:00100000:1.0:1788843498.204972:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 294 00000100:00100000:1.0:1788843498.204991:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+11:8714:x1875738116500736:12345-192.168.203.33@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788843498.205303:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+11:8714:x1875738116500736:12345-192.168.203.33@tcp:502:llog_process_th.0 Request processed in 317us (1184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843498.205313:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 294 00000100:00100000:2.0:1788843498.229290:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843498.231782:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116500864 00000100:00100000:0.0:1788843498.231803:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116500864 00000100:00100000:0.0:1788843498.231895:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 295 00000100:00100000:0.0:1788843498.231908:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+11:8714:x1875738116500864:12345-192.168.203.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788843498.233269:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+11:8714:x1875738116500864:12345-192.168.203.33@tcp:502:llog_process_th.0 Request processed in 1353us (3983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843498.233283:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 295 00000100:00100000:2.0:1788843498.241234:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843498.241400:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116500992 00000100:00100000:3.0:1788843498.241415:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116500992 00000100:00100000:3.0:1788843498.241757:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 296 00000100:00100000:3.0:1788843498.241772:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+11:8714:x1875738116500992:12345-192.168.203.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788843498.241984:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+11:8714:x1875738116500992:12345-192.168.203.33@tcp:502:llog_process_th.0 Request processed in 215us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843498.241993:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 296 00000100:00100000:3.0:1788843498.244890:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843498.245027:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116501120 00000100:00100000:0.0:1788843498.245040:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116501120 00000100:00100000:0.0:1788843498.245136:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 297 00000100:00100000:0.0:1788843498.245179:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+11:8710:x1875738116501120:12345-192.168.203.33@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788843498.245199:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843498.245222:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd10fa3c400/0xa762dfcbd58d111d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490816 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843498.245257:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd10fa3c400/0xa762dfcbd58d111d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490816 expref: 12 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843498.245271:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd10fa3c400/0xa762dfcbd58d111d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490816 expref: 12 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843498.245281:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3c400, rc 0) 00000100:00100000:0.0:1788843498.245416:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+12:8710:x1875738116501120:12345-192.168.203.33@tcp:101:mount.lustre.0 Request processed in 238us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843498.245445:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 297 00000100:00100000:0.0:1788843498.252396:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843498.252607:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116501248 00000100:00100000:1.0:1788843498.252629:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116501248 00000100:00100000:1.0:1788843498.252700:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 298 00000100:00100000:1.0:1788843498.252712:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+12:8710:x1875738116501248:12345-192.168.203.33@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788843498.252764:0:6501:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788843498.252786:0:6501:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788843498.252791:0:6501:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788843498.252794:0:6501:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788843498.252797:0:6501:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788843498.252799:0:6501:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1788843498.255231:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+12:8710:x1875738116501248:12345-192.168.203.33@tcp:256:mount.lustre.0 Request processed in 2505us (2833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843498.255251:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 298 00000100:00100000:2.0:1788843498.259005:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843498.259258:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116501376 00000100:00100000:0.0:1788843498.259272:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116501376 00000100:00100000:0.0:1788843498.259340:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 299 00000100:00100000:0.0:1788843498.259352:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+12:8710:x1875738116501376:12345-192.168.203.33@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788843498.259373:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843498.259395:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd10fa3dc00/0xa762dfcbd58d1124 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf24d95f2249081d expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843498.259432:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd10fa3dc00/0xa762dfcbd58d1124 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249081d expref: 13 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843498.259445:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd10fa3dc00/0xa762dfcbd58d1124 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249081d expref: 13 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843498.259456:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3dc00, rc 0) 00000100:00100000:0.0:1788843498.259701:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+13:8710:x1875738116501376:12345-192.168.203.33@tcp:101:mount.lustre.0 Request processed in 350us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843498.259709:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 299 00000100:00100000:1.0:1788843498.268423:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843498.268678:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116501504 00000100:00100000:2.0:1788843498.268693:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116501504 00000100:00100000:2.0:1788843498.268814:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 300 00000100:00100000:2.0:1788843498.268827:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+13:8710:x1875738116501504:12345-192.168.203.33@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788843498.269045:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+13:8710:x1875738116501504:12345-192.168.203.33@tcp:501:mount.lustre.0 Request processed in 220us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843498.269054:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 300 00000100:00100000:2.0:1788843498.273910:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843498.274203:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116501632 00000100:00100000:0.0:1788843498.274218:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116501632 00000100:00100000:0.0:1788843498.274292:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 301 00000100:00100000:0.0:1788843498.274304:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+13:8710:x1875738116501632:12345-192.168.203.33@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788843498.274485:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+13:8710:x1875738116501632:12345-192.168.203.33@tcp:503:mount.lustre.0 Request processed in 182us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843498.274505:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 301 00000100:00100000:0.0:1788843498.280057:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843498.280258:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116501760 00000100:00100000:2.0:1788843498.280282:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116501760 00000100:00100000:2.0:1788843498.280358:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 302 00000100:00100000:2.0:1788843498.280371:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+13:8718:x1875738116501760:12345-192.168.203.33@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788843498.282192:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+13:8718:x1875738116501760:12345-192.168.203.33@tcp:502:llog_process_th.0 Request processed in 1806us (2132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843498.282209:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 302 00000100:00100000:1.0:1788843498.290517:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843498.293434:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116501888 00000100:00100000:0.0:1788843498.293457:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116501888 00000100:00100000:1.0:1788843498.299898:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 303 00000100:00100000:1.0:1788843498.299921:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+13:8718:x1875738116501888:12345-192.168.203.33@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788843498.300178:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+13:8718:x1875738116501888:12345-192.168.203.33@tcp:502:llog_process_th.0 Request processed in 263us (9674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843498.300187:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 303 00000100:00100000:2.0:1788843498.304903:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843498.305013:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843498.305045:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843498.305073:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843498.305107:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116502016 00000100:00100000:2.0:1788843498.305119:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116502016 00000100:00100000:2.0:1788843498.305183:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116502656 00000100:00100000:2.0:1788843498.305202:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116502656 00000100:00100000:2.0:1788843498.305233:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116502784 00000100:00100000:2.0:1788843498.305236:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116502784 00000100:00100000:2.0:1788843498.305247:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116502272 00000100:00100000:2.0:1788843498.305250:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116502272 00000100:00100000:2.0:1788843498.305263:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 133 00000100:00100000:2.0:1788843498.305274:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2388:x1875738116502656:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1788843498.305389:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 16 00000100:00100000:0.0:1788843498.305396:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2386:x1875738116502016:12345-192.168.203.33@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788843498.305435:0:6508:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from bdfa9d4d-a4fc-4db6-8668-5ed8e821acee@192.168.203.33@tcp t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:0.0:1788843498.305482:0:6508:0:(genops.c:1385:class_connect()) connect: client bdfa9d4d-a4fc-4db6-8668-5ed8e821acee, cookie 0xa762dfcbd58d112b 00000004:00100000:0.0:1788843498.305516:0:6508:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788843498.305796:0:6508:0:(import.c:65:import_set_state_nolock()) ffff9bd007224800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788843498.305897:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+6:2386:x1875738116502016:12345-192.168.203.33@tcp:38:mount.lustre.0 Request processed in 499us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843498.305907:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 16 00000100:00100000:0.0:1788843498.305927:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 134 00000100:00100000:0.0:1788843498.305934:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2388:x1875738116502784:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843498.306254:0:9517:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788843498.306265:0:9517:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1788843498.306406:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2388:x1875738116502656:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 1134us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843498.306413:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 133 00000100:00100000:2.0:1788843498.306430:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 17 00000100:00100000:2.0:1788843498.306434:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2386:x1875738116502272:12345-192.168.203.33@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788843498.306453:0:6506:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from bdfa9d4d-a4fc-4db6-8668-5ed8e821acee@192.168.203.33@tcp t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:2.0:1788843498.306482:0:6506:0:(genops.c:1385:class_connect()) connect: client bdfa9d4d-a4fc-4db6-8668-5ed8e821acee, cookie 0xa762dfcbd58d1132 00000004:00100000:2.0:1788843498.306501:0:6506:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788843498.307443:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2388:x1875738116502784:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 1501us (2389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843498.307454:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 134 00000100:00080000:2.0:1788843498.308133:0:6506:0:(import.c:65:import_set_state_nolock()) ffff9bd13fabe800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788843498.308189:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+6:2386:x1875738116502272:12345-192.168.203.33@tcp:38:mount.lustre.0 Request processed in 1751us (3114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843498.308198:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 17 00000100:00100000:2.0:1788843498.313120:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843498.313192:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843498.313294:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843498.313393:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116502528 00000100:00100000:1.0:1788843498.313393:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116502144 00000100:00100000:3.0:1788843498.313405:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116502528 00000100:00100000:1.0:1788843498.313405:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116502144 00000100:00100000:0.0:1788843498.313479:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116502400 00000100:00100000:0.0:1788843498.313484:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116502400 00000100:00100000:0.0:1788843498.313556:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 18 00000100:00100000:0.0:1788843498.313568:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141a76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+6:0:x1875738116502400:12345-192.168.203.33@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788843498.313616:0:11996:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788843498.313776:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 19 00000100:00100000:0.0:1788843498.313871:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141a76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+6:0:x1875738116502400:12345-192.168.203.33@tcp:41:mount.lustre.0 Request processed in 304us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843498.313909:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 18 00000100:00080000:2.0:1788843498.314279:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843498.316850:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+7:8710:x1875738116502528:12345-192.168.203.33@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788843498.317123:0:9517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788843498.317259:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+7:8710:x1875738116502528:12345-192.168.203.33@tcp:41:mount.lustre.0 Request processed in 3474us (4065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843498.317269:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 19 00000100:00100000:3.0:1788843498.317308:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 20 00000100:00100000:3.0:1788843498.317319:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+6:0:x1875738116502144:12345-192.168.203.33@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788843498.317330:0:9517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00080000:2.0:1788843498.317440:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788843498.317609:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+6:0:x1875738116502144:12345-192.168.203.33@tcp:41:mount.lustre.0 Request processed in 291us (4505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843498.317634:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 20 00000100:00100000:2.0:1788843498.331202:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843498.331664:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116502912 00000100:00100000:0.0:1788843498.331677:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116502912 00000100:00100000:0.0:1788843498.331752:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 21 00000100:00100000:0.0:1788843498.331765:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141a77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+6:8710:x1875738116502912:12345-192.168.203.33@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788843498.331888:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141a77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+6:8710:x1875738116502912:12345-192.168.203.33@tcp:40:mount.lustre.0 Request processed in 125us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843498.331896:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 21 00000100:00100000:2.0:1788843498.335759:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843498.335871:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843498.335945:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843498.336049:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116503040 00000100:00100000:0.0:1788843498.336062:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116503040 00000100:00100000:0.0:1788843498.336109:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116503168 00000100:00100000:0.0:1788843498.336111:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116503168 00000100:00100000:0.0:1788843498.336132:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 20 00000100:00100000:0.0:1788843498.336174:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141a76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2386:x1875738116503040:12345-192.168.203.33@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788843498.336218:0:8423:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from bdfa9d4d-a4fc-4db6-8668-5ed8e821acee@192.168.203.33@tcp t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:0.0:1788843498.336257:0:8423:0:(genops.c:1385:class_connect()) connect: client bdfa9d4d-a4fc-4db6-8668-5ed8e821acee, cookie 0xa762dfcbd58d1139 00002000:00100000:0.0:1788843498.336272:0:8423:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bdfa9d4d-a4fc-4db6-8668-5ed8e821acee/ffff9bd007225000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788843498.336295:0:8423:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788843498.336402:0:8423:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788843498.336440:0:8423:0:(import.c:65:import_set_state_nolock()) ffff9bd007227800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788843498.336520:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141a76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+6:2386:x1875738116503040:12345-192.168.203.33@tcp:8:mount.lustre.0 Request processed in 378us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843498.336529:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 20 00000100:00100000:0.0:1788843498.336559:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 21 00000100:00100000:0.0:1788843498.336564:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141a74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2386:x1875738116503168:12345-192.168.203.33@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788843498.336591:0:8423:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from bdfa9d4d-a4fc-4db6-8668-5ed8e821acee@192.168.203.33@tcp t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:0.0:1788843498.336622:0:8423:0:(genops.c:1385:class_connect()) connect: client bdfa9d4d-a4fc-4db6-8668-5ed8e821acee, cookie 0xa762dfcbd58d1140 00002000:00100000:0.0:1788843498.336627:0:8423:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bdfa9d4d-a4fc-4db6-8668-5ed8e821acee/ffff9bd007222800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788843498.336641:0:8423:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788843498.336680:0:8423:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788843498.336696:0:8423:0:(import.c:65:import_set_state_nolock()) ffff9bd007226800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788843498.336719:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141a74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+6:2386:x1875738116503168:12345-192.168.203.33@tcp:8:mount.lustre.0 Request processed in 153us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843498.336727:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 21 00000100:00100000:1.0:1788843498.339345:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116503296 00000100:00100000:1.0:1788843498.339365:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116503296 00000100:00100000:2.0:1788843498.343537:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 5 00000100:00100000:2.0:1788843498.343555:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141a74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+6:8710:x1875738116503296:12345-192.168.203.33@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788843498.343683:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141a74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+6:8710:x1875738116503296:12345-192.168.203.33@tcp:900:mount.lustre.0 Request processed in 131us (7940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843498.343693:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 5 00000100:00100000:1.0:1788843498.350278:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843498.350588:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116503424 00000100:00100000:3.0:1788843498.350601:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116503424 00000100:00100000:3.0:1788843498.350729:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1 00000100:00100000:3.0:1788843498.350742:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+6:8710:x1875738116503424:12345-192.168.203.33@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788843498.350861:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788843498.350995:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+6:8710:x1875738116503424:12345-192.168.203.33@tcp:33:mount.lustre.0 Request processed in 254us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843498.351004:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1 00000100:00100000:0.0:1788843498.394910:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788843498.394950:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134403456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788843498.395047:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843498.395420:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134403456 00000100:00100000:2.0:1788843498.395431:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134403456 00000100:00100000:2.0:1788843498.395498:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788843498.395511:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134403456:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788843498.395816:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134403712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843498.395856:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843498.395903:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134403712 00000100:00100000:3.0:1788843498.395907:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134403712 00000100:00100000:3.0:1788843498.395929:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788843498.395945:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134403712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788843498.395961:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843498.396009:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134403712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843498.396016:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1788843498.396061:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00776aa00 x1875738134403712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843514 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843498.396082:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134403712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843498.396105:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134403584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843498.396126:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843498.396183:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134403584 00000100:00100000:3.0:1788843498.396187:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134403584 00000100:00100000:3.0:1788843498.396202:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788843498.396208:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134403584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788843498.396235:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843498.396265:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134403584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843498.396272:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1788843498.396295:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00776b800 x1875738134403584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843514 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843498.396308:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134403584:0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788843498.397434:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788843498.397520:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134403456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2008us (2470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843498.397529:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1788843498.407825:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f984700 x1875738134403456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843514 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843498.407860:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134403456:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788843498.651946:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843499.422130:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134403840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788843499.422244:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843499.422345:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134403968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788843499.422373:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843499.422418:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134403840 00000100:00100000:0.0:1788843499.422427:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134403840 00000100:00100000:0.0:1788843499.422480:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134403968 00000100:00100000:0.0:1788843499.422483:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134403968 00000100:00100000:0.0:1788843499.422503:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788843499.422513:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007934e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134403840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788843499.422557:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788843499.422611:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007934e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134403840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843499.422633:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788843499.422651:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788843499.422657:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007935500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134403968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788843499.422675:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788843499.422710:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007935500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134403968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843499.422716:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788843499.422763:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134403968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788843499.422797:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134403840:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788843499.683814:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843500.698433:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843501.725110:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843502.746862:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843503.003059:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843503.003095:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134404096:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788843503.003225:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843503.003556:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134404096 00000100:00100000:2.0:1788843503.003568:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134404096 00000100:00100000:2.0:1788843503.003645:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788843503.003657:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134404096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788843503.003697:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788843503.003761:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134404096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843503.003768:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:2.0:1788843503.003822:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007936680 x1875738134404096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843519 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843503.003855:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134404096:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788843503.004220:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134404352:0@lo:400:kworker.0 00000100:00100000:0.0:1788843503.004261:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843503.004285:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1875738134404864:0@lo:400:kworker.0 00000100:00100000:0.0:1788843503.004306:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843503.004320:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134405376:0@lo:400:kworker.0 00000100:00100000:0.0:1788843503.004340:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843503.004357:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788843503.004362:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134404224:0@lo:400:kworker.0 00000100:00100000:0.0:1788843503.004388:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843503.004422:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134404736:0@lo:400:kworker.0 00000100:00100000:0.0:1788843503.004446:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843503.004463:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1875738134405248:0@lo:400:kworker.0 00000100:00100000:0.0:1788843503.004482:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843503.004512:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134404736 00000100:00100000:0.0:1788843503.004535:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134404736 00000100:00100000:0.0:1788843503.004573:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788843503.004580:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134404736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843503.004626:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134404736:12345-0@lo:400:kworker.0 Request processed in 46us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843503.004633:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788843503.004654:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134404352 00000100:00100000:0.0:1788843503.004657:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134404352 00000100:00100000:0.0:1788843503.004681:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134404864 00000100:00100000:0.0:1788843503.004683:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134404864 00000100:00100000:0.0:1788843503.004699:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134405376 00000100:00100000:0.0:1788843503.004701:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134405376 00000100:00100000:0.0:1788843503.004713:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134405248 00000100:00100000:0.0:1788843503.004715:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134405248 00000100:00100000:0.0:1788843503.004729:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788843503.004735:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e87a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134404352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843503.004768:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e87a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134404352:12345-0@lo:400:kworker.0 Request processed in 34us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843503.004775:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788843503.004787:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788843503.004793:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e87aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875738134404864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843503.004818:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e87aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875738134404864:12345-0@lo:400:kworker.0 Request processed in 26us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843503.004824:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788843503.004835:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788843503.004851:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e87b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875738134405376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843503.004877:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e87b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875738134405376:12345-0@lo:400:kworker.0 Request processed in 37us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843503.004893:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788843503.004904:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788843503.004910:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e87ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875738134405248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843503.004951:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e87ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875738134405248:12345-0@lo:400:kworker.0 Request processed in 41us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843503.004957:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788843503.004993:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134404736:0@lo:400:kworker.0 00000100:00100000:0.0:1788843503.005004:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1875738134405248:0@lo:400:kworker.0 00000100:00100000:0.0:1788843503.005013:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134404352:0@lo:400:kworker.0 00000100:00100000:0.0:1788843503.005021:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1875738134404864:0@lo:400:kworker.0 00010000:00080000:0.0:1788843503.005031:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd1203d3480 x1875738134405376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843503.005041:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134405376:0@lo:400:kworker.0 00000100:00080000:1.0:1788843503.005310:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788843503.005316:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788843503.005319:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843503.005394:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1875738134404608:0@lo:400:kworker.0 00000100:00100000:3.0:1788843503.005445:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843503.005474:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134405120:0@lo:400:kworker.0 00000100:00100000:3.0:1788843503.005500:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843503.005538:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134405632:0@lo:400:kworker.0 00000100:00100000:3.0:1788843503.005560:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843503.005584:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788843503.005591:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134404480:0@lo:400:kworker.0 00000100:00100000:3.0:1788843503.005612:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843503.005629:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1875738134404992:0@lo:400:kworker.0 00000100:00100000:3.0:1788843503.005660:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843503.005678:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134405504:0@lo:400:kworker.0 00000100:00100000:3.0:1788843503.005699:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843503.005727:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134404608 00000100:00100000:3.0:1788843503.005732:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134404608 00000100:00100000:3.0:1788843503.005755:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134404992 00000100:00100000:3.0:1788843503.005758:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134404992 00000100:00100000:3.0:1788843503.005780:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788843503.005786:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1875738134404608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843503.005822:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1875738134404608:12345-0@lo:400:kworker.0 Request processed in 37us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843503.005829:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788843503.005856:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788843503.005863:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1875738134404992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843503.005889:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1875738134404992:12345-0@lo:400:kworker.0 Request processed in 28us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843503.005895:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788843503.005914:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134405120 00000100:00100000:3.0:1788843503.005918:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134405120 00000100:00100000:3.0:1788843503.006123:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134405632 00000100:00100000:3.0:1788843503.006127:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134405632 00000100:00100000:3.0:1788843503.006137:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134405504 00000100:00100000:3.0:1788843503.006175:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134405504 00000100:00100000:3.0:1788843503.006190:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788843503.006196:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134405120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843503.006226:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134405120:12345-0@lo:400:kworker.0 Request processed in 31us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843503.006242:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788843503.006362:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134404224 00000100:00100000:2.0:1788843503.006367:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134404224 00000100:00100000:2.0:1788843503.006396:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788843503.006414:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3633:x1875738134404224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843503.006458:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3633:x1875738134404224:12345-0@lo:400:kworker.0 Request processed in 46us (2069us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843503.006464:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788843503.006517:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134404224:0@lo:400:kworker.0 00000100:00100000:3.0:1788843503.006661:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788843503.006670:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134405632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843503.006701:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134405632:12345-0@lo:400:kworker.0 Request processed in 34us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843503.006707:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788843503.006720:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788843503.006725:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134405504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843503.006752:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134405504:12345-0@lo:400:kworker.0 Request processed in 27us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843503.006758:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1788843503.007687:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788843503.007696:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788843503.007700:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788843503.007739:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd1203d3100 x1875738134404992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843503.007754:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1875738134404992:0@lo:400:kworker.0 00010000:00080000:0.0:1788843503.007766:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd1203d0380 x1875738134405504/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843503.007774:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134405504:0@lo:400:kworker.0 00000100:00100000:0.0:1788843503.007804:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1875738134404608:0@lo:400:kworker.0 00010000:00080000:0.0:1788843503.007815:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd1203d2680 x1875738134405120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843503.007822:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134405120:0@lo:400:kworker.0 00010000:00080000:0.0:1788843503.007831:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd1203d1880 x1875738134405632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843503.007838:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134405632:0@lo:400:kworker.0 00000100:00100000:3.0:1788843503.008031:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134404480 00000100:00100000:3.0:1788843503.008041:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134404480 00000100:00100000:3.0:1788843503.008089:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788843503.008096:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134404480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843503.008179:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134404480:12345-0@lo:400:kworker.0 Request processed in 82us (2564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843503.008186:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788843503.008219:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134404480:0@lo:400:kworker.0 00000100:00100000:2.0:1788843503.515324:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e87b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134405888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788843503.515415:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843503.515499:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788843503.515506:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134405760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788843503.515532:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843503.515555:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788843503.515565:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134405888 00000100:00100000:0.0:1788843503.515567:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134406016:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788843503.515574:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134405888 00000100:00100000:0.0:1788843503.515598:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843503.515618:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134405760 00000100:00100000:2.0:1788843503.515621:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134405760 00000100:00100000:0.0:1788843503.515631:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134406016 00000100:00100000:0.0:1788843503.515634:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134406016 00000100:00100000:2.0:1788843503.515637:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788843503.515646:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134405888:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788843503.515651:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788843503.515668:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134405760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788843503.515688:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1788843503.515695:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843503.515945:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134405760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 284us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843503.515955:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788843503.515975:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788843503.515983:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e87bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134406016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788843503.515992:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843503.516024:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e87bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134406016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843503.516030:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1788843503.516088:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f986a00 x1875738134406016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843519 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843503.516121:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134406016:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1788843503.527619:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00776a300 x1875738134405760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843519 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843503.527660:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134405760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788843503.541696:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134405888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 26033us (26265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843503.541716:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1788843503.541723:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd13e87b100 x1875738134405888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843519 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843503.541758:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e87b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134405888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788843503.542022:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843503.542059:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843503.542096:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843503.542121:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843503.542157:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843503.542180:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843503.542209:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843503.542232:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116503552 00000100:00100000:1.0:1788843503.542240:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116503552 00000100:00100000:1.0:1788843503.542291:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 305 00000100:00100000:1.0:1788843503.542300:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+13:2390:x1875738116503552:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843503.542377:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+13:2390:x1875738116503552:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 79us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843503.542385:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 305 00000100:00100000:1.0:1788843503.542419:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116503808 00000100:00100000:1.0:1788843503.542423:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116503808 00000100:00100000:1.0:1788843503.542459:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116504064 00000100:00100000:1.0:1788843503.542487:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116504064 00000100:00100000:1.0:1788843503.542504:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116503680 00000100:00100000:1.0:1788843503.542507:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116503680 00000100:00100000:1.0:1788843503.542522:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116503936 00000100:00100000:1.0:1788843503.542524:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116503936 00000100:00100000:1.0:1788843503.542723:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 141 00000100:00100000:1.0:1788843503.542733:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2390:x1875738116503808:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843503.542769:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2390:x1875738116503808:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 39us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843503.542777:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 141 00000100:00100000:1.0:1788843503.542793:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 142 00000100:00100000:1.0:1788843503.542801:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd136c45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+6:2390:x1875738116504064:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843503.542828:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd136c45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+6:2390:x1875738116504064:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 29us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843503.542848:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 142 00000100:00100000:1.0:1788843503.542863:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 143 00000100:00100000:1.0:1788843503.542875:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd136c44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2389:x1875738116503680:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843503.542902:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd136c44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2389:x1875738116503680:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 30us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843503.542908:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 143 00000100:00100000:1.0:1788843503.542976:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 144 00000100:00100000:1.0:1788843503.542984:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd136c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+6:2389:x1875738116503936:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843503.543010:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd136c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+6:2389:x1875738116503936:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 28us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843503.543016:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 144 00000100:00100000:3.0:1788843503.544064:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116504320 00000100:00100000:3.0:1788843503.544076:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116504320 00000100:00100000:3.0:1788843503.544135:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116504192 00000100:00100000:3.0:1788843503.544156:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116504192 00000100:00100000:3.0:1788843503.544190:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 58 00000100:00100000:3.0:1788843503.544199:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd136c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+6:2390:x1875738116504320:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843503.544275:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd136c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+6:2390:x1875738116504320:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 77us (2152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843503.544283:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 58 00000100:00100000:3.0:1788843503.544303:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 59 00000100:00100000:3.0:1788843503.544313:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd136c47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+6:2389:x1875738116504192:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843503.544341:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd136c47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+6:2389:x1875738116504192:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 30us (2131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843503.544349:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 59 00000100:00080000:1.0:1788843503.550223:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788843503.550236:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788843503.550240:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788843503.550244:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788843503.771703:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788843504.034043:0:8417:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bdfa9d4d-a4fc-4db6-8668-5ed8e821acee 00000001:00100000:1.0:1788843504.035021:0:9500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bdfa9d4d-a4fc-4db6-8668-5ed8e821acee 00000001:00100000:1.0:1788843504.036072:0:7438:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of bdfa9d4d-a4fc-4db6-8668-5ed8e821acee 00000001:00100000:2.0:1788843504.036468:0:6485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bdfa9d4d-a4fc-4db6-8668-5ed8e821acee 00000001:02000400:3.0:1788843504.513511:0:12178:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg333-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:0.0:1788843504.539805:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e87b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134406144:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788843504.539914:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843504.540021:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134406144 00000100:00100000:0.0:1788843504.540041:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134406144 00000100:00100000:0.0:1788843504.540104:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788843504.540116:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134406144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788843504.540184:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788843504.540238:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134406144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843504.540246:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788843504.540299:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e87b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134406144:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788843504.541189:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788843504.541204:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd136c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134406272:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788843504.541258:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843504.541307:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134406272 00000100:00100000:1.0:1788843504.541313:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134406272 00000100:00100000:1.0:1788843504.541360:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788843504.541384:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd136c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134406272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788843504.541413:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788843504.541453:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd136c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134406272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843504.541460:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788843504.541508:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd136c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134406272:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788843504.812389:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843505.819925:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843506.851795:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843507.875009:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843508.122391:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788843508.122415:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e87b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134406400:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788843508.122491:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843508.122669:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134406400 00000100:00100000:0.0:1788843508.122679:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134406400 00000100:00100000:0.0:1788843508.122758:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788843508.122769:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f984380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134406400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788843508.122796:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843508.122853:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f984380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134406400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843508.122861:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788843508.122866:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134406528:0@lo:400:kworker.0 00000100:00100000:3.0:1788843508.122902:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788843508.122944:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd13e87b480 x1875738134406400/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843524 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843508.122957:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1875738134406656:0@lo:400:kworker.0 00000100:00100000:2.0:1788843508.122962:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e87b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134406400:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788843508.122983:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843508.123002:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134406656 00000100:00100000:2.0:1788843508.123006:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134406656 00000100:00100000:2.0:1788843508.123034:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788843508.123038:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134407040:0@lo:400:kworker.0 00000100:00100000:2.0:1788843508.123040:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1875738134406656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843508.123063:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843508.123070:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1875738134406656:12345-0@lo:400:kworker.0 Request processed in 30us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843508.123076:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788843508.123091:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1875738134406656:0@lo:400:kworker.0 00000100:00100000:2.0:1788843508.123093:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134406784:0@lo:400:kworker.0 00000100:00100000:2.0:1788843508.123115:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843508.123118:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1875738134407168:0@lo:400:kworker.0 00000100:00100000:2.0:1788843508.123133:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788843508.123137:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843508.123155:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134406912:0@lo:400:kworker.0 00000100:00100000:2.0:1788843508.123178:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843508.123208:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134407040 00000100:00100000:2.0:1788843508.123212:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134407040 00000100:00100000:2.0:1788843508.123236:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134406784 00000100:00100000:2.0:1788843508.123239:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134406784 00000100:00100000:2.0:1788843508.123252:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788843508.123257:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134407040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843508.123288:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134407040:12345-0@lo:400:kworker.0 Request processed in 31us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843508.123309:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788843508.123323:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788843508.123329:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134406784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843508.123359:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134406784:12345-0@lo:400:kworker.0 Request processed in 31us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843508.123365:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788843508.123427:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134406528 00000100:00100000:0.0:1788843508.123431:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134406528 00000100:00100000:0.0:1788843508.123455:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788843508.123468:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3630:x1875738134406528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843508.123498:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3630:x1875738134406528:12345-0@lo:400:kworker.0 Request processed in 31us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843508.123504:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00080000:1.0:1788843508.123565:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843508.129499:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134407040:0@lo:400:kworker.0 00000100:00100000:0.0:1788843508.129518:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134406528:0@lo:400:kworker.0 00000100:00100000:0.0:1788843508.129644:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e87b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1875738134407552:0@lo:400:kworker.0 00000100:00100000:0.0:1788843508.129709:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843508.129761:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134407424:0@lo:400:kworker.0 00000100:00100000:1.0:1788843508.129793:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843508.129835:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788843508.129841:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1875738134407296:0@lo:400:kworker.0 00000100:00100000:1.0:1788843508.129872:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134407424 00000100:00100000:1.0:1788843508.129878:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134407424 00000100:00100000:1.0:1788843508.129934:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788843508.129944:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd136c45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134407424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843508.130010:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd136c45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134407424:12345-0@lo:400:kworker.0 Request processed in 67us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843508.130017:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1788843508.130050:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843508.137894:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134407168 00000100:00100000:3.0:1788843508.137910:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134407168 00000100:00100000:3.0:1788843508.137938:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd136c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1875738134407680:0@lo:400:kworker.0 00000100:00100000:2.0:1788843508.138002:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134406912 00000100:00100000:2.0:1788843508.138007:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134406912 00000100:00080000:3.0:1788843508.138026:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843508.138060:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788843508.138324:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f986a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134406912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843508.138388:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f986a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134406912:12345-0@lo:400:kworker.0 Request processed in 320us (15208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843508.140737:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134407552 00000100:00100000:1.0:1788843508.140751:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134407552 00000100:00080000:0.0:1788843508.140871:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843508.141199:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788843508.141257:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd13e878a80 x1875738134407424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843508.141272:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134407424:0@lo:400:kworker.0 00000100:00100000:0.0:1788843508.141298:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd136c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134407936:0@lo:400:kworker.0 00000100:00100000:0.0:1788843508.141350:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843508.141374:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788843508.141380:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd136c46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134407808:0@lo:400:kworker.0 00000100:00100000:0.0:1788843508.141403:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843508.141429:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134407936 00000100:00100000:0.0:1788843508.141433:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134407936 00000100:00100000:0.0:1788843508.141467:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134407808 00000100:00100000:0.0:1788843508.141470:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134407808 00000100:00100000:0.0:1788843508.141491:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788843508.141499:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134407936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843508.141548:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134407936:12345-0@lo:400:kworker.0 Request processed in 49us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843508.141569:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788843508.141585:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788843508.141590:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007934000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134407808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843508.141624:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007934000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134407808:12345-0@lo:400:kworker.0 Request processed in 33us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843508.141630:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1788843508.141655:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788843508.141676:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd136c46300 x1875738134407808/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843508.141687:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd136c46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134407808:0@lo:400:kworker.0 00010000:00080000:0.0:1788843508.141699:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd136c44700 x1875738134407936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843508.141707:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd136c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134407936:0@lo:400:kworker.0 00000100:00100000:3.0:1788843508.142569:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788843508.142600:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843508.142818:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788843508.142841:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134407296 00000100:00100000:2.0:1788843508.142847:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134407296 00000100:00100000:2.0:1788843508.142881:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134407680 00000100:00100000:2.0:1788843508.142883:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134407680 00000100:00100000:2.0:1788843508.142895:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788843508.142901:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875738134407296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843508.142955:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875738134407296:12345-0@lo:400:kworker.0 Request processed in 55us (1759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843508.142961:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788843508.142971:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788843508.142976:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1875738134407680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843508.143003:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1875738134407680:12345-0@lo:400:kworker.0 Request processed in 27us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843508.143020:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788843508.143063:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134406912:0@lo:400:kworker.0 00000100:00100000:2.0:1788843508.143074:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134406784:0@lo:400:kworker.0 00000100:00080000:0.0:1788843508.143131:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788843508.143273:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788843508.143284:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e87b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875738134407552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843508.143329:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e87b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875738134407552:12345-0@lo:400:kworker.0 Request processed in 48us (13620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843508.143334:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788843508.143353:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1875738134407168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843508.143382:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1875738134407168:12345-0@lo:400:kworker.0 Request processed in 805us (20244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843508.143388:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788843508.143452:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e87b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1875738134407552:0@lo:400:kworker.0 00010000:00080000:3.0:1788843508.148850:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd136c44000 x1875738134407680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843508.148869:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd136c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1875738134407680:0@lo:400:kworker.0 00000100:00100000:3.0:1788843508.148883:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1875738134407168:0@lo:400:kworker.0 00010000:00080000:3.0:1788843508.148937:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd13e879f80 x1875738134407296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843508.148946:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1875738134407296:0@lo:400:kworker.0 00000100:00100000:1.0:1788843508.636166:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788843508.636192:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134408064:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788843508.636262:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843508.636497:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788843508.636509:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134408192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843508.636544:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843508.636575:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134408064 00000100:00100000:3.0:1788843508.636581:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134408064 00000100:00100000:3.0:1788843508.636625:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134408192 00000100:00100000:3.0:1788843508.636628:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134408192 00000100:00100000:3.0:1788843508.636645:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788843508.636652:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd136c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134408064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788843508.637058:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843508.637116:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd136c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134408064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 463us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843508.637124:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788843508.637167:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788843508.637175:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134408192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788843508.637188:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843508.637239:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134408192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843508.637245:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:1.0:1788843508.637533:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f984700 x1875738134408064/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843524 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843508.637560:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134408064:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788843508.637844:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00723ca80 x1875738134408192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843524 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843508.637859:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134408192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788843508.638086:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788843508.638097:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134408320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788843508.638130:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843508.638185:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134408320 00000100:00100000:2.0:1788843508.638190:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134408320 00000100:00100000:2.0:1788843508.638224:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788843508.638231:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f986300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134408320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788843508.638244:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788843508.638274:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f986300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134408320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843508.638292:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:2.0:1788843508.638318:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f984700 x1875738134408320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843524 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843508.638330:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134408320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788843508.660233:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843508.660270:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843508.660308:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843508.660337:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843508.660359:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843508.660376:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843508.660400:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843508.660445:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116505088 00000100:00100000:0.0:1788843508.660456:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116505088 00000100:00100000:0.0:1788843508.660509:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116505216 00000100:00100000:0.0:1788843508.660519:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116505216 00000100:00100000:0.0:1788843508.660546:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 63 00000100:00100000:0.0:1788843508.660555:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007937b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2387:x1875738116505088:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1788843508.660627:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007937b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2387:x1875738116505088:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 73us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843508.660635:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 63 00000100:00100000:0.0:1788843508.660653:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 64 00000100:00100000:0.0:1788843508.660660:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2387:x1875738116505216:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843508.660783:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116504576 00000100:00100000:2.0:1788843508.660788:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116504576 00000100:00100000:2.0:1788843508.660825:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116504832 00000100:00100000:2.0:1788843508.660829:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116504832 00000100:00100000:2.0:1788843508.660852:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116504704 00000100:00100000:2.0:1788843508.660856:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116504704 00000100:00100000:2.0:1788843508.660869:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116504960 00000100:00100000:2.0:1788843508.660871:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116504960 00000100:00100000:2.0:1788843508.660885:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 151 00000100:00100000:2.0:1788843508.660899:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2387:x1875738116504576:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843508.660955:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2387:x1875738116504576:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 57us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843508.660962:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 151 00000100:00100000:2.0:1788843508.660975:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 152 00000100:00100000:2.0:1788843508.660981:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2387:x1875738116504832:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843508.661004:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2387:x1875738116504832:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 24us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843508.661010:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 152 00000100:00100000:2.0:1788843508.661021:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 153 00000100:00100000:2.0:1788843508.661027:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007936a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116504704:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843508.661050:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007936a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116504704:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 23us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843508.661056:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 153 00000100:00100000:2.0:1788843508.661068:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 154 00000100:00100000:2.0:1788843508.661074:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007934700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2387:x1875738116504960:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843508.661095:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007934700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2387:x1875738116504960:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 22us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843508.661101:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 154 00000100:00100000:0.0:1788843508.662374:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2387:x1875738116505216:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 1706us (1965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843508.662385:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 64 00000100:00100000:0.0:1788843508.662755:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116504448 00000100:00100000:0.0:1788843508.662764:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116504448 00000100:00100000:0.0:1788843508.662818:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 307 00000100:00100000:0.0:1788843508.662827:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+13:2387:x1875738116504448:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1788843508.663046:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+13:2387:x1875738116504448:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 220us (2707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843508.663054:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 307 00000100:00080000:0.0:1788843508.663101:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788843508.663106:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788843508.663109:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788843508.663112:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788843508.892835:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843509.658404:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788843509.658427:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e87bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134408448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788843509.658558:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843509.660297:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134408448 00000100:00100000:0.0:1788843509.660310:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134408448 00000100:00100000:0.0:1788843509.660361:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788843509.660371:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134408448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788843509.660413:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788843509.660482:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134408448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (1924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843509.660491:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788843509.660571:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788843509.660584:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134408576:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788843509.660620:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843509.660650:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134408576 00000100:00100000:0.0:1788843509.660654:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134408576 00000100:00100000:0.0:1788843509.660677:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788843509.660684:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e87b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134408576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788843509.660705:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788843509.660737:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e87b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134408576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843509.660743:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788843509.660781:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134408576:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788843509.661229:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e87bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134408448:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788843509.914304:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843510.939488:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843511.969217:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843512.987481:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843513.242620:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd136c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134408960:0@lo:400:kworker.0 00000100:00100000:1.0:1788843513.242743:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843513.242806:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1875738134409472:0@lo:400:kworker.0 00000100:00100000:1.0:1788843513.242846:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843513.242867:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1875738134409984:0@lo:400:kworker.0 00000100:00100000:1.0:1788843513.242887:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843513.242917:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1788843513.242923:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd136c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134408832:0@lo:400:kworker.0 00000100:00100000:1.0:1788843513.242951:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843513.242972:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134409344:0@lo:400:kworker.0 00000100:00100000:1.0:1788843513.243013:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843513.243030:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134409856:0@lo:400:kworker.0 00000100:00100000:1.0:1788843513.243050:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843513.243063:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134410368:0@lo:400:kworker.0 00000100:00100000:1.0:1788843513.243078:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843513.243103:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134408960 00000100:00100000:1.0:1788843513.243110:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134408960 00000100:00100000:0.0:1788843513.243274:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134409856 00000100:00100000:0.0:1788843513.243278:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134409856 00000100:00100000:0.0:1788843513.243313:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134410368 00000100:00100000:0.0:1788843513.243316:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134410368 00000100:00100000:0.0:1788843513.243336:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788843513.243344:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134409856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843513.243399:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134409856:12345-0@lo:400:kworker.0 Request processed in 56us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843513.243407:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788843513.243424:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788843513.243448:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134410368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843513.243479:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134410368:12345-0@lo:400:kworker.0 Request processed in 44us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843513.243485:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788843513.243508:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134409472 00000100:00100000:0.0:1788843513.243511:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134409472 00000100:00100000:0.0:1788843513.243532:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134409984 00000100:00100000:0.0:1788843513.243535:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134409984 00000100:00100000:0.0:1788843513.243547:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788843513.243553:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134408960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843513.243584:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134408960:12345-0@lo:400:kworker.0 Request processed in 31us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843513.243591:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788843513.243604:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788843513.243610:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875738134409472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843513.243638:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875738134409472:12345-0@lo:400:kworker.0 Request processed in 28us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843513.243644:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788843513.243655:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788843513.243660:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875738134409984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843513.243686:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875738134409984:12345-0@lo:400:kworker.0 Request processed in 26us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843513.243692:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:0.0:1788843513.243708:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788843513.243712:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788843513.243713:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788843513.243747:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fa2fb80 x1875738134409856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843513.243768:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134409856:0@lo:400:kworker.0 00010000:00080000:0.0:1788843513.243794:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fa2c000 x1875738134410368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843513.243802:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134410368:0@lo:400:kworker.0 00000100:00100000:0.0:1788843513.243816:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd136c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134408960:0@lo:400:kworker.0 00000100:00100000:0.0:1788843513.243825:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1875738134409472:0@lo:400:kworker.0 00000100:00100000:0.0:1788843513.243833:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1875738134409984:0@lo:400:kworker.0 00000100:00100000:1.0:1788843513.244023:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134408832 00000100:00100000:1.0:1788843513.244028:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134408832 00000100:00100000:1.0:1788843513.244065:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1788843513.244073:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3633:x1875738134408832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843513.244112:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3633:x1875738134408832:12345-0@lo:400:kworker.0 Request processed in 40us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843513.244119:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1788843513.244171:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134409344 00000100:00100000:1.0:1788843513.244175:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134409344 00000100:00100000:1.0:1788843513.244202:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788843513.244209:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134409344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843513.244360:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd136c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134409088:0@lo:400:kworker.0 00000100:00100000:3.0:1788843513.244421:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843513.244451:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134409600:0@lo:400:kworker.0 00000100:00100000:3.0:1788843513.244475:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843513.244491:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134410112:0@lo:400:kworker.0 00000100:00100000:3.0:1788843513.244511:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843513.244531:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788843513.244538:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134408704:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788843513.244576:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843513.244594:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd136c46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134409216:0@lo:400:kworker.0 00000100:00100000:3.0:1788843513.244613:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843513.244629:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134409728:0@lo:400:kworker.0 00000100:00100000:3.0:1788843513.244645:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843513.244665:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134410240:0@lo:400:kworker.0 00000100:00100000:3.0:1788843513.244682:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843513.244797:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134409344:12345-0@lo:400:kworker.0 Request processed in 35us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843513.244811:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788843513.244824:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134409088 00000100:00100000:1.0:1788843513.244827:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134409088 00000100:00100000:1.0:1788843513.244844:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788843513.244849:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134409088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843513.244896:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134409088:12345-0@lo:400:kworker.0 Request processed in 47us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843513.244902:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788843513.244923:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134409600 00000100:00100000:1.0:1788843513.244926:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134409600 00000100:00100000:1.0:1788843513.244950:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134410112 00000100:00100000:1.0:1788843513.244953:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134410112 00000100:00100000:1.0:1788843513.244966:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134409216 00000100:00100000:1.0:1788843513.244968:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134409216 00000100:00100000:1.0:1788843513.244980:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788843513.244986:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134409600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843513.245015:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134409600:12345-0@lo:400:kworker.0 Request processed in 29us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843513.245021:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788843513.245032:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788843513.245039:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134410112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843513.245066:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134410112:12345-0@lo:400:kworker.0 Request processed in 28us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843513.245072:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788843513.245083:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788843513.245088:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134409216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843513.245121:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134409216:12345-0@lo:400:kworker.0 Request processed in 33us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843513.245128:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:1.0:1788843513.245175:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788843513.245198:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd136c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134408832:0@lo:400:kworker.0 00000100:00100000:1.0:1788843513.245210:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134409344:0@lo:400:kworker.0 00000100:00100000:2.0:1788843513.245358:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134408704 00000100:00100000:2.0:1788843513.245363:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134408704 00000100:00100000:2.0:1788843513.245400:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788843513.245416:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134408704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788843513.245452:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788843513.245488:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134408704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843513.245494:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1788843513.245513:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843513.245846:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134409728 00000100:00100000:0.0:1788843513.245851:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134409728 00000100:00100000:0.0:1788843513.245886:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134410240 00000100:00100000:0.0:1788843513.245889:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134410240 00000100:00100000:0.0:1788843513.245915:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788843513.245922:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134409728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843513.245960:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134409728:12345-0@lo:400:kworker.0 Request processed in 38us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843513.245965:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788843513.245978:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788843513.245984:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134410240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843513.246009:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134410240:12345-0@lo:400:kworker.0 Request processed in 26us (1326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843513.246015:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1788843513.246080:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788843513.246191:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd13e879f80 x1875738134408704/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843513.246209:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134408704:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788843513.246223:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd136c46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134409216:0@lo:400:kworker.0 00010000:00080000:3.0:1788843513.246233:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fa2d880 x1875738134409728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843513.246241:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134409728:0@lo:400:kworker.0 00010000:00080000:3.0:1788843513.246360:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fa2d500 x1875738134410240/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843513.246369:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134410240:0@lo:400:kworker.0 00000100:00100000:3.0:1788843513.246380:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd136c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134409088:0@lo:400:kworker.0 00010000:00080000:3.0:1788843513.246391:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fa2f800 x1875738134409600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843513.246399:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134409600:0@lo:400:kworker.0 00010000:00080000:3.0:1788843513.246408:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fa2c700 x1875738134410112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843513.246416:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134410112:0@lo:400:kworker.0 00000020:00000004:0.0:1788843513.423561:0:12495:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788843513.423807:0:12495:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788843513.754850:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134410496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788843513.755214:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843513.762885:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134410624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788843513.763902:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134410752:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788843513.767326:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843513.767384:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134410496 00000100:00100000:3.0:1788843513.767390:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843513.767396:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134410496 00000100:00100000:2.0:1788843513.767472:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134410624 00000100:00100000:2.0:1788843513.767477:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134410624 00000100:00100000:2.0:1788843513.767525:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134410752 00000100:00100000:2.0:1788843513.767528:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134410752 00000100:00100000:2.0:1788843513.767551:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788843513.767567:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134410624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788843513.767608:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788843513.767800:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134410624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 236us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843513.767814:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788843513.767839:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788843513.767849:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134410752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788843513.767876:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843513.768223:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788843513.768233:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134410496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788843513.768245:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843513.768291:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134410496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (13078us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843513.768298:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:1.0:1788843513.768420:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00723d500 x1875738134410496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843513.768447:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134410496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788843513.774006:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134410752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6145us (6598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843513.774025:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:2.0:1788843513.774192:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0079baa00 x1875738134410624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843513.774263:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134410624:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788843513.779431:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f984700 x1875738134410752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843513.779467:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134410752:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788843513.779912:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843513.780715:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843513.780739:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843513.780807:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116505344 00000100:00100000:0.0:1788843513.780819:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116505344 00000100:00100000:0.0:1788843513.780883:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 309 00000100:00100000:0.0:1788843513.780895:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+13:2389:x1875738116505344:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1788843513.780985:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+13:2389:x1875738116505344:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 91us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843513.780992:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 309 00000100:00100000:0.0:1788843513.782190:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843513.782260:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116505472 00000100:00100000:2.0:1788843513.782273:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116505472 00000100:00080000:1.0:1788843513.782375:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843513.782654:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116505728 00000100:00100000:3.0:1788843513.782660:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116505728 00000100:00100000:3.0:1788843513.782711:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 161 00000100:00100000:3.0:1788843513.782722:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2390:x1875738116505472:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843513.782819:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2390:x1875738116505472:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 99us (2910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843513.782827:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 161 00000100:00100000:3.0:1788843513.782848:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 162 00000100:00100000:3.0:1788843513.782855:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2390:x1875738116505728:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843513.782880:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2390:x1875738116505728:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 26us (2140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843513.782887:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 162 00000100:00080000:1.0:1788843513.782963:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843513.785625:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116505600 00000100:00100000:1.0:1788843513.785645:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116505600 00000100:00100000:1.0:1788843513.785741:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 163 00000100:00100000:1.0:1788843513.785754:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e87bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2389:x1875738116505600:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843513.785861:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e87bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2389:x1875738116505600:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 110us (3681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843513.785869:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 163 00000100:00100000:0.0:1788843513.785950:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843513.786119:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843513.786177:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843513.786201:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116505856 00000100:00100000:0.0:1788843513.786206:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116505856 00000100:00100000:0.0:1788843513.786239:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 164 00000100:00100000:0.0:1788843513.786246:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd136c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2389:x1875738116505856:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843513.786328:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116505984 00000100:00100000:1.0:1788843513.786333:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116505984 00000100:00100000:1.0:1788843513.786364:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116506112 00000100:00100000:1.0:1788843513.786367:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116506112 00000100:00100000:1.0:1788843513.786394:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 69 00000100:00100000:1.0:1788843513.786421:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd136c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2390:x1875738116505984:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843513.786465:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd136c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2390:x1875738116505984:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 46us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843513.786472:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 69 00000100:00100000:1.0:1788843513.786568:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 70 00000100:00100000:1.0:1788843513.786576:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd136c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2389:x1875738116506112:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843513.786604:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd136c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2389:x1875738116506112:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 30us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843513.786610:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 70 00000100:00100000:0.0:1788843513.787233:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd136c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2389:x1875738116505856:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 985us (1111us total) trans 0 rc 0/0 00000100:00080000:3.0:1788843513.787594:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788843513.787601:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788843513.787605:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788843513.787646:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 164 00010000:00010000:3.0:1788843514.010371:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843514.780291:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f985180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134410880:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788843514.780361:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843514.782059:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788843514.782080:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd136c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134411008:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788843514.782170:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843514.782305:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134410880 00000100:00100000:0.0:1788843514.782314:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134410880 00000100:00100000:0.0:1788843514.782358:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134411008 00000100:00100000:0.0:1788843514.782362:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134411008 00000100:00100000:0.0:1788843514.782379:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788843514.782387:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134410880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788843514.782420:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788843514.782520:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134410880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (2158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843514.782527:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788843514.782546:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788843514.782552:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134411008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788843514.782569:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788843514.782600:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134411008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 47us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843514.782608:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788843514.782739:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd136c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134411008:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788843514.782754:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f985180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134410880:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788843515.034378:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788843515.762549:0:12592:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788843515.762823:0:12592:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788843516.058514:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843517.084894:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788843518.059073:0:12689:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788843518.059514:0:12689:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788843518.109362:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843518.363660:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141a76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1875738134411264:0@lo:400:kworker.0 00000100:00100000:3.0:1788843518.363731:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843518.363794:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1875738134411776:0@lo:400:kworker.0 00000100:00100000:3.0:1788843518.363815:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843518.363852:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1875738134412288:0@lo:400:kworker.0 00000100:00100000:3.0:1788843518.363874:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843518.363901:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1788843518.363906:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141a77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134411136:0@lo:400:kworker.0 00000100:00100000:3.0:1788843518.363934:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843518.363954:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134411648:0@lo:400:kworker.0 00000100:00100000:3.0:1788843518.363977:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843518.363993:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134412160:0@lo:400:kworker.0 00000100:00100000:3.0:1788843518.364133:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843518.364365:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134412672:0@lo:400:kworker.0 00000100:00100000:3.0:1788843518.364390:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843518.365942:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134411520:0@lo:400:kworker.0 00000100:00100000:0.0:1788843518.365999:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843518.366030:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134412032:0@lo:400:kworker.0 00000100:00100000:0.0:1788843518.366064:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134411264 00000100:00100000:0.0:1788843518.366071:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134411264 00000100:00100000:0.0:1788843518.366111:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134411776 00000100:00100000:0.0:1788843518.366114:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134411776 00000100:00100000:0.0:1788843518.366226:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134412288 00000100:00100000:0.0:1788843518.366230:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134412288 00000100:00100000:0.0:1788843518.366244:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134411520 00000100:00100000:0.0:1788843518.366246:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134411520 00000100:00100000:0.0:1788843518.366258:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788843518.366267:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1875738134411264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843518.366318:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1875738134411264:12345-0@lo:400:kworker.0 Request processed in 52us (2587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843518.366325:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788843518.366340:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788843518.366345:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1875738134411776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843518.366369:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1875738134411776:12345-0@lo:400:kworker.0 Request processed in 25us (2554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843518.366375:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788843518.366384:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788843518.366389:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1875738134412288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843518.366411:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1875738134412288:12345-0@lo:400:kworker.0 Request processed in 23us (2537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843518.366416:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788843518.366427:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788843518.366432:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134411520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843518.366462:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134411520:12345-0@lo:400:kworker.0 Request processed in 29us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843518.366468:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788843518.366486:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788843518.366495:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd136c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134412800:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788843518.366527:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843518.366555:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134412800 00000100:00100000:0.0:1788843518.366558:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134412800 00000100:00100000:0.0:1788843518.366584:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788843518.366591:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134412800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788843518.366610:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843518.366643:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134412800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843518.366649:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:0.0:1788843518.366683:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd136c44000 x1875738134412800/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843534 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843518.366703:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd136c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134412800:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788843518.367303:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141a74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134411392:0@lo:400:kworker.0 00000100:00100000:0.0:1788843518.367353:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843518.367375:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134411904:0@lo:400:kworker.0 00000100:00100000:0.0:1788843518.367398:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843518.367415:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1875738134412416:0@lo:400:kworker.0 00000100:00100000:0.0:1788843518.367436:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843518.367487:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134411648 00000100:00100000:0.0:1788843518.367493:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134411648 00000100:00100000:0.0:1788843518.367520:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134411392 00000100:00100000:0.0:1788843518.367523:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134411392 00000100:00100000:0.0:1788843518.367536:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788843518.367542:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134411648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843518.367577:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134411648:12345-0@lo:400:kworker.0 Request processed in 36us (3599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843518.367590:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788843518.367603:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788843518.367608:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134411392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843518.367640:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134411392:12345-0@lo:400:kworker.0 Request processed in 32us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843518.367646:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788843518.367660:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134411904 00000100:00100000:0.0:1788843518.367663:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134411904 00000100:00100000:0.0:1788843518.367684:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134412416 00000100:00100000:0.0:1788843518.367686:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134412416 00000100:00100000:0.0:1788843518.367701:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788843518.367707:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134411904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843518.367735:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134411904:12345-0@lo:400:kworker.0 Request processed in 29us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843518.367754:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788843518.367767:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788843518.367774:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1875738134412416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843518.367799:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1875738134412416:12345-0@lo:400:kworker.0 Request processed in 27us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843518.367804:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788843518.367840:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141a74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134411392:0@lo:400:kworker.0 00010000:00080000:0.0:1788843518.367852:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007768380 x1875738134411904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843518.367860:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134411904:0@lo:400:kworker.0 00010000:00080000:0.0:1788843518.367869:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00776aa00 x1875738134412416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843518.367884:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1875738134412416:0@lo:400:kworker.0 00000100:00100000:3.0:1788843518.371366:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843518.378304:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134412160 00000100:00100000:2.0:1788843518.378320:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134412160 00000100:00100000:2.0:1788843518.378398:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134412672 00000100:00100000:2.0:1788843518.378401:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134412672 00000100:00100000:2.0:1788843518.378522:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788843518.378532:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134412160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843518.378625:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134412160:12345-0@lo:400:kworker.0 Request processed in 94us (14491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843518.378632:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788843518.378651:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788843518.378657:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134412672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843518.378683:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134412672:12345-0@lo:400:kworker.0 Request processed in 27us (14293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843518.378701:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788843518.378931:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0059ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134412544:0@lo:400:kworker.0 00000100:00100000:3.0:1788843518.378967:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843518.379009:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134411520:0@lo:400:kworker.0 00000100:00100000:3.0:1788843518.379037:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134411136 00000100:00100000:3.0:1788843518.379041:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134411136 00000100:00100000:3.0:1788843518.379118:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788843518.379125:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3631:x1875738134411136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843518.379174:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3631:x1875738134411136:12345-0@lo:400:kworker.0 Request processed in 49us (15239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843518.379180:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788843518.381335:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134412032 00000100:00100000:2.0:1788843518.381348:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134412032 00000100:00100000:2.0:1788843518.381393:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134412544 00000100:00100000:2.0:1788843518.381396:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134412544 00000100:00100000:2.0:1788843518.381496:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788843518.381506:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134412032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843518.381589:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134412032:12345-0@lo:400:kworker.0 Request processed in 85us (10231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843518.381596:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788843518.381612:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788843518.381618:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134412544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843518.381650:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134412544:12345-0@lo:400:kworker.0 Request processed in 33us (2683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843518.381656:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:2.0:1788843518.381702:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007769500 x1875738134412032/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843518.381716:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134412032:0@lo:400:kworker.0 00010000:00080000:2.0:1788843518.381729:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0059ded80 x1875738134412544/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843518.381748:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134412544:0@lo:400:kworker.0 00000100:00080000:3.0:1788843518.382311:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788843518.382318:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788843518.382321:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788843518.382323:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788843518.382371:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0059dce00 x1875738134412672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843518.382382:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0059dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134412672:0@lo:400:kworker.0 00000100:00100000:3.0:1788843518.382397:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141a76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1875738134411264:0@lo:400:kworker.0 00000100:00100000:3.0:1788843518.382483:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1875738134411776:0@lo:400:kworker.0 00000100:00100000:3.0:1788843518.382495:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1875738134412288:0@lo:400:kworker.0 00000100:00100000:3.0:1788843518.382520:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141a77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134411136:0@lo:400:kworker.0 00000100:00100000:3.0:1788843518.382532:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134411648:0@lo:400:kworker.0 00010000:00080000:3.0:1788843518.382544:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007768000 x1875738134412160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843518.382552:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134412160:0@lo:400:kworker.0 00000100:00100000:2.0:1788843518.878035:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f985180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134413056:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788843518.878107:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843518.878126:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134412928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788843518.878190:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843518.878232:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134413056 00000100:00100000:0.0:1788843518.878239:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134413056 00000100:00100000:0.0:1788843518.878288:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134412928 00000100:00100000:0.0:1788843518.878292:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134412928 00000100:00100000:0.0:1788843518.878313:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788843518.878324:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f984380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134413056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788843518.878353:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843518.878527:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788843518.878538:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134412928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788843518.878548:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843518.878583:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134412928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843518.878591:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788843518.878611:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788843518.878621:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134413184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843518.878648:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843518.878723:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134413184 00000100:00100000:3.0:1788843518.878727:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134413184 00000100:00100000:3.0:1788843518.878756:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788843518.878776:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134413184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788843518.878787:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843518.878818:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134413184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843518.878824:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:3.0:1788843518.878857:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f984700 x1875738134413184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843534 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843518.878875:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134413184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788843518.878931:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f984380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134413056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 611us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843518.878938:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:0.0:1788843518.878970:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0079ba680 x1875738134412928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843534 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843518.878983:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134412928:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788843518.879045:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f985180 x1875738134413056/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843534 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843518.879063:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f985180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134413056:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788843518.891965:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843518.892008:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843518.892039:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843518.892059:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843518.892082:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843518.892109:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116506368 00000100:00100000:3.0:1788843518.892119:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116506368 00000100:00100000:3.0:1788843518.892200:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116506624 00000100:00100000:3.0:1788843518.892203:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116506624 00000100:00100000:3.0:1788843518.892218:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116506496 00000100:00100000:3.0:1788843518.892220:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116506496 00000100:00100000:3.0:1788843518.892234:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116506752 00000100:00100000:3.0:1788843518.892237:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116506752 00000100:00100000:3.0:1788843518.892252:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 171 00000100:00100000:3.0:1788843518.892262:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2388:x1875738116506368:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843518.892331:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2388:x1875738116506368:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 70us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843518.892338:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 171 00000100:00100000:3.0:1788843518.892354:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 172 00000100:00100000:3.0:1788843518.892374:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2388:x1875738116506624:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843518.892395:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2388:x1875738116506624:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 22us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843518.892466:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 172 00000100:00100000:3.0:1788843518.892482:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 173 00000100:00100000:3.0:1788843518.892488:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2388:x1875738116506496:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843518.892514:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2388:x1875738116506496:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 27us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843518.892520:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 173 00000100:00100000:3.0:1788843518.892532:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 174 00000100:00100000:3.0:1788843518.892538:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00799bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2388:x1875738116506752:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843518.892559:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00799bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2388:x1875738116506752:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 21us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843518.892565:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 174 00000100:00100000:3.0:1788843518.892584:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116506240 00000100:00100000:3.0:1788843518.892588:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116506240 00000100:00100000:3.0:1788843518.892613:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 311 00000100:00100000:3.0:1788843518.892619:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+13:2388:x1875738116506240:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843518.892641:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+13:2388:x1875738116506240:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 22us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843518.892647:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 311 00000100:00080000:3.0:1788843518.892673:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788843518.892677:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843518.894695:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843518.894757:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843518.894795:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116506880 00000100:00100000:3.0:1788843518.894805:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116506880 00000100:00100000:3.0:1788843518.894869:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116507008 00000100:00100000:3.0:1788843518.894872:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116507008 00000100:00100000:3.0:1788843518.894897:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 22 00000100:00100000:3.0:1788843518.894905:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00799b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2386:x1875738116506880:12345-192.168.203.33@tcp:9:kworker.0 00000020:00000080:3.0:1788843518.894936:0:8424:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d1139 00000100:00080000:3.0:1788843518.894944:0:8424:0:(import.c:65:import_set_state_nolock()) ffff9bd007227800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788843518.894992:0:8424:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788843518.895162:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00799b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+2:2386:x1875738116506880:12345-192.168.203.33@tcp:9:kworker.0 Request processed in 257us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843518.895171:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 22 00000100:00100000:3.0:1788843518.895188:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 23 00000100:00100000:3.0:1788843518.895196:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2386:x1875738116507008:12345-192.168.203.33@tcp:9:kworker.0 00000020:00000080:3.0:1788843518.895207:0:8424:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d1140 00000100:00080000:3.0:1788843518.895212:0:8424:0:(import.c:65:import_set_state_nolock()) ffff9bd007226800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788843518.895236:0:8424:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788843518.895303:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+2:2386:x1875738116507008:12345-192.168.203.33@tcp:9:kworker.0 Request processed in 107us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843518.895309:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 23 00010000:00010000:3.0:1788843518.895332:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843518.895337:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788843518.895344:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788843518.895348:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788843519.131249:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843519.899842:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843519.899864:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134413312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788843519.899971:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843519.900040:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134413312 00000100:00100000:1.0:1788843519.900047:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134413312 00000100:00100000:1.0:1788843519.900091:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788843519.900099:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134413312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788843519.900133:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788843519.900225:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134413312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843519.900233:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788843519.900277:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134413312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788843519.902508:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134413440:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788843519.902612:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843519.902759:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134413440 00000100:00100000:0.0:1788843519.902767:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134413440 00000100:00100000:0.0:1788843519.902818:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788843519.902828:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134413440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788843519.902865:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788843519.902936:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134413440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843519.902943:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788843519.905363:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134413440:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788843520.154611:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788843520.614858:0:12787:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788843520.615072:0:12787:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788843521.178626:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843522.203262:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788843522.577929:0:12884:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788843522.579271:0:12884:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788843523.227331:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843523.482671:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788843523.482696:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134413568:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788843523.482819:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843523.483185:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134413568 00000100:00100000:2.0:1788843523.483193:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134413568 00000100:00100000:2.0:1788843523.483722:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788843523.483732:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134413568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788843523.483763:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788843523.483816:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134413568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843523.483824:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1788843523.483926:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788843523.483960:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fa2c000 x1875738134413568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843539 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843523.483979:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134413568:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788843523.485986:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134414080:0@lo:400:kworker.0 00000100:00100000:0.0:1788843523.486051:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843523.486090:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134414592:0@lo:400:kworker.0 00000100:00100000:0.0:1788843523.486131:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843523.486314:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141a74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134415104:0@lo:400:kworker.0 00000100:00100000:0.0:1788843523.486341:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843523.486367:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788843523.486373:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134413952:0@lo:400:kworker.0 00000100:00100000:0.0:1788843523.486400:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843523.486431:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134413696:0@lo:400:kworker.0 00000100:00100000:2.0:1788843523.486468:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843523.486494:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134414208:0@lo:400:kworker.0 00000100:00100000:2.0:1788843523.486516:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843523.486535:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1875738134414720:0@lo:400:kworker.0 00000100:00100000:2.0:1788843523.486556:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843523.486573:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788843523.486578:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134413824:0@lo:400:kworker.0 00000100:00100000:2.0:1788843523.486599:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843523.486616:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134414336:0@lo:400:kworker.0 00000100:00100000:2.0:1788843523.486634:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843523.486647:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141a77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134414848:0@lo:400:kworker.0 00000100:00100000:2.0:1788843523.486677:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843523.486929:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134414080 00000100:00100000:3.0:1788843523.486936:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134414080 00000100:00100000:0.0:1788843523.486965:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1875738134414464:0@lo:400:kworker.0 00000100:00100000:3.0:1788843523.486972:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134414720 00000100:00100000:3.0:1788843523.486976:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134414720 00000100:00100000:0.0:1788843523.487001:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843523.487002:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134413824 00000100:00100000:1.0:1788843523.487003:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134414336 00000100:00100000:3.0:1788843523.487006:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134413824 00000100:00100000:1.0:1788843523.487007:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134414336 00000100:00100000:3.0:1788843523.487021:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134414848 00000100:00100000:0.0:1788843523.487021:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141a76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134414976:0@lo:400:kworker.0 00000100:00100000:3.0:1788843523.487025:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134414848 00000100:00100000:1.0:1788843523.487025:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134414464 00000100:00100000:1.0:1788843523.487028:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134414464 00000100:00100000:1.0:1788843523.487047:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788843523.487052:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843523.487059:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd136c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134414080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843523.487120:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd136c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134414080:12345-0@lo:400:kworker.0 Request processed in 65us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843523.490713:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134413696 00000100:00100000:2.0:1788843523.490727:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134413696 00000100:00100000:2.0:1788843523.490792:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1788843523.490803:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3630:x1875738134413696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843523.491074:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788843523.491096:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788843523.491105:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134413824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843523.491181:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134413824:12345-0@lo:400:kworker.0 Request processed in 77us (4580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843523.491188:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788843523.491408:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3630:x1875738134413696:12345-0@lo:400:kworker.0 Request processed in 607us (4938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843523.491481:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1788843523.491515:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134414592 00000100:00100000:2.0:1788843523.491519:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134414592 00000100:00100000:2.0:1788843523.492314:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134415104 00000100:00100000:2.0:1788843523.492390:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134415104 00000100:00100000:2.0:1788843523.492496:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134414976 00000100:00100000:2.0:1788843523.492500:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134414976 00000100:00100000:2.0:1788843523.492520:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788843523.492528:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134414592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843523.492589:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134414592:12345-0@lo:400:kworker.0 Request processed in 62us (6458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843523.492596:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788843523.492611:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788843523.492617:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134415104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843523.492646:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134415104:12345-0@lo:400:kworker.0 Request processed in 29us (6305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843523.492651:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788843523.492662:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788843523.492667:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134414976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843523.492692:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134414976:12345-0@lo:400:kworker.0 Request processed in 25us (5641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843523.492731:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788843523.492811:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788843523.492826:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134414336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843523.492866:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134414336:12345-0@lo:400:kworker.0 Request processed in 46us (6231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843523.492873:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788843523.492896:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788843523.492903:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134414848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843523.492934:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134414848:12345-0@lo:400:kworker.0 Request processed in 32us (6256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843523.492940:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788843523.492953:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788843523.492959:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875738134414464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843523.492992:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875738134414464:12345-0@lo:400:kworker.0 Request processed in 33us (5993us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843523.492998:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00010000:00080000:0.0:1788843523.493041:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007769500 x1875738134414464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843523.493042:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134413824:0@lo:400:kworker.0 00000100:00100000:0.0:1788843523.493059:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1875738134414464:0@lo:400:kworker.0 00000100:00100000:3.0:1788843523.493062:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134414336:0@lo:400:kworker.0 00010000:00080000:0.0:1788843523.493079:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141a76d80 x1875738134414976/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788843523.493084:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141a77800 x1875738134414848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843523.493097:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141a76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134414976:0@lo:400:kworker.0 00000100:00100000:3.0:1788843523.493104:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141a77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134414848:0@lo:400:kworker.0 00000100:00100000:3.0:1788843523.493119:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134413696:0@lo:400:kworker.0 00000100:00080000:3.0:1788843523.493183:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788843523.493187:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788843523.493190:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788843523.493193:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843523.493493:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875738134414720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843523.493541:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875738134414720:12345-0@lo:400:kworker.0 Request processed in 2458us (6983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843523.493548:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788843523.493585:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1875738134414720:0@lo:400:kworker.0 00000100:00100000:1.0:1788843523.494730:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788843523.494771:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134413952 00000100:00100000:1.0:1788843523.494777:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134413952 00000100:00100000:1.0:1788843523.494820:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134414208 00000100:00100000:1.0:1788843523.494824:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134414208 00000100:00100000:1.0:1788843523.494840:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788843523.494848:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134413952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843523.494907:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134413952:12345-0@lo:400:kworker.0 Request processed in 59us (8506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843523.494913:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788843523.494930:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788843523.494936:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134414208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843523.494973:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134414208:12345-0@lo:400:kworker.0 Request processed in 37us (8455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843523.494980:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788843523.495015:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134414208:0@lo:400:kworker.0 00000100:00100000:0.0:1788843523.496538:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134414080:0@lo:400:kworker.0 00010000:00080000:0.0:1788843523.496570:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00776aa00 x1875738134414592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843523.496581:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134414592:0@lo:400:kworker.0 00010000:00080000:0.0:1788843523.496670:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141a74700 x1875738134415104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843523.496681:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141a74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134415104:0@lo:400:kworker.0 00000100:00100000:0.0:1788843523.496727:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134413952:0@lo:400:kworker.0 00000100:00100000:3.0:1788843523.995263:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134415232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843523.995340:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843523.995499:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134415232 00000100:00100000:1.0:1788843523.995508:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134415232 00000100:00100000:1.0:1788843523.995561:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788843523.995571:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00799a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134415232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788843523.995598:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788843523.995653:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00799a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134415232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843523.995661:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:0.0:1788843523.995782:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00723d500 x1875738134415232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843539 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843523.995800:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134415232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788843523.999349:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788843523.999371:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134415488:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788843523.999441:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843523.999504:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134415360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788843523.999529:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843523.999603:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134415488 00000100:00100000:3.0:1788843523.999611:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134415488 00000100:00100000:3.0:1788843523.999659:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134415360 00000100:00100000:3.0:1788843523.999662:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134415360 00000100:00100000:3.0:1788843523.999679:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788843523.999688:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134415488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788843523.999721:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843523.999767:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134415488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843523.999774:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788843523.999792:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788843523.999800:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134415360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788843523.999814:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843523.999856:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134415360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843523.999862:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:0.0:1788843524.000008:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007ac8e00 x1875738134415360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843539 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843524.000026:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134415360:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788843524.000057:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007999180 x1875738134415488/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843539 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843524.000068:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134415488:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788843524.013079:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843524.013127:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843524.013187:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843524.013265:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843524.013315:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116507136 00000100:00100000:0.0:1788843524.013325:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116507136 00000100:00100000:0.0:1788843524.013417:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 313 00000100:00100000:0.0:1788843524.013429:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+13:2388:x1875738116507136:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1788843524.013512:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+13:2388:x1875738116507136:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 86us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843524.013520:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 313 00000100:00100000:3.0:1788843524.020188:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843524.025966:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116507392 00000100:00100000:2.0:1788843524.025985:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116507392 00000100:00100000:2.0:1788843524.026080:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116507648 00000100:00100000:2.0:1788843524.026084:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116507648 00000100:00100000:2.0:1788843524.026109:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116507264 00000100:00100000:2.0:1788843524.026112:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116507264 00000100:00100000:2.0:1788843524.026135:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 181 00000100:00100000:2.0:1788843524.026160:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00799a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2388:x1875738116507392:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843524.026243:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00799a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2388:x1875738116507392:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 85us (13115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843524.026251:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 181 00000100:00100000:2.0:1788843524.026268:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 182 00000100:00100000:2.0:1788843524.026274:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00799b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2388:x1875738116507648:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843524.026298:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00799b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2388:x1875738116507648:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 24us (13112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843524.026305:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 182 00000100:00100000:2.0:1788843524.026317:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 183 00000100:00100000:2.0:1788843524.026324:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2388:x1875738116507264:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843524.026348:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2388:x1875738116507264:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 24us (13083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843524.026354:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 183 00000100:00080000:2.0:1788843524.026509:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788843524.026513:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788843524.028011:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116507520 00000100:00100000:2.0:1788843524.028038:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116507520 00000100:00100000:2.0:1788843524.028094:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 184 00000100:00100000:2.0:1788843524.028103:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00799b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2388:x1875738116507520:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843524.028182:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00799b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2388:x1875738116507520:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 79us (8001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843524.028190:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 184 00000100:00080000:3.0:1788843524.028873:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788843524.250355:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843525.018650:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788843525.018671:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134415744:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788843525.018758:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843525.018928:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134415616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788843525.018960:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843525.019041:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134415744 00000100:00100000:0.0:1788843525.019049:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134415744 00000100:00100000:0.0:1788843525.019092:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134415616 00000100:00100000:0.0:1788843525.019095:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134415616 00000100:00100000:0.0:1788843525.019109:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788843525.019117:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134415744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788843525.019173:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788843525.019227:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134415744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843525.019233:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788843525.019251:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788843525.019258:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134415616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788843525.019275:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788843525.019309:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134415616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843525.019315:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788843525.019354:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134415616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788843525.019397:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134415744:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1788843525.022756:0:9500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bdfa9d4d-a4fc-4db6-8668-5ed8e821acee 00000020:00000080:1.0:1788843525.022769:0:9500:0:(genops.c:885:class_export_put()) final put ffff9bd007222800/bdfa9d4d-a4fc-4db6-8668-5ed8e821acee 00000020:00000080:2.0:1788843525.022875:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd007222800/bdfa9d4d-a4fc-4db6-8668-5ed8e821acee for lustre-OST0001 00000020:00000080:2.0:1788843525.022953:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd007226800 for lustre-OST0001 00000001:00100000:0.0:1788843525.025552:0:8417:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bdfa9d4d-a4fc-4db6-8668-5ed8e821acee 00000020:00000080:0.0:1788843525.025582:0:8417:0:(genops.c:885:class_export_put()) final put ffff9bd007225000/bdfa9d4d-a4fc-4db6-8668-5ed8e821acee 00000020:00000080:1.0:1788843525.025945:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd007225000/bdfa9d4d-a4fc-4db6-8668-5ed8e821acee for lustre-OST0000 00000020:00000080:1.0:1788843525.026103:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd007227800 for lustre-OST0000 00010000:00010000:3.0:1788843525.276912:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843526.298716:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788843526.389894:0:13028:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788843527.323303:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843528.346266:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843528.603885:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843528.603931:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134415872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788843528.604027:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843528.604390:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134416128:0@lo:400:kworker.0 00000100:00100000:1.0:1788843528.604427:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843528.604504:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1875738134416640:0@lo:400:kworker.0 00000100:00100000:1.0:1788843528.604529:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843528.604550:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134417152:0@lo:400:kworker.0 00000100:00100000:1.0:1788843528.604573:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843528.604596:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788843528.604602:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134416000:0@lo:400:kworker.0 00000100:00100000:1.0:1788843528.604632:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843528.604703:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1875738134416384:0@lo:400:kworker.0 00000100:00100000:3.0:1788843528.604736:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843528.604782:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134416896:0@lo:400:kworker.0 00000100:00100000:3.0:1788843528.604809:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843528.604874:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134415872 00000100:00100000:0.0:1788843528.604884:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134415872 00000100:00100000:0.0:1788843528.604965:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788843528.604978:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134415872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788843528.605012:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843528.605081:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134415872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843528.605089:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788843528.609645:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134416128 00000100:00100000:0.0:1788843528.609665:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134416128 00000100:00100000:0.0:1788843528.609756:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134416640 00000100:00100000:0.0:1788843528.609760:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134416640 00000100:00100000:0.0:1788843528.609777:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134417152 00000100:00100000:0.0:1788843528.609780:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134417152 00000100:00100000:0.0:1788843528.609793:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134416384 00000100:00100000:0.0:1788843528.609796:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134416384 00000100:00100000:0.0:1788843528.609813:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788843528.609825:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134416128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843528.609955:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134416128:12345-0@lo:400:kworker.0 Request processed in 131us (5526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843528.609963:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788843528.609984:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788843528.609991:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875738134416640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843528.610021:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875738134416640:12345-0@lo:400:kworker.0 Request processed in 31us (5491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843528.610027:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788843528.610051:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788843528.610057:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875738134417152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843528.610106:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875738134417152:12345-0@lo:400:kworker.0 Request processed in 48us (5531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843528.610112:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788843528.610123:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788843528.610129:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00799ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1875738134416384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843528.610190:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00799ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1875738134416384:12345-0@lo:400:kworker.0 Request processed in 61us (5453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843528.610195:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788843528.610232:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134416256:0@lo:400:kworker.0 00000100:00100000:0.0:1788843528.610279:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843528.610325:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134416768:0@lo:400:kworker.0 00000100:00100000:0.0:1788843528.610370:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843528.610397:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134417280:0@lo:400:kworker.0 00000100:00100000:0.0:1788843528.610433:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134416256 00000100:00100000:0.0:1788843528.610437:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134416256 00000100:00100000:0.0:1788843528.610488:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788843528.610496:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134416256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843528.610555:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134416256:12345-0@lo:400:kworker.0 Request processed in 61us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843528.610562:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788843528.610578:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134416768 00000100:00100000:0.0:1788843528.610581:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134416768 00000100:00100000:0.0:1788843528.610601:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788843528.610606:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd006757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134416768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843528.610646:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd006757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134416768:12345-0@lo:400:kworker.0 Request processed in 40us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843528.610653:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00080000:3.0:1788843528.612967:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788843528.612980:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788843528.612984:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843528.613228:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788843528.613306:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd1203d3800 x1875738134415872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843544 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843528.613334:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134415872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788843528.613375:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134416256:0@lo:400:kworker.0 00010000:00080000:3.0:1788843528.613389:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fe0ca80 x1875738134416768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843528.613398:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134416768:0@lo:400:kworker.0 00000100:00100000:3.0:1788843528.613446:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134417408:0@lo:400:kworker.0 00000100:00100000:3.0:1788843528.618399:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843528.618482:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134416896 00000100:00100000:3.0:1788843528.618493:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134416896 00000100:00100000:3.0:1788843528.618559:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134417280 00000100:00100000:3.0:1788843528.618562:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134417280 00000100:00100000:3.0:1788843528.618574:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134417408 00000100:00100000:3.0:1788843528.618576:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134417408 00000100:00100000:3.0:1788843528.618590:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788843528.618600:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134416896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843528.618688:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134416896:12345-0@lo:400:kworker.0 Request processed in 90us (13878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843528.618697:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788843528.618715:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788843528.618721:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00799aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134417280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843528.618762:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00799aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134417280:12345-0@lo:400:kworker.0 Request processed in 32us (5530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843528.618769:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788843528.618778:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788843528.618784:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134417408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843528.618806:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134417408:12345-0@lo:400:kworker.0 Request processed in 23us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843528.618812:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1788843528.618836:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788843528.618841:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788843528.618884:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f8ab100 x1875738134417280/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843528.618902:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134417280:0@lo:400:kworker.0 00010000:00080000:3.0:1788843528.619010:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f8aaa00 x1875738134417408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843528.619020:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134417408:0@lo:400:kworker.0 00000100:00100000:3.0:1788843528.619041:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1875738134416384:0@lo:400:kworker.0 00010000:00080000:3.0:1788843528.619051:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fe0d880 x1875738134416896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843528.619203:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134416896:0@lo:400:kworker.0 00000100:00100000:1.0:1788843528.621375:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134416512:0@lo:400:kworker.0 00000100:00100000:1.0:1788843528.621473:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843528.621508:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1875738134417024:0@lo:400:kworker.0 00000100:00100000:1.0:1788843528.621538:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843528.621568:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134417024 00000100:00100000:1.0:1788843528.621577:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134417024 00000100:00100000:1.0:1788843528.621641:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788843528.621650:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875738134417024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843528.621714:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875738134417024:12345-0@lo:400:kworker.0 Request processed in 65us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843528.621722:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:1.0:1788843528.621747:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843528.621913:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134416512 00000100:00100000:2.0:1788843528.621918:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134416512 00000100:00100000:2.0:1788843528.621953:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788843528.621960:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134416512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843528.621997:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134416512:12345-0@lo:400:kworker.0 Request processed in 38us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843528.622003:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788843528.622203:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1875738134417024:0@lo:400:kworker.0 00000100:00100000:1.0:1788843528.622220:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134416128:0@lo:400:kworker.0 00000100:00100000:1.0:1788843528.622232:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1875738134416640:0@lo:400:kworker.0 00010000:00080000:1.0:1788843528.622247:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f8abb80 x1875738134417152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843528.622257:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134417152:0@lo:400:kworker.0 00000100:00100000:1.0:1788843528.622281:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134416512:0@lo:400:kworker.0 00000100:00100000:3.0:1788843528.622403:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134416000 00000100:00100000:3.0:1788843528.622408:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134416000 00000100:00100000:3.0:1788843528.622448:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788843528.622456:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3633:x1875738134416000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843528.622505:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3633:x1875738134416000:12345-0@lo:400:kworker.0 Request processed in 51us (17872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843528.622512:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788843528.622597:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134416000:0@lo:400:kworker.0 00000100:00100000:0.0:1788843529.119312:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134417536:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788843529.119410:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843529.119547:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134417536 00000100:00100000:3.0:1788843529.119557:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134417536 00000100:00100000:3.0:1788843529.119620:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788843529.119631:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd006755c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134417536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788843529.119679:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843529.119734:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd006755c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134417536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843529.119742:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1788843529.119830:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007999180 x1875738134417536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843545 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843529.119853:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134417536:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788843529.120638:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788843529.120651:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134417664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788843529.123521:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843529.124104:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134417664 00000100:00100000:1.0:1788843529.124117:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134417664 00000100:00100000:1.0:1788843529.124204:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788843529.124217:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd006756d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134417664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788843529.124250:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788843529.124321:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd006756d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134417664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843529.124345:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:0.0:1788843529.124748:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd13e876a00 x1875738134417664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843545 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843529.124774:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134417664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788843529.125231:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ac9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134417792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788843529.125300:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843529.125604:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134417792 00000100:00100000:0.0:1788843529.125613:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134417792 00000100:00100000:0.0:1788843529.125658:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788843529.125677:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134417792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788843529.125698:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843529.125758:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134417792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843529.125765:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:2.0:1788843529.125866:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007ac9f80 x1875738134417792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843545 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843529.125883:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ac9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134417792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843529.133199:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843529.133250:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116507776 00000100:00100000:3.0:1788843529.133252:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843529.133264:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116507776 00000100:00100000:3.0:1788843529.133298:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843529.133324:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843529.133338:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 315 00000100:00100000:0.0:1788843529.133361:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+13:2387:x1875738116507776:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843529.133373:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843529.133401:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116508032 00000100:00100000:3.0:1788843529.133405:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116508032 00000100:00100000:3.0:1788843529.133448:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116508288 00000100:00100000:3.0:1788843529.133452:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116508288 00000100:00100000:0.0:1788843529.133457:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+13:2387:x1875738116507776:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 98us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843529.133468:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 315 00000100:00100000:3.0:1788843529.133470:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116507904 00000100:00100000:3.0:1788843529.133480:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116507904 00000100:00100000:3.0:1788843529.133499:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116508160 00000100:00100000:3.0:1788843529.133502:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116508160 00000100:00100000:0.0:1788843529.133521:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 191 00000100:00100000:0.0:1788843529.133531:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116508032:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1788843529.133565:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116508032:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 36us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843529.133614:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 192 00000100:00100000:1.0:1788843529.133627:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 193 00000100:00100000:3.0:1788843529.133628:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2387:x1875738116508288:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843529.133643:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2387:x1875738116507904:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843529.133677:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2387:x1875738116508288:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 55us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843529.133685:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 192 00000100:00100000:1.0:1788843529.133696:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2387:x1875738116507904:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 58us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843529.133705:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 194 00000100:00100000:3.0:1788843529.133712:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2387:x1875738116508160:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843529.133739:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2387:x1875738116508160:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 28us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843529.133746:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 194 00000100:00100000:0.0:1788843529.135510:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 191 00000100:00080000:2.0:1788843529.137792:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788843529.137827:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788843529.137981:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 193 00010000:00010000:3.0:1788843529.370312:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843530.142248:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006754700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134417920:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788843530.142341:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843530.142441:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134417920 00000100:00100000:0.0:1788843530.142451:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134417920 00000100:00100000:0.0:1788843530.142506:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788843530.142518:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd006757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134417920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788843530.142562:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788843530.142616:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd006757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134417920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843530.142623:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788843530.142688:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006754700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134417920:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788843530.143191:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788843530.143204:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134418048:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788843530.143252:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843530.143294:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134418048 00000100:00100000:3.0:1788843530.143299:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134418048 00000100:00100000:3.0:1788843530.143344:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788843530.143352:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134418048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788843530.143377:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788843530.143412:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134418048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843530.143419:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788843530.143455:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134418048:0@lo:41:osp-pre-1-0.0 00000020:00000080:2.0:1788843530.161468:0:13176:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffff78fcde0 20000000:00000080:2.0:1788843530.161496:0:13176:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bd0065a9400 uarg=0000000000000000 20000000:01000000:2.0:1788843530.161559:0:13176:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788843530.161567:0:13176:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788843530.161573:0:13176:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788843530.162574:0:13177:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1788843530.163970:0:13176:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788843530.181963:0:13176:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788843530.183814:0:13176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd10f7af400/0xa762dfcbd58d1147 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.183846:0:13176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd10f7ae600/0xa762dfcbd58d10d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224907de expref: 12 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.183856:0:13176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd10fa3cc00/0xa762dfcbd58d10e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d10de expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.183865:0:13176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d10f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d10ec expref: 23 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.183872:0:13176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd007946800/0xa762dfcbd58d1101 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d10fa expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.183878:0:13176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd10f7afe00/0xa762dfcbd58d110f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d1108 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.183885:0:13176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd10fa3dc00/0xa762dfcbd58d1124 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249081d expref: 12 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.183893:0:13176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd10f7af400/0xa762dfcbd58d1147 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.183948:0:13176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd10fa3dc00/0xa762dfcbd58d1124 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249081d expref: 12 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.183966:0:13176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd10fa3dc00/0xa762dfcbd58d1124 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249081d expref: 12 pid: 6500 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843530.184432:0:13176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe0df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875738134418176:192.168.203.33@tcp:104: 00010000:00010000:3.0:1788843530.184574:0:13176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd10f7afe00/0xa762dfcbd58d110f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d1108 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.184583:0:13176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd10f7afe00/0xa762dfcbd58d110f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d1108 expref: 23 pid: 6500 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843530.184593:0:13176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe0c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875738134418304:0@lo:104: 00000100:00100000:3.0:1788843530.184878:0:13176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788843530.184940:0:13176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd007946800/0xa762dfcbd58d1101 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d10fa expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.184949:0:13176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd007946800/0xa762dfcbd58d1101 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d10fa expref: 23 pid: 6501 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843530.184957:0:13176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe0d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875738134418432:0@lo:104: 00000100:00100000:3.0:1788843530.185250:0:13176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843530.185282:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134418304 00000100:00100000:3.0:1788843530.185290:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134418304 00000100:00100000:3.0:1788843530.185350:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134418432 00000100:00100000:3.0:1788843530.185356:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134418432 00000100:00100000:3.0:1788843530.185372:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788843530.185381:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+4:13176:x1875738134418304:12345-0@lo:104: 00010000:00010000:3.0:1788843530.185397:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d1108 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d110f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.185458:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788843530.185464:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+4:13176:x1875738134418304:12345-0@lo:104: Request processed in 84us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843530.185482:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788843530.185504:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788843530.185510:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+3:13176:x1875738134418432:12345-0@lo:104: 00010000:00010000:3.0:1788843530.185517:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd007946c00/0xa762dfcbd58d10fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d1101 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.185549:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788843530.185553:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+3:13176:x1875738134418432:12345-0@lo:104: Request processed in 45us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843530.185558:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:3.0:1788843530.185576:0:10329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788843530.185582:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d1108 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d110f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.185589:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7afc00 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:3.0:1788843530.185593:0:10329:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d1108 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d110f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.185615:0:10329:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d1108 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d110f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843530.185623:0:10329:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d1108 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d110f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843530.185629:0:10329:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788843530.185675:0:10329:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d1108 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d110f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.185682:0:10329:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843530.185713:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d1108 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d110f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.185720:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d1108 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d110f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.185735:0:10329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843530.185739:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd007946c00/0xa762dfcbd58d10fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d1101 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.185745:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946c00 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:3.0:1788843530.185748:0:10329:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd007946c00/0xa762dfcbd58d10fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d1101 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.185755:0:10329:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd007946c00/0xa762dfcbd58d10fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d1101 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843530.185762:0:10329:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd007946c00/0xa762dfcbd58d10fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d1101 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843530.185767:0:10329:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788843530.185782:0:10329:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd007946c00/0xa762dfcbd58d10fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d1101 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.185788:0:10329:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843530.185804:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd007946c00/0xa762dfcbd58d10fa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d1101 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.185811:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd007946c00/0xa762dfcbd58d10fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d1101 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.185821:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843530.185828:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843530.185830:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843530.185856:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134418560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843530.185892:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788843530.185951:0:13176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d10f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d10ec expref: 23 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.185961:0:13176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d10f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d10ec expref: 23 pid: 6498 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843530.185969:0:13176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875738134418816:0@lo:104: 00000100:00100000:3.0:1788843530.186575:0:13176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788843530.186950:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843530.187554:0:13176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd10fa3cc00/0xa762dfcbd58d10e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d10de expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843530.187571:0:13176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd10fa3cc00/0xa762dfcbd58d10e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d10de expref: 23 pid: 6500 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843530.187586:0:13176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ac9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875738134418944:0@lo:104: 00000100:00100000:2.0:1788843530.187665:0:13176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788843530.187701:0:13176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd10f7ae600/0xa762dfcbd58d10d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224907de expref: 12 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843530.187710:0:13176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd10f7ae600/0xa762dfcbd58d10d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224907de expref: 12 pid: 6500 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843530.187721:0:13176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ac8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875738134419072:192.168.203.33@tcp:104: 00000100:00100000:2.0:1788843530.187784:0:13176:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007722840 going to sleep for 11 seconds 00000100:00100000:2.0:1788843530.187816:0:13176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe0c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875738134418304:0@lo:104: 00000100:00100000:2.0:1788843530.187827:0:13176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe0d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875738134418432:0@lo:104: 00000100:00100000:3.0:1788843530.188537:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134418816 00000100:00100000:3.0:1788843530.188549:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134418816 00000100:00100000:3.0:1788843530.188600:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134418944 00000100:00100000:3.0:1788843530.188689:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134418944 00000100:00100000:3.0:1788843530.188719:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788843530.188730:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141a74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+4:13176:x1875738134418816:12345-0@lo:104: 00010000:00010000:3.0:1788843530.188748:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34a00/0xa762dfcbd58d10ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d10f3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.188840:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788843530.188846:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141a74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+4:13176:x1875738134418816:12345-0@lo:104: Request processed in 119us (2274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843530.188853:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788843530.188872:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788843530.188878:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007aca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+3:13176:x1875738134418944:12345-0@lo:104: 00010000:00010000:3.0:1788843530.188887:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d800/0xa762dfcbd58d10de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d10e5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.188943:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788843530.188949:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007aca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+3:13176:x1875738134418944:12345-0@lo:104: Request processed in 72us (1294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843530.188955:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788843530.189083:0:13176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875738134418816:0@lo:104: 00000100:00100000:2.0:1788843530.189094:0:13176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ac9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875738134418944:0@lo:104: 00010000:00010000:2.0:1788843530.189196:0:6495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788843530.189210:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34a00/0xa762dfcbd58d10ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d10f3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843530.189218:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb34a00 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:2.0:1788843530.189225:0:6495:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34a00/0xa762dfcbd58d10ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d10f3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843530.189236:0:6495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34a00/0xa762dfcbd58d10ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d10f3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843530.189244:0:6495:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34a00/0xa762dfcbd58d10ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d10f3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843530.189251:0:6495:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788843530.189293:0:6495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34a00/0xa762dfcbd58d10ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d10f3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843530.189300:0:6495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788843530.189317:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34a00/0xa762dfcbd58d10ec lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d10f3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843530.189324:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34a00/0xa762dfcbd58d10ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d10f3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843530.189340:0:6495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843530.189343:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d800/0xa762dfcbd58d10de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d10e5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843530.189349:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d800 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:2.0:1788843530.189352:0:6495:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d800/0xa762dfcbd58d10de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d10e5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843530.189368:0:6495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d800/0xa762dfcbd58d10de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d10e5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843530.189374:0:6495:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d800/0xa762dfcbd58d10de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d10e5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843530.189379:0:6495:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788843530.189392:0:6495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d800/0xa762dfcbd58d10de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d10e5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843530.189399:0:6495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788843530.189412:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d800/0xa762dfcbd58d10de lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d10e5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843530.189419:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d800/0xa762dfcbd58d10de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d10e5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843530.189435:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843530.189436:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843530.189438:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843530.191122:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843530.191172:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788843530.191202:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134419328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843530.191267:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843530.191329:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134418560 00000100:00100000:3.0:1788843530.191339:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134418560 00010000:00010000:3.0:1788843530.191381:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd10f7afe00/0xa762dfcbd58d110f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d1108 expref: 24 pid: 6500 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843530.191416:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134419328 00000100:00100000:3.0:1788843530.191420:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134419328 00010000:00010000:3.0:1788843530.191433:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd10fa3cc00/0xa762dfcbd58d10e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d10de expref: 25 pid: 6500 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843530.191454:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788843530.191464:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+25:3633:x1875738134418560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788843530.191481:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843530.191487:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd10f7afe00/0xa762dfcbd58d110f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d1108 expref: 25 pid: 6500 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.191500:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd10f7afe00/0xa762dfcbd58d110f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d1108 expref: 25 pid: 6500 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.191521:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd10f7afe00/0xa762dfcbd58d110f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d1108 expref: 25 pid: 6500 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.191559:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843530.191597:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3633:x1875738134418560:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (5704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843530.191620:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788843530.191642:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788843530.191648:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141a76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:3633:x1875738134419328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788843530.191664:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843530.191670:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd10fa3cc00/0xa762dfcbd58d10e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d10de expref: 23 pid: 6500 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.191679:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd10fa3cc00/0xa762dfcbd58d10e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d10de expref: 23 pid: 6500 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.191690:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd10fa3cc00/0xa762dfcbd58d10e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d10de expref: 23 pid: 6500 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.191699:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843530.191721:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141a76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:3633:x1875738134419328:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843530.191727:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788843530.191772:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134419328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843530.191783:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134418560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843530.192098:0:13176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe0df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875738134418176:192.168.203.33@tcp:104: 00000100:00100000:3.0:1788843530.192444:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843530.192535:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116508416 00000100:00100000:3.0:1788843530.192540:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116508416 00010000:00010000:3.0:1788843530.192565:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd10fa3dc00/0xa762dfcbd58d1124 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249081d expref: 13 pid: 6500 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843530.192621:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 42 00000100:00100000:3.0:1788843530.192631:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141a77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7928f422-fe0e-4906-b099-11067616e1bb+13:2390:x1875738116508416:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843530.192645:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843530.192649:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd10fa3dc00/0xa762dfcbd58d1124 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249081d expref: 13 pid: 6500 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.192671:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd10fa3dc00/0xa762dfcbd58d1124 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249081d expref: 13 pid: 6500 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.192685:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd10fa3dc00/0xa762dfcbd58d1124 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249081d expref: 13 pid: 6500 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.192698:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843530.192750:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141a77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7928f422-fe0e-4906-b099-11067616e1bb+12:2390:x1875738116508416:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 121us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843530.192757:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 42 00000100:00100000:3.0:1788843530.192899:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134418688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843530.192938:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843530.192976:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788843530.192982:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134419200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843530.193004:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843530.193027:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134418688 00000100:00100000:3.0:1788843530.193031:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134418688 00010000:00010000:3.0:1788843530.193047:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd007946800/0xa762dfcbd58d1101 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d10fa expref: 22 pid: 6501 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843530.193065:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134419200 00000100:00100000:3.0:1788843530.193075:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134419200 00010000:00010000:3.0:1788843530.193089:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d10f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d10ec expref: 23 pid: 6498 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843530.193103:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788843530.193108:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:3630:x1875738134418688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788843530.193118:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843530.193123:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd007946800/0xa762dfcbd58d1101 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d10fa expref: 23 pid: 6501 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.193131:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd007946800/0xa762dfcbd58d1101 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d10fa expref: 23 pid: 6501 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.193163:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd007946800/0xa762dfcbd58d1101 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d10fa expref: 23 pid: 6501 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.193173:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843530.193201:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:3630:x1875738134418688:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843530.193207:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788843530.193221:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788843530.193227:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:3630:x1875738134419200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788843530.193234:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843530.193238:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d10f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d10ec expref: 21 pid: 6498 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.193248:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d10f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d10ec expref: 21 pid: 6498 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.193259:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d10f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d10ec expref: 21 pid: 6498 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.193274:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843530.193340:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:3630:x1875738134419200:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843530.193346:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788843530.193379:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134419200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843530.193388:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134418688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788843530.196238:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843530.196704:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116508544 00000100:00100000:3.0:1788843530.196719:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116508544 00010000:00010000:3.0:1788843530.196777:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd10f7ae600/0xa762dfcbd58d10d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224907de expref: 12 pid: 6500 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843530.197854:0:13176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ac8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875738134419072:192.168.203.33@tcp:104: 00010000:00010000:2.0:1788843530.197913:0:13176:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd10f7af400/0xa762dfcbd58d1147 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843530.199757:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 45 00000100:00100000:3.0:1788843530.199786:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13332d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7928f422-fe0e-4906-b099-11067616e1bb+12:2390:x1875738116508544:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843530.199816:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843530.199828:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd10f7ae600/0xa762dfcbd58d10d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224907de expref: 12 pid: 6500 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.199846:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd10f7ae600/0xa762dfcbd58d10d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224907de expref: 12 pid: 6500 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.199870:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd10f7ae600/0xa762dfcbd58d10d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224907de expref: 12 pid: 6500 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.199890:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd10f7af400/0xa762dfcbd58d1147 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.199900:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd10f7af400/0xa762dfcbd58d1147 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.199939:0:6491:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd10f7af400/0xa762dfcbd58d1147 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.199947:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd10f7af400/0xa762dfcbd58d1147 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.199954:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd10f7af400/0xa762dfcbd58d1147 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.199961:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd10f7af400/0xa762dfcbd58d1147 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.199968:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7af400 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:3.0:1788843530.199973:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd10f7af400/0xa762dfcbd58d1147 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.199982:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd10f7af400/0xa762dfcbd58d1147 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.200007:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd10f7af400/0xa762dfcbd58d1147 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843530.200020:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788843530.200072:0:13176:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd10f7af400/0xa762dfcbd58d1147 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843530.200080:0:13176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd10f7af400/0xa762dfcbd58d1147 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843530.200094:0:13176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd10f7af400/0xa762dfcbd58d1147 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843530.200106:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13332d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7928f422-fe0e-4906-b099-11067616e1bb+11:2390:x1875738116508544:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 334us (3988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843530.200114:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 45 00010000:00010000:3.0:1788843530.395561:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843531.419595:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843531.442077:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843531.445802:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116508672 00000100:00100000:1.0:1788843531.445820:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116508672 00000100:00100000:1.0:1788843531.445925:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 316 00000100:00100000:1.0:1788843531.445936:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1153f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+11:6164:x1875738116508672:12345-192.168.203.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843531.445953:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843531.445972:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd13fb34600/0xa762dfcbd58d114e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf24d95f2249084e expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843531.445999:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd13fb34600/0xa762dfcbd58d114e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249084e expref: 12 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843531.446009:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd13fb34600/0xa762dfcbd58d114e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249084e expref: 12 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843531.446018:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fb34600, rc 0) 00000100:00100000:1.0:1788843531.446085:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1153f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+12:6164:x1875738116508672:12345-192.168.203.33@tcp:101:ll_cfg_requeue.0 Request processed in 150us (4017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843531.446092:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 316 00000100:00100000:1.0:1788843531.455364:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843531.455400:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116508800 00000100:00100000:1.0:1788843531.455417:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116508800 00000100:00100000:1.0:1788843531.455466:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 317 00000100:00100000:1.0:1788843531.455476:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1032f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+12:6164:x1875738116508800:12345-192.168.203.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788843531.455632:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1032f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+12:6164:x1875738116508800:12345-192.168.203.33@tcp:501:ll_cfg_requeue.0 Request processed in 145us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843531.455640:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 317 00000100:00100000:3.0:1788843531.461432:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843531.462457:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116508928 00000100:00100000:2.0:1788843531.462469:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116508928 00000100:00100000:2.0:1788843531.462520:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 318 00000100:00100000:2.0:1788843531.462530:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1032f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+12:6164:x1875738116508928:12345-192.168.203.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843531.462754:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1032f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+12:6164:x1875738116508928:12345-192.168.203.33@tcp:503:ll_cfg_requeue.0 Request processed in 224us (1503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843531.462762:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 318 00000100:00100000:1.0:1788843531.482434:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843531.483885:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116509056 00000100:00100000:2.0:1788843531.483899:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116509056 00000100:00100000:2.0:1788843531.483960:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 319 00000100:00100000:2.0:1788843531.483970:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1032f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+12:6164:x1875738116509056:12345-192.168.203.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843531.483988:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843531.484006:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d1155 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490855 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843531.484034:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d1155 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490855 expref: 13 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843531.484046:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d1155 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490855 expref: 13 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843531.484056:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007946a00, rc 0) 00000100:00100000:2.0:1788843531.484128:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1032f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+13:6164:x1875738116509056:12345-192.168.203.33@tcp:101:ll_cfg_requeue.0 Request processed in 159us (1701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843531.484135:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 319 00000100:00100000:2.0:1788843531.487538:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843531.491704:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116509184 00000100:00100000:1.0:1788843531.491720:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116509184 00000100:00100000:1.0:1788843531.492477:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 320 00000100:00100000:1.0:1788843531.492490:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+13:6164:x1875738116509184:12345-192.168.203.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788843531.492644:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+13:6164:x1875738116509184:12345-192.168.203.33@tcp:501:ll_cfg_requeue.0 Request processed in 157us (5113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843531.492661:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 320 00000100:00100000:2.0:1788843531.510237:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843531.510397:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116509312 00000100:00100000:1.0:1788843531.510407:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116509312 00000100:00100000:1.0:1788843531.510467:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 321 00000100:00100000:1.0:1788843531.510477:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+13:6164:x1875738116509312:12345-192.168.203.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788843531.510633:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+13:6164:x1875738116509312:12345-192.168.203.33@tcp:503:ll_cfg_requeue.0 Request processed in 143us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843531.510642:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 321 10000000:01000000:0.0:1788843531.933378:0:6503:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788843531.933385:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd006461000 from 7 10000000:01000000:0.0:1788843531.933389:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788843531.933443:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3cc00/0xa762dfcbd58d115c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843531.933455:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3cc00/0xa762dfcbd58d115c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843531.933465:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3cc00/0xa762dfcbd58d115c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843531.933488:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006754700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134419456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788843531.933552:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843531.933627:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788843531.933923:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134419456 00000100:00100000:1.0:1788843531.933932:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134419456 00000100:00100000:1.0:1788843531.934025:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788843531.934035:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:6503:x1875738134419456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843531.934062:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843531.934076:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd13fb34a00/0xa762dfcbd58d1163 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d115c expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843531.934100:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd13fb34a00/0xa762dfcbd58d1163 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d115c expref: 21 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843531.934121:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd13fb34a00/0xa762dfcbd58d1163 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d115c expref: 21 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843531.934130:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fb34a00, rc 0) 00000100:00100000:1.0:1788843531.934199:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:6503:x1875738134419456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843531.934206:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1788843531.934300:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006754700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134419456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843531.934315:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3cc00/0xa762dfcbd58d115c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d1163 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843531.934325:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3cc00/0xa762dfcbd58d115c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d1163 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843531.935433:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006754700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134419584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843531.935481:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843531.945192:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788843531.952248:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134419584 00000100:00100000:2.0:1788843531.952265:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134419584 00000100:00100000:2.0:1788843531.952329:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1788843531.952339:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:6503:x1875738134419584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843531.953964:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:6503:x1875738134419584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1620us (18476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843531.953975:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788843531.954206:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006754700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134419584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843531.954259:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006754700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134419712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843531.954304:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843531.954351:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788843531.954439:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134419712 00000100:00100000:2.0:1788843531.954446:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134419712 00000100:00100000:2.0:1788843531.954492:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1788843531.954501:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e092050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:6503:x1875738134419712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843531.954755:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e092050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:6503:x1875738134419712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 253us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843531.954762:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788843531.954976:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006754700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134419712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788843531.956344:0:13232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788843531.960589:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788843531.960708:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788843531.960722:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3cc00/0xa762dfcbd58d115c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d1163 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843531.960799:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3cc00/0xa762dfcbd58d115c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d1163 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843531.960810:0:6503:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788843531.960813:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd10c0f0000 from 7 10000000:01000000:2.0:1788843531.960816:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788843531.960921:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946e00/0xa762dfcbd58d116a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843531.960930:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd007946e00/0xa762dfcbd58d116a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843531.960941:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd007946e00/0xa762dfcbd58d116a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843531.960978:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ac8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134419840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788843531.961044:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843531.961157:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd111699cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843531.961500:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134419840 00000100:00100000:1.0:1788843531.961508:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134419840 00000100:00100000:1.0:1788843531.961604:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788843531.961615:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:6503:x1875738134419840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843531.961635:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843531.961656:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd13fb34800/0xa762dfcbd58d1171 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d116a expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843531.961679:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd13fb34800/0xa762dfcbd58d1171 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d116a expref: 22 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843531.961688:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd13fb34800/0xa762dfcbd58d1171 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d116a expref: 22 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843531.961703:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fb34800, rc 0) 00000100:00100000:1.0:1788843531.961926:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:6503:x1875738134419840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 312us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843531.961933:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1788843531.962011:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ac8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134419840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843531.962034:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd007946e00/0xa762dfcbd58d116a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d1171 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843531.962043:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd007946e00/0xa762dfcbd58d116a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d1171 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843531.962116:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134419968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843531.962166:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843531.962533:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd118d47840 going to sleep for 11 seconds 00000100:00100000:2.0:1788843531.962587:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134419968 00000100:00100000:2.0:1788843531.962592:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134419968 00000100:00100000:2.0:1788843531.962629:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788843531.962638:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:6503:x1875738134419968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843531.962925:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:6503:x1875738134419968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 287us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843531.962933:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1788843531.963059:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134419968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843531.963095:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134420096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788843531.963437:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843531.963460:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd118d47840 going to sleep for 11 seconds 00000100:00100000:2.0:1788843531.963508:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134420096 00000100:00100000:2.0:1788843531.963513:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134420096 00000100:00100000:2.0:1788843531.963544:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1788843531.963551:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:6503:x1875738134420096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843531.963822:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:6503:x1875738134420096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 270us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843531.963830:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1788843531.963978:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134420096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788843531.965310:0:13233:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788843531.969912:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788843531.969959:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788843531.969972:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946e00/0xa762dfcbd58d116a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d1171 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843531.969986:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007946e00/0xa762dfcbd58d116a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d1171 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843531.969999:0:6503:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788843531.970001:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd12e2b3800 from 7 10000000:01000000:1.0:1788843531.970004:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788843531.970045:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d1178 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843531.970053:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d1178 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843531.970064:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d1178 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843531.970089:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e876d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134420224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788843531.970250:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843531.970296:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00789c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843531.970556:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134420224 00000100:00100000:2.0:1788843531.970564:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134420224 00000100:00100000:2.0:1788843531.970616:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1788843531.970627:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:6503:x1875738134420224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843531.970639:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843531.970663:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d117f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d1178 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843531.970687:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d117f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d1178 expref: 23 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843531.970706:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d117f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d1178 expref: 23 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843531.970715:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007947400, rc 0) 00000100:00100000:2.0:1788843531.970977:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:6503:x1875738134420224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 351us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843531.970984:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1788843531.971063:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e876d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134420224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843531.971076:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d1178 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d117f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843531.971085:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d1178 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d117f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843531.971270:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e876d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134420352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788843531.971296:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843531.971448:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00789c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843531.971526:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134420352 00000100:00100000:2.0:1788843531.971531:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134420352 00000100:00100000:2.0:1788843531.971588:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1788843531.971595:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:6503:x1875738134420352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843531.971699:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:6503:x1875738134420352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843531.971705:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1788843531.976547:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e876d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134420352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843531.976610:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134420480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788843531.976694:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843531.976737:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd118d47e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788843531.977980:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134420480 00000100:00100000:2.0:1788843531.977990:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134420480 00000100:00100000:2.0:1788843531.978048:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1788843531.978057:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:6503:x1875738134420480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843531.978205:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:6503:x1875738134420480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (1510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843531.978212:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1788843531.978259:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134420480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788843531.982176:0:13234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788843531.982508:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788843531.982537:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788843531.982549:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d1178 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d117f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843531.982561:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d1178 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d117f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843531.982572:0:6503:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788843531.982574:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd118db4800 from 7 10000000:01000000:1.0:1788843531.982577:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788843531.982612:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35a00/0xa762dfcbd58d1186 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843531.982620:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35a00/0xa762dfcbd58d1186 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843531.982630:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35a00/0xa762dfcbd58d1186 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843531.982676:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e875c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134420608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788843531.982739:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843531.982785:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00789c180 going to sleep for 11 seconds 00000100:00100000:2.0:1788843531.982855:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134420608 00000100:00100000:2.0:1788843531.982862:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134420608 00000100:00100000:2.0:1788843531.982907:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788843531.982915:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:6503:x1875738134420608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843531.982927:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843531.982942:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007947800/0xa762dfcbd58d118d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d1186 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843531.982964:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007947800/0xa762dfcbd58d118d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d1186 expref: 24 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843531.982975:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007947800/0xa762dfcbd58d118d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d1186 expref: 24 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843531.982983:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007947800, rc 0) 00000100:00100000:2.0:1788843531.983025:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:6503:x1875738134420608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843531.983032:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1788843531.985494:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e875c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134420608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843531.985521:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35a00/0xa762dfcbd58d1186 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d118d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843531.985534:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35a00/0xa762dfcbd58d1186 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d118d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843531.985625:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134420736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843531.985690:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843531.985726:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd11195ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788843531.986465:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134420736 00000100:00100000:2.0:1788843531.986473:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134420736 00000100:00100000:2.0:1788843531.986538:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1788843531.986548:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:6503:x1875738134420736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843531.986682:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:6503:x1875738134420736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843531.986689:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788843531.986830:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134420736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843531.986871:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134420864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788843531.986921:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843531.986952:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd11195ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788843531.988456:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134420864 00000100:00100000:2.0:1788843531.988468:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134420864 00000100:00100000:2.0:1788843531.988517:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1788843531.988527:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:6503:x1875738134420864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843531.988667:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:6503:x1875738134420864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (1745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843531.988675:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788843531.988774:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134420864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788843531.989695:0:13235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788843531.989974:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788843531.989997:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788843531.990011:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35a00/0xa762dfcbd58d1186 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d118d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843531.990024:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35a00/0xa762dfcbd58d1186 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d118d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843532.442538:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843533.472803:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843533.722437:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134420992:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788843533.722508:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843533.722626:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134420992 00000100:00100000:0.0:1788843533.722645:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134420992 00000100:00100000:0.0:1788843533.722707:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788843533.722718:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134420992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788843533.722747:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843533.722797:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134420992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843533.722804:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:0.0:1788843533.722847:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd006756300 x1875738134420992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843549 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843533.722879:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134420992:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788843533.722947:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788843533.731820:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788843533.738849:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1875738134421248:0@lo:400:kworker.0 00000100:00100000:2.0:1788843533.738942:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843533.739013:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134421120:0@lo:400:kworker.0 00000100:00100000:2.0:1788843533.739043:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843533.739084:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134421248 00000100:00100000:2.0:1788843533.739091:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134421248 00000100:00100000:2.0:1788843533.739133:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788843533.739165:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1875738134421248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843533.739221:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1875738134421248:12345-0@lo:400:kworker.0 Request processed in 57us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843533.739233:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788843533.739255:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134421120 00000100:00100000:2.0:1788843533.739258:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134421120 00000100:00100000:2.0:1788843533.739280:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788843533.739285:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3631:x1875738134421120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843533.739313:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3631:x1875738134421120:12345-0@lo:400:kworker.0 Request processed in 27us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843533.739319:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788843533.739368:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1875738134421248:0@lo:400:kworker.0 00000100:00100000:2.0:1788843533.739385:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134421120:0@lo:400:kworker.0 00000100:00100000:0.0:1788843533.739695:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788843533.739705:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134421376:0@lo:400:kworker.0 00000100:00100000:0.0:1788843533.739738:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843533.739773:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134421376 00000100:00100000:0.0:1788843533.739777:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134421376 00000100:00100000:0.0:1788843533.739804:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788843533.739812:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd006754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134421376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843533.739848:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd006754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134421376:12345-0@lo:400:kworker.0 Request processed in 37us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843533.739868:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788843533.739897:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134421376:0@lo:400:kworker.0 00000100:00100000:3.0:1788843533.740131:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134421632:0@lo:400:kworker.0 00000100:00100000:3.0:1788843533.740190:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843533.740208:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1875738134422144:0@lo:400:kworker.0 00000100:00100000:3.0:1788843533.740230:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843533.740246:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788843533.740251:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134421760:0@lo:400:kworker.0 00000100:00100000:3.0:1788843533.740269:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843533.740281:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006757800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134422272:0@lo:400:kworker.0 00000100:00100000:3.0:1788843533.740299:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843533.740323:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134422144 00000100:00100000:3.0:1788843533.740327:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134422144 00000100:00100000:3.0:1788843533.740355:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134421760 00000100:00100000:3.0:1788843533.740364:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134421760 00000100:00100000:3.0:1788843533.740381:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134422272 00000100:00100000:3.0:1788843533.740384:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134422272 00000100:00100000:3.0:1788843533.740397:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788843533.740403:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875738134422144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843533.740437:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875738134422144:12345-0@lo:400:kworker.0 Request processed in 34us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843533.740442:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788843533.740456:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788843533.740461:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134421760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843533.740487:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134421760:12345-0@lo:400:kworker.0 Request processed in 25us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843533.740493:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788843533.740506:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788843533.740513:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134422272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843533.740538:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134422272:12345-0@lo:400:kworker.0 Request processed in 26us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843533.740544:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:3.0:1788843533.740562:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788843533.740565:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843533.740583:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134421760:0@lo:400:kworker.0 00010000:00080000:3.0:1788843533.740596:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd006757800 x1875738134422272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843533.740606:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006757800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134422272:0@lo:400:kworker.0 00000100:00100000:3.0:1788843533.740614:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1875738134422144:0@lo:400:kworker.0 00000100:00100000:3.0:1788843533.740659:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134421504:0@lo:400:kworker.0 00000100:00100000:3.0:1788843533.740682:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843533.740698:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134422016:0@lo:400:kworker.0 00000100:00100000:3.0:1788843533.740719:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843533.740735:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134422528:0@lo:400:kworker.0 00000100:00100000:3.0:1788843533.740755:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843533.740772:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788843533.740777:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1875738134421888:0@lo:400:kworker.0 00000100:00100000:3.0:1788843533.740798:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843533.740807:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134422400:0@lo:400:kworker.0 00000100:00100000:3.0:1788843533.740825:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843533.740848:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134422016 00000100:00100000:3.0:1788843533.740851:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134422016 00000100:00100000:3.0:1788843533.740879:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134422528 00000100:00100000:3.0:1788843533.740882:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134422528 00000100:00100000:3.0:1788843533.740893:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134422400 00000100:00100000:3.0:1788843533.740895:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134422400 00000100:00100000:3.0:1788843533.740907:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788843533.740913:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134422016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843533.741027:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134422016:12345-0@lo:400:kworker.0 Request processed in 113us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843533.741034:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788843533.741048:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788843533.741054:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134422528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843533.741079:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134422528:12345-0@lo:400:kworker.0 Request processed in 26us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843533.741095:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788843533.741105:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788843533.741110:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141a77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134422400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843533.741135:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141a77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134422400:12345-0@lo:400:kworker.0 Request processed in 25us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843533.741165:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1788843533.741182:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788843533.741185:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843533.741192:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134421504 00000100:00100000:3.0:1788843533.741195:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134421504 00000100:00100000:3.0:1788843533.741209:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134421888 00000100:00100000:3.0:1788843533.741211:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134421888 00000100:00100000:3.0:1788843533.741230:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788843533.741235:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134421504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843533.741263:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134421504:12345-0@lo:400:kworker.0 Request processed in 27us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843533.741268:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788843533.741278:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788843533.741284:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141a76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875738134421888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843533.741308:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141a76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875738134421888:12345-0@lo:400:kworker.0 Request processed in 24us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843533.741313:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:3.0:1788843533.741324:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788843533.741341:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd006754a80 x1875738134421888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843533.741350:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1875738134421888:0@lo:400:kworker.0 00010000:00080000:3.0:1788843533.741369:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd006757480 x1875738134422400/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843533.741378:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134422400:0@lo:400:kworker.0 00000100:00100000:3.0:1788843533.741387:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134421504:0@lo:400:kworker.0 00010000:00080000:3.0:1788843533.741396:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd006756680 x1875738134422016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843533.741403:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134422016:0@lo:400:kworker.0 00010000:00080000:3.0:1788843533.741412:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd006755880 x1875738134422528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843533.741420:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134422528:0@lo:400:kworker.0 00000100:00100000:0.0:1788843533.741499:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134421632 00000100:00100000:0.0:1788843533.741504:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134421632 00000100:00100000:0.0:1788843533.741537:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788843533.741544:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134421632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843533.741584:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134421632:12345-0@lo:400:kworker.0 Request processed in 40us (1393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843533.741590:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788843533.741857:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134421632:0@lo:400:kworker.0 00000100:00100000:3.0:1788843534.240696:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134422656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843534.240780:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843534.240856:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788843534.240865:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134422784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843534.243654:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843534.243730:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788843534.243749:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134422912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788843534.244700:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843534.244750:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134422656 00000100:00100000:3.0:1788843534.244758:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134422656 00000100:00100000:3.0:1788843534.244793:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134422784 00000100:00100000:3.0:1788843534.244796:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134422784 00000100:00100000:3.0:1788843534.244818:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134422912 00000100:00100000:3.0:1788843534.244821:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134422912 00000100:00100000:3.0:1788843534.244833:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788843534.244841:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134422656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788843534.244926:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843534.244970:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134422656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (4191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843534.244977:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788843534.244994:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788843534.245000:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134422784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788843534.245012:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843534.245035:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134422784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (1388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843534.245041:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788843534.245051:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788843534.245057:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134422912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788843534.245079:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843534.245105:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134422912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843534.245112:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:3.0:1788843534.245165:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fe0d880 x1875738134422912/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843550 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843534.245184:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134422912:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788843534.245213:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fe0df80 x1875738134422784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843550 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843534.245237:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134422784:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788843534.245250:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fe0ca80 x1875738134422656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843550 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843534.245261:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134422656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788843534.256755:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843534.256784:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843534.256811:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843534.256830:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843534.256851:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843534.256886:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116509568 00000100:00100000:2.0:1788843534.256905:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116509568 00000100:00100000:2.0:1788843534.256956:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116509824 00000100:00100000:2.0:1788843534.256959:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116509824 00000100:00100000:2.0:1788843534.256972:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116509696 00000100:00100000:2.0:1788843534.256974:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116509696 00000100:00100000:2.0:1788843534.256985:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116509952 00000100:00100000:2.0:1788843534.256988:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116509952 00000100:00100000:2.0:1788843534.257003:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 201 00000100:00100000:2.0:1788843534.257012:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2389:x1875738116509568:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843534.257083:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2389:x1875738116509568:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 71us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843534.257090:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 201 00000100:00100000:2.0:1788843534.257107:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 202 00000100:00100000:2.0:1788843534.257114:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2389:x1875738116509824:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843534.257138:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2389:x1875738116509824:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 25us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843534.257163:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 202 00000100:00100000:2.0:1788843534.257175:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 203 00000100:00100000:2.0:1788843534.257182:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2389:x1875738116509696:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843534.257217:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2389:x1875738116509696:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 36us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843534.257222:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 203 00000100:00100000:2.0:1788843534.257233:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 204 00000100:00100000:2.0:1788843534.257240:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2389:x1875738116509952:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843534.257262:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2389:x1875738116509952:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 23us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843534.257275:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 204 00000100:00100000:3.0:1788843534.257739:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116509440 00000100:00100000:3.0:1788843534.257747:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116509440 00000100:00100000:3.0:1788843534.257788:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 335 00000100:00100000:3.0:1788843534.257795:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+13:2389:x1875738116509440:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843534.257833:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+13:2389:x1875738116509440:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 39us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843534.257840:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 335 00000100:00080000:3.0:1788843534.257879:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788843534.257883:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1788843534.271844:0:13373:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg333-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788843534.492093:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843535.258728:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788843535.258763:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134423040:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788843535.258860:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843535.259451:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134423040 00000100:00100000:3.0:1788843535.259463:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134423040 00000100:00100000:3.0:1788843535.259641:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788843535.259653:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134423040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788843535.259702:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788843535.259778:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134423040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843535.259786:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788843535.259872:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134423040:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788843535.259926:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134423168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788843535.259967:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843535.273381:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134423168 00000100:00100000:0.0:1788843535.273402:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134423168 00000100:00100000:0.0:1788843535.273484:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788843535.273497:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134423168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788843535.273558:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788843535.273687:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134423168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 192us (13719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843535.273696:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788843535.274955:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134423168:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788843535.515076:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843536.539199:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843537.562364:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843538.586546:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843538.843005:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134423552:0@lo:400:kworker.0 00000100:00100000:0.0:1788843538.843172:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843538.843261:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1875738134424064:0@lo:400:kworker.0 00000100:00100000:0.0:1788843538.843293:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843538.843300:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134423680:0@lo:400:kworker.0 00000100:00100000:0.0:1788843538.843317:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134424576:0@lo:400:kworker.0 00000100:00100000:1.0:1788843538.843333:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843538.843352:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134423552 00000100:00100000:1.0:1788843538.843357:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134424192:0@lo:400:kworker.0 00000100:00100000:0.0:1788843538.843368:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134423552 00000100:00100000:1.0:1788843538.843392:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843538.843409:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134424704:0@lo:400:kworker.0 00000100:00100000:0.0:1788843538.843425:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788843538.843428:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843538.843435:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134423552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843538.843461:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1788843538.843467:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134423296:0@lo:400:kworker.0 00000100:00100000:3.0:1788843538.843560:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134424192 00000100:00100000:3.0:1788843538.843571:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134424192 00000100:00100000:3.0:1788843538.843628:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134424704 00000100:00100000:3.0:1788843538.843632:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134424704 00000100:00100000:3.0:1788843538.843653:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788843538.843660:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e874a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134424192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843538.843762:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134424064 00000100:00100000:2.0:1788843538.843766:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134424064 00000100:00100000:2.0:1788843538.843798:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134423680 00000100:00100000:2.0:1788843538.843801:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134423680 00000100:00100000:2.0:1788843538.843821:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788843538.843829:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875738134424064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843538.844048:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134423552:12345-0@lo:400:kworker.0 Request processed in 613us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843538.844058:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788843538.844180:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134423424:0@lo:400:kworker.0 00000100:00100000:0.0:1788843538.844212:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843538.844234:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134423936:0@lo:400:kworker.0 00000100:00100000:0.0:1788843538.844256:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843538.844266:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1875738134424448:0@lo:400:kworker.0 00000100:00100000:0.0:1788843538.844287:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843538.844303:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134424960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788843538.844327:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843538.844362:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843538.844400:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134423552:0@lo:400:kworker.0 00000100:00100000:0.0:1788843538.844466:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134424960 00000100:00100000:0.0:1788843538.844470:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134424960 00000100:00100000:0.0:1788843538.844502:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788843538.844510:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3632:x1875738134424960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788843538.844553:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843538.844605:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3632:x1875738134424960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843538.844608:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843538.844612:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788843538.844632:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134423424 00000100:00100000:1.0:1788843538.844638:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134423808:0@lo:400:kworker.0 00000100:00100000:0.0:1788843538.844642:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134423424 00000100:00100000:0.0:1788843538.844659:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134423936 00000100:00100000:0.0:1788843538.844661:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134423936 00000100:00100000:1.0:1788843538.844665:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843538.844675:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134424448 00000100:00100000:0.0:1788843538.844677:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134424448 00000100:00100000:1.0:1788843538.844683:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006757800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134424320:0@lo:400:kworker.0 00000100:00100000:0.0:1788843538.844689:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134424576 00000100:00100000:0.0:1788843538.844691:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134424576 00000100:00100000:0.0:1788843538.844705:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788843538.844706:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843538.844711:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134423680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843538.844717:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006754700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134424832:0@lo:400:kworker.0 00000100:00100000:1.0:1788843538.844738:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843538.844743:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134423680:12345-0@lo:400:kworker.0 Request processed in 32us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843538.844749:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788843538.844755:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134423680:0@lo:400:kworker.0 00000100:00100000:0.0:1788843538.844762:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788843538.844768:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134423424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843538.844795:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134423424:12345-0@lo:400:kworker.0 Request processed in 28us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843538.844799:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134424320 00000100:00100000:0.0:1788843538.844801:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788843538.844803:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134424320 00000100:00100000:0.0:1788843538.844812:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788843538.844817:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134423936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843538.844822:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134424832 00000100:00100000:1.0:1788843538.844824:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134424832 00000100:00100000:1.0:1788843538.844839:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788843538.844841:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134423936:12345-0@lo:400:kworker.0 Request processed in 25us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843538.844846:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134424704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843538.844848:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788843538.844858:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788843538.844864:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1875738134424448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843538.844959:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134424704:12345-0@lo:400:kworker.0 Request processed in 113us (1528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843538.844966:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788843538.844982:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788843538.844988:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134424320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843538.845015:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134424320:12345-0@lo:400:kworker.0 Request processed in 28us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843538.845016:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1875738134424448:12345-0@lo:400:kworker.0 Request processed in 152us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843538.845021:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788843538.845022:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788843538.845050:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788843538.845056:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875738134424576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843538.845093:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875738134424576:12345-0@lo:400:kworker.0 Request processed in 37us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843538.845099:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788843538.845120:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134423808 00000100:00100000:0.0:1788843538.845124:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134423808 00000100:00100000:0.0:1788843538.845172:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788843538.845178:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788843538.845179:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134423808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843538.845184:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134424832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843538.845213:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134424832:12345-0@lo:400:kworker.0 Request processed in 29us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843538.845213:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134423808:12345-0@lo:400:kworker.0 Request processed in 35us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843538.845220:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788843538.845251:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134423424:0@lo:400:kworker.0 00000100:00100000:0.0:1788843538.845261:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134423936:0@lo:400:kworker.0 00000100:00100000:0.0:1788843538.845271:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1875738134424448:0@lo:400:kworker.0 00010000:00080000:0.0:1788843538.845285:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007ac8700 x1875738134424960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843554 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843538.845304:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134424960:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788843538.845341:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:0.0:1788843538.845342:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd006756300 x1875738134424576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843538.845351:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134424576:0@lo:400:kworker.0 00000100:00080000:1.0:1788843538.845360:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788843538.845366:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788843538.845369:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788843538.845378:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134423808:0@lo:400:kworker.0 00010000:00080000:0.0:1788843538.845388:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd006757800 x1875738134424320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843538.845407:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006757800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134424320:0@lo:400:kworker.0 00010000:00080000:0.0:1788843538.845419:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd006754700 x1875738134424832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843538.845427:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006754700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134424832:0@lo:400:kworker.0 00000100:00080000:1.0:1788843538.845436:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788843538.845438:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd006755180 x1875738134424704/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843538.845447:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134424704:0@lo:400:kworker.0 00000100:00100000:1.0:1788843538.845498:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134423296 00000100:00100000:1.0:1788843538.845502:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134423296 00000100:00100000:1.0:1788843538.845608:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1788843538.845617:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3630:x1875738134423296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843538.845660:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3630:x1875738134423296:12345-0@lo:400:kworker.0 Request processed in 45us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843538.845666:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788843538.845686:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134423296:0@lo:400:kworker.0 00000100:00100000:3.0:1788843538.848029:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e874a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134424192:12345-0@lo:400:kworker.0 Request processed in 4357us (4622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843538.848057:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:0.0:1788843538.849981:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd006754380 x1875738134424192/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843538.850006:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134424192:0@lo:400:kworker.0 00000100:00100000:2.0:1788843538.852549:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875738134424064:12345-0@lo:400:kworker.0 Request processed in 8705us (9239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843538.852568:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00010000:00080000:0.0:1788843538.857287:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd006754a80 x1875738134424064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843538.857312:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1875738134424064:0@lo:400:kworker.0 00000100:00100000:2.0:1788843539.357173:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134425088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788843539.357273:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843539.357357:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134425344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843539.357393:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843539.357413:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134425216:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788843539.364069:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843539.365193:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134425088 00000100:00100000:1.0:1788843539.365211:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134425088 00000100:00100000:1.0:1788843539.365288:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134425344 00000100:00100000:1.0:1788843539.365293:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134425344 00000100:00100000:1.0:1788843539.365316:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788843539.365327:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134425088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788843539.365544:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788843539.365649:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134425088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 323us (8377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843539.365658:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788843539.365678:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788843539.365685:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134425344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788843539.365706:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788843539.365754:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134425344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (8360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843539.365760:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:3.0:1788843539.375384:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007acb100 x1875738134425088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843555 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843539.375417:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134425088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788843539.376894:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134425216 00000100:00100000:2.0:1788843539.376910:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134425216 00000100:00100000:2.0:1788843539.377019:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843539.377064:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843539.377088:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843539.377108:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843539.377135:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843539.377189:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116510080 00000100:00100000:2.0:1788843539.377194:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116510080 00000100:00100000:2.0:1788843539.377249:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 337 00000100:00100000:2.0:1788843539.377260:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+13:2389:x1875738116510080:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843539.377621:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+13:2389:x1875738116510080:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 359us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843539.377630:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 337 00000100:00100000:2.0:1788843539.377677:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116510336 00000100:00100000:2.0:1788843539.377681:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116510336 00000100:00100000:2.0:1788843539.377722:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116510592 00000100:00100000:2.0:1788843539.377726:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116510592 00000100:00100000:2.0:1788843539.377740:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116510208 00000100:00100000:2.0:1788843539.377743:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116510208 00000100:00100000:2.0:1788843539.377756:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116510464 00000100:00100000:2.0:1788843539.377759:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116510464 00000100:00100000:2.0:1788843539.377774:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 211 00000100:00100000:2.0:1788843539.377780:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2389:x1875738116510336:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843539.377814:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2389:x1875738116510336:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 35us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843539.377821:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 211 00000100:00100000:2.0:1788843539.377831:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 212 00000100:00100000:2.0:1788843539.377837:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2389:x1875738116510592:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843539.377858:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2389:x1875738116510592:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 22us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843539.377864:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 212 00000100:00100000:2.0:1788843539.377873:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 213 00000100:00100000:2.0:1788843539.377879:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2389:x1875738116510208:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843539.377900:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2389:x1875738116510208:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 21us (791us total) trans 0 rc 0/0 00010000:00080000:3.0:1788843539.380455:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd120369c00 x1875738134425344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843555 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843539.380496:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134425344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843539.382509:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 214 00000100:00100000:3.0:1788843539.382545:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2389:x1875738116510464:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843539.382872:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2389:x1875738116510464:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 346us (5734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843539.382880:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 214 00000100:00100000:2.0:1788843539.383178:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 213 00000100:00080000:2.0:1788843539.384024:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788843539.384033:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788843539.385051:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788843539.385075:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134425216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788843539.385111:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788843539.385225:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134425216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 162us (21167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843539.385232:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:3.0:1788843539.385261:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fa2c000 x1875738134425216/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843555 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843539.385297:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134425216:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788843539.610463:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788843539.793824:0:13523:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 00:58:57 (1788843537) === 00000100:00100000:3.0:1788843539.948574:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843539.950740:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116510720 00000100:00100000:0.0:1788843539.950762:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116510720 00000100:00100000:0.0:1788843539.950837:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 22 00000100:00100000:0.0:1788843539.950850:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2389:x1875738116510720:12345-192.168.203.33@tcp:41:mkdir.0 00000004:00000024:0.0:1788843539.950901:0:11996:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788843539.951095:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2389:x1875738116510720:12345-192.168.203.33@tcp:41:mkdir.0 Request processed in 246us (2956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843539.951104:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 22 00000100:00100000:0.0:1788843539.951208:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843539.951922:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116510848 00000100:00100000:0.0:1788843539.951932:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116510848 00000100:00100000:0.0:1788843539.951978:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2 00000100:00100000:0.0:1788843539.951987:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:10479:x1875738116510848:12345-192.168.203.33@tcp:700:mkdir.0 00000100:00100000:0.0:1788843539.952130:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:10479:x1875738116510848:12345-192.168.203.33@tcp:700:mkdir.0 Request processed in 144us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843539.952137:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2 00000100:00100000:0.0:1788843539.962336:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843539.963105:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116511104 00000100:00100000:2.0:1788843539.963119:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116511104 00000100:00100000:2.0:1788843539.963216:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 23 00000100:00100000:2.0:1788843539.963229:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:10479:x1875738116511104:12345-192.168.203.33@tcp:36:mkdir.0 00010000:00010000:2.0:1788843539.963314:0:9517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843539.963554:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af200/0xa762dfcbd58d1036 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224907c9 expref: 6 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843539.963669:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd007730d00) 00010000:00010000:2.0:1788843539.963689:0:9517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788843539.963879:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1194 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843539.963895:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1194 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843539.963906:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1194 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843539.964036:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d119b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843539.964047:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d119b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843539.964055:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d119b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843539.966097:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d11a2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843539.966265:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d11a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843539.966277:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d11a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788843539.966302:0:9517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c050dfc8 reply state 000000007ecc85a1 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d11a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843539.966386:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d11a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843539.966396:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9bd13dfdac00) 00010000:00010000:2.0:1788843539.966399:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788843539.966403:0:9517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788843539.966409:0:9517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788843539.966418:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1194 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843539.966425:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1194 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843539.966443:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1194 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843539.966449:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843539.966454:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1194 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843539.966462:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1194 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843539.966474:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd13338fb00) 00010000:00010000:2.0:1788843539.966477:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843539.966480:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1194 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843539.966487:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1194 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788843539.966514:0:9517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c050dfc8 reply state 000000007ecc85a1 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d119b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843539.966524:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d119b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843539.966531:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bd13338f400) 00010000:00010000:2.0:1788843539.966533:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788843539.966535:0:9517:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788843539.966859:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:10479:x1875738116511104:12345-192.168.203.33@tcp:36:mkdir.0 Request processed in 3629us (4533us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788843539.966868:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 23 00000100:00100000:0.0:1788843539.977939:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843539.978020:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116511232 00000100:00100000:2.0:1788843539.978032:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116511232 00000100:00100000:2.0:1788843539.978105:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 24 00000100:00100000:2.0:1788843539.978117:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:10480:x1875738116511232:12345-192.168.203.33@tcp:101:chmod.0 00010000:00010000:2.0:1788843539.978163:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843539.978192:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d11a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f2249085c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843539.978276:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d11b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843539.978294:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d11b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843539.978308:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d11b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843539.978360:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788843539.978365:0:6506:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788843539.978409:0:6506:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d11b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843539.978442:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d11a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249085c expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843539.978463:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d11b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249085c expref: 8 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843539.978473:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd13dfda500) 00010000:00010000:2.0:1788843539.978476:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788843539.978503:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007946800, rc 0) 00000100:00100000:2.0:1788843539.978610:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:10480:x1875738116511232:12345-192.168.203.33@tcp:101:chmod.0 Request processed in 494us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843539.978618:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 24 00000100:00100000:3.0:1788843539.981211:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843539.981284:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116511488 00000100:00100000:0.0:1788843539.981299:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116511488 00000100:00100000:0.0:1788843539.981374:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 25 00000100:00100000:0.0:1788843539.981387:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:10480:x1875738116511488:12345-192.168.203.33@tcp:36:chmod.0 00010000:00010000:0.0:1788843539.981465:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843539.981510:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d11b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249085c expref: 8 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843539.981533:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd13dfda500) 00010000:00010000:0.0:1788843539.981545:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788843539.981579:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d11b7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843539.981604:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d11b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843539.981632:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d11b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788843539.982184:0:6508:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004665e739 reply state 00000000c9e9daed transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d11b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843539.982211:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d11b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843539.982283:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd00658c300) 00010000:00010000:0.0:1788843539.982288:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788843539.982293:0:6508:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788843539.982362:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788843539.982489:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+9:10480:x1875738116511488:12345-192.168.203.33@tcp:36:chmod.0 Request processed in 1101us (1288us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788843539.982499:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 25 00000100:00100000:3.0:1788843540.006655:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843540.006754:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116511616 00000100:00100000:2.0:1788843540.006792:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116511616 00000100:00100000:2.0:1788843540.006868:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 26 00000100:00100000:2.0:1788843540.006878:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+9:10481:x1875738116511616:12345-192.168.203.33@tcp:101:chown.0 00010000:00010000:2.0:1788843540.006912:0:9517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843540.006938:0:9517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d11be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490863 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.007032:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d11c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.007051:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d11c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.007065:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d11c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843540.007124:0:9517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788843540.007129:0:9517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788843540.007208:0:9517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d11c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.007242:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d11be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490863 expref: 11 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.007260:0:9517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d11c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490863 expref: 10 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.007290:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd00658c300) 00010000:00010000:2.0:1788843540.007294:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788843540.007299:0:9517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007947c00, rc 0) 00000100:00100000:2.0:1788843540.007368:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+10:10481:x1875738116511616:12345-192.168.203.33@tcp:101:chown.0 Request processed in 491us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843540.007375:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 26 00000100:00100000:3.0:1788843540.016720:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843540.016847:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116511744 00000100:00100000:0.0:1788843540.016861:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116511744 00000100:00100000:0.0:1788843540.016937:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 27 00000100:00100000:0.0:1788843540.016949:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+10:10481:x1875738116511744:12345-192.168.203.33@tcp:101:chown.0 00010000:00010000:0.0:1788843540.016974:0:11996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843540.017011:0:11996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d11cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f2249086a expref: -99 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.017098:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d11d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.017117:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d11d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.018791:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d11d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.018837:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d11da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.018853:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d11da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.018862:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d11da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.018980:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c200/0xa762dfcbd58d11e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.018989:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c200/0xa762dfcbd58d11e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.018996:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c200/0xa762dfcbd58d11e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843540.019060:0:11996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788843540.019064:0:11996:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788843540.019093:0:11996:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c200/0xa762dfcbd58d11e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.019108:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d11d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.019115:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d11d3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.020551:0:11996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d11d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.020560:0:11996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3dc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843540.020566:0:11996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d11d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.020577:0:11996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d11d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.020611:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd00658c300) 00010000:00010000:0.0:1788843540.020615:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843540.020621:0:11996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d11d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.020628:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d11d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.020653:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d11da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.020661:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d11da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.020668:0:11996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d11da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.020673:0:11996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843540.020677:0:11996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d11da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.020708:0:11996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d11da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.020718:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bd13338f400) 00010000:00010000:0.0:1788843540.020720:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843540.020724:0:11996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d11da lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.020731:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d11da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.020788:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d11cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249086a expref: 12 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.020804:0:11996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c200/0xa762dfcbd58d11e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249086a expref: 11 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.020812:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9bd13dfdac00) 00010000:00010000:0.0:1788843540.020815:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788843540.020817:0:11996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3c200, rc 0) 00000100:00100000:0.0:1788843540.021102:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+11:10481:x1875738116511744:12345-192.168.203.33@tcp:101:chown.0 Request processed in 4152us (4393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843540.021114:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 27 00000100:00100000:0.0:1788843540.032881:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843540.033028:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116511872 00000100:00100000:2.0:1788843540.033042:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116511872 00000100:00100000:2.0:1788843540.033121:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 6 00000100:00100000:2.0:1788843540.033135:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+11:10481:x1875738116511872:12345-192.168.203.33@tcp:900:chown.0 00000100:00100000:2.0:1788843540.033265:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+11:10481:x1875738116511872:12345-192.168.203.33@tcp:900:chown.0 Request processed in 133us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843540.033274:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 6 00000100:00100000:2.0:1788843540.038073:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843540.038847:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116512128 00000100:00100000:0.0:1788843540.038862:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116512128 00000100:00100000:0.0:1788843540.038941:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 28 00000100:00100000:0.0:1788843540.038953:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+11:10481:x1875738116512128:12345-192.168.203.33@tcp:36:chown.0 00010000:00010000:0.0:1788843540.039043:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843540.039086:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c200/0xa762dfcbd58d11e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249086a expref: 11 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.039109:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9bd13dfdac00) 00010000:00010000:0.0:1788843540.039114:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788843540.039212:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d11e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.039228:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d11e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.039240:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d11e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788843540.054839:0:6485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:0.0:1788843540.054957:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d119b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.054970:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d119b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.054978:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d119b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.054983:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843540.054988:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d119b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.055045:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d119b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.055080:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bd13338f400) 00010000:00010000:0.0:1788843540.055083:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843540.055088:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d119b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.055095:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d119b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.055114:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d11a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.055121:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d11a2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.055127:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d11a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.055131:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843540.055134:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d11a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.055210:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d11a2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.055220:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9bd13dfdac00) 00010000:00010000:0.0:1788843540.055223:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843540.055236:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d11a2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.055243:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d11a2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.055284:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d11b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.055290:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d11b7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.055295:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d11b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.055301:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3c800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843540.055305:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d11b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.055311:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d11b7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.055320:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd00658c300) 00010000:00010000:0.0:1788843540.055324:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000004:00010000:3.0:1788843540.055325:0:6508:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ccd0cfc reply state 00000000b89558ad transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d11e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.055327:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d11b7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.055343:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d11b7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843540.055369:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d11e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843540.055382:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9bd13dfdac00) 00010000:00010000:3.0:1788843540.055385:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788843540.055390:0:6508:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788843540.055407:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:3.0:1788843540.055547:0:6508:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788843540.055579:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:10481:x1875738116512128:12345-192.168.203.33@tcp:36:chown.0 Request processed in 16622us (17515us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788843540.055601:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 28 00010000:00010000:2.0:1788843540.056022:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d11e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.056034:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d11e8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.056039:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d11e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.056043:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843540.056046:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d11e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.056064:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d11e8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.056076:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9bd13dfdac00) 00010000:00010000:2.0:1788843540.056078:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788843540.056081:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d11e8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.056086:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d11e8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843540.079901:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843540.080027:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116512256 00000100:00100000:2.0:1788843540.080044:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116512256 00000100:00100000:2.0:1788843540.080122:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 29 00000100:00100000:2.0:1788843540.080135:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:10482:x1875738116512256:12345-192.168.203.33@tcp:101:touch.500 00010000:00010000:2.0:1788843540.080206:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843540.080229:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d11ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490871 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788843540.084349:0:6506:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1257us 00010000:00010000:0.0:1788843540.115366:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d11f6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.115388:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d11f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.115413:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d11f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.115431:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d11fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.115439:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d11fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.115446:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d11fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.115578:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1204 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.115587:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1204 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.115605:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1204 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843540.115636:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788843540.115640:0:6506:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788843540.115675:0:6506:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1204 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.115689:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d11f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.115695:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d11f6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.115711:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d11f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.115718:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3c800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843540.115722:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d11f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.115731:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d11f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.115743:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd00658c300) 00010000:00010000:0.0:1788843540.115766:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843540.115770:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d11f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.115777:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d11f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.115796:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d11fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.115802:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d11fd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.115808:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d11fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.115813:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843540.115815:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d11fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.115831:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d11fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.115840:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bd00658c200) 00010000:00010000:0.0:1788843540.115842:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843540.115844:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d11fd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.115850:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d11fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.115893:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d11ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490871 expref: 8 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.115907:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1204 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490871 expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.115913:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9bd00658c400) 00010000:00010000:0.0:1788843540.115915:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788843540.115918:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3dc00, rc 0) 00000100:00100000:0.0:1788843540.115992:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:10482:x1875738116512256:12345-192.168.203.33@tcp:101:touch.500 Request processed in 35859us (36107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843540.116001:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 29 00000100:00100000:0.0:1788843540.124717:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843540.124931:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116512512 00000100:00100000:3.0:1788843540.124949:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116512512 00000100:00100000:2.0:1788843540.126756:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 30 00000100:00100000:2.0:1788843540.129365:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:10482:x1875738116512512:12345-192.168.203.33@tcp:101:touch.500 00010000:00010000:2.0:1788843540.129395:0:11996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843540.129424:0:11996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946200/0xa762dfcbd58d120b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490878 expref: -99 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.129569:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1212 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.129624:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1212 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.129639:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1212 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.129805:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1219 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.129830:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1219 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.129843:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1219 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788843540.130297:0:11996:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1788843540.130428:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1220 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.130438:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1220 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.130445:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1220 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.130477:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1212 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.130485:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1212 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.130502:0:11996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1212 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.130517:0:11996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843540.131698:0:11996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1212 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.131717:0:11996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1212 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.131734:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9bd00658c400) 00010000:00010000:2.0:1788843540.131737:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843540.131743:0:11996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1212 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.131757:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1212 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788843540.131775:0:11996:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000010a1f72b reply state 00000000b2c7ebf4 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1219 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.131787:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1219 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.131794:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd52ae8b4 (ffff9bd00658a300) 00010000:00010000:2.0:1788843540.131796:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788843540.131799:0:11996:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788843540.131845:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946200/0xa762dfcbd58d120b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490878 expref: 10 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.131862:0:11996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1220 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490878 expref: 9 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.131885:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9bd00658aa00) 00010000:00010000:2.0:1788843540.131888:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843540.131890:0:11996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007947000, rc 0) 00000100:00100000:2.0:1788843540.131966:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+10:10482:x1875738116512512:12345-192.168.203.33@tcp:101:touch.500 Request processed in 2630us (7257us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788843540.131975:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 30 00000100:00100000:3.0:1788843540.140434:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843540.141066:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116512768 00000100:00100000:1.0:1788843540.141078:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116512768 00000100:00100000:1.0:1788843540.141166:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 31 00000100:00100000:1.0:1788843540.141177:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+10:10482:x1875738116512768:12345-192.168.203.33@tcp:36:touch.500 00010000:00010000:1.0:1788843540.141237:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843540.141264:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1220 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490878 expref: 10 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.141284:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9bd00658aa00) 00010000:00010000:1.0:1788843540.141296:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788843540.141354:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35400/0xa762dfcbd58d122e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.141369:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35400/0xa762dfcbd58d122e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.141379:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35400/0xa762dfcbd58d122e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788843540.141489:0:6508:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e0b95aa reply state 0000000067e0c4b2 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35400/0xa762dfcbd58d122e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.141501:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35400/0xa762dfcbd58d122e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.141507:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9bd00746cc00) 00010000:00010000:1.0:1788843540.141523:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788843540.141527:0:6508:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788843540.141629:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+11:10482:x1875738116512768:12345-192.168.203.33@tcp:36:touch.500 Request processed in 453us (1203us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788843540.141636:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 31 00000100:00100000:2.0:1788843540.145466:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843540.145942:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116512896 00000100:00100000:0.0:1788843540.145961:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116512896 00000100:00100000:0.0:1788843540.146060:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 32 00000100:00100000:0.0:1788843540.146075:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+11:10482:x1875738116512896:12345-192.168.203.33@tcp:101:touch.500 00010000:00010000:0.0:1788843540.146169:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843540.146202:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1235 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f2249087f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.146285:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1235 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249087f expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.146302:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1235 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249087f expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843540.146325:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9bd00746cc00) 00010000:00010000:0.0:1788843540.146328:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788843540.146333:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3c800, rc 0) 00000100:00100000:0.0:1788843540.146407:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+12:10482:x1875738116512896:12345-192.168.203.33@tcp:101:touch.500 Request processed in 337us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843540.146414:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 32 00000100:00100000:0.0:1788843540.149695:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843540.150026:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116513024 00000100:00100000:1.0:1788843540.150040:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116513024 00000100:00100000:1.0:1788843540.150097:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 24 00000100:00100000:1.0:1788843540.150106:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2386:x1875738116513024:12345-192.168.203.33@tcp:8:touch.500 00010000:00080000:1.0:1788843540.150177:0:8421:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f25f61b6-5faf-4e05-81a4-dea3dba05dc5@192.168.203.33@tcp t0 exp 0000000000000000 cur 318 last 0 00000020:00000080:1.0:1788843540.150208:0:8421:0:(genops.c:1385:class_connect()) connect: client f25f61b6-5faf-4e05-81a4-dea3dba05dc5, cookie 0xa762dfcbd58d123c 00002000:00100000:1.0:1788843540.150220:0:8421:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f25f61b6-5faf-4e05-81a4-dea3dba05dc5/ffff9bd141a7b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788843540.150231:0:8421:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788843540.150301:0:8421:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788843540.150331:0:8421:0:(import.c:65:import_set_state_nolock()) ffff9bd141a7e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843540.150405:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2386:x1875738116513024:12345-192.168.203.33@tcp:8:touch.500 Request processed in 299us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843540.150412:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 24 00000100:00100000:3.0:1788843540.155666:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843540.157404:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116513152 00000100:00100000:1.0:1788843540.157419:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116513152 00000100:00100000:1.0:1788843540.157512:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 25 00000100:00100000:1.0:1788843540.157523:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:0:x1875738116513152:12345-192.168.203.33@tcp:2:touch.500 00000100:00080000:2.0:1788843540.158366:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788843540.169358:0:9500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:0.0:1788843540.169374:0:9500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f25f61b6-5faf-4e05-81a4-dea3dba05dc5 00000100:00100000:1.0:1788843540.169630:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:0:x1875738116513152:12345-192.168.203.33@tcp:2:touch.500 Request processed in 12104us (13966us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788843540.169642:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 25 00000100:00100000:0.0:1788843540.175248:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843540.175477:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116513408 00000100:00100000:3.0:1788843540.175498:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116513408 00000100:00100000:3.0:1788843540.175570:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2 00000100:00100000:3.0:1788843540.175583:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+12:10482:x1875738116513408:12345-192.168.203.33@tcp:35:touch.500 00000100:00100000:3.0:1788843540.175995:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+13:10482:x1875738116513408:12345-192.168.203.33@tcp:35:touch.500 Request processed in 411us (758us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788843540.176025:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2 00000100:00100000:0.0:1788843540.193891:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843540.194005:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116513536 00000100:00100000:2.0:1788843540.194019:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116513536 00000100:00100000:2.0:1788843540.194196:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 33 00000100:00100000:2.0:1788843540.194209:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+13:10483:x1875738116513536:12345-192.168.203.33@tcp:101:rm.0 00010000:00010000:2.0:1788843540.194242:0:11996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843540.194280:0:11996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1243 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490886 expref: -99 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.194370:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d124a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.194388:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d124a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.194401:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d124a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843540.194462:0:11996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788843540.194466:0:11996:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788843540.194554:0:11996:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d124a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.194587:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1243 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490886 expref: 15 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.194620:0:11996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d124a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490886 expref: 14 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.194629:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9bd00658c400) 00010000:00010000:2.0:1788843540.194632:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788843540.194637:0:11996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007946800, rc 0) 00000100:00100000:2.0:1788843540.194711:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+14:10483:x1875738116513536:12345-192.168.203.33@tcp:101:rm.0 Request processed in 505us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843540.194720:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 33 00000100:00100000:2.0:1788843540.197632:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843540.197710:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116513792 00000100:00100000:3.0:1788843540.197728:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116513792 00000100:00100000:3.0:1788843540.197804:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 34 00000100:00100000:3.0:1788843540.197817:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+14:10483:x1875738116513792:12345-192.168.203.33@tcp:101:rm.0 00010000:00010000:3.0:1788843540.197846:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843540.197875:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae600/0xa762dfcbd58d1251 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f2249088d expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843540.198015:0:6507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788843540.198232:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae600/0xa762dfcbd58d1251 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249088d expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843540.198250:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd00658c300) 00010000:00010000:3.0:1788843540.198253:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788843540.198272:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae600/0xa762dfcbd58d1251 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249088d expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843540.198288:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10f7ae600, rc 0) 00000100:00100000:3.0:1788843540.198358:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+15:10483:x1875738116513792:12345-192.168.203.33@tcp:101:rm.0 Request processed in 544us (740us total) trans 4294967305 rc 301/301 00000100:00100000:3.0:1788843540.198366:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 34 00000100:00100000:0.0:1788843540.202906:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843540.203007:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116513920 00000100:00100000:3.0:1788843540.203021:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116513920 00000100:00100000:3.0:1788843540.203099:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 3 00000100:00100000:3.0:1788843540.203111:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+15:10483:x1875738116513920:12345-192.168.203.33@tcp:37:rm.0 00000100:00100000:3.0:1788843540.210952:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+15:10483:x1875738116513920:12345-192.168.203.33@tcp:37:rm.0 Request processed in 7826us (8046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843540.210969:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 3 00000100:00100000:2.0:1788843540.215532:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843540.215707:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116514176 00000100:00100000:0.0:1788843540.215721:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116514176 00000100:00100000:0.0:1788843540.215797:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 4 00000100:00100000:0.0:1788843540.215810:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd133002450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+15:10483:x1875738116514176:12345-192.168.203.33@tcp:35:rm.0 00000100:00100000:0.0:1788843540.216384:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd133002450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+16:10483:x1875738116514176:12345-192.168.203.33@tcp:35:rm.0 Request processed in 571us (862us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788843540.216411:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 4 00000100:00100000:0.0:1788843540.223706:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843540.223842:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116514432 00000100:00100000:2.0:1788843540.223856:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116514432 00000100:00100000:2.0:1788843540.223933:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 35 00000100:00100000:2.0:1788843540.223946:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+16:10483:x1875738116514432:12345-192.168.203.33@tcp:101:rm.0 00010000:00010000:2.0:1788843540.223978:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843540.224005:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d125f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490894 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.224462:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1266 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.224695:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1266 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.224733:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1266 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843540.224749:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788843540.224898:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d125f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490894 expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.224922:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1266 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490894 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.224933:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9bd00658c400) 00010000:00010000:2.0:1788843540.224937:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788843540.224942:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007946c00, rc 0) 00000100:00100000:2.0:1788843540.225213:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+18:10483:x1875738116514432:12345-192.168.203.33@tcp:101:rm.0 Request processed in 1268us (1521us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788843540.225222:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 35 00000100:00100000:2.0:1788843540.229258:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843540.229431:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116514560 00000100:00100000:0.0:1788843540.229444:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116514560 00000100:00100000:0.0:1788843540.229525:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 36 00000100:00100000:0.0:1788843540.229537:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+18:10483:x1875738116514560:12345-192.168.203.33@tcp:41:rm.0 00000004:00000024:0.0:1788843540.229620:0:11996:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1788843540.229707:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+18:10483:x1875738116514560:12345-192.168.203.33@tcp:41:rm.0 Request processed in 172us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843540.229716:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 36 00000100:00100000:0.0:1788843540.233761:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843540.234586:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116514688 00000100:00100000:2.0:1788843540.234610:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116514688 00000100:00100000:2.0:1788843540.234693:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 37 00000100:00100000:2.0:1788843540.234705:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+18:10483:x1875738116514688:12345-192.168.203.33@tcp:101:rm.0 00010000:00010000:2.0:1788843540.234731:0:9517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843540.234760:0:9517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1274 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f2249089b expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.234902:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946200/0xa762dfcbd58d127b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.234941:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946200/0xa762dfcbd58d127b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.234955:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946200/0xa762dfcbd58d127b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.234971:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1282 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.234978:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1282 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.234985:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1282 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.235896:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031400/0xa762dfcbd58d1289 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.235914:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031400/0xa762dfcbd58d1289 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.235922:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031400/0xa762dfcbd58d1289 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843540.235970:0:9517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788843540.235975:0:9517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788843540.235997:0:9517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031400/0xa762dfcbd58d1289 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.236011:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031400/0xa762dfcbd58d1289 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.236037:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946200/0xa762dfcbd58d127b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.236044:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946200/0xa762dfcbd58d127b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.236050:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946200/0xa762dfcbd58d127b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.236057:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843540.236677:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946200/0xa762dfcbd58d127b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.236692:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946200/0xa762dfcbd58d127b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.236713:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9bd00658c400) 00010000:00010000:2.0:1788843540.236716:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843540.236722:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946200/0xa762dfcbd58d127b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.236728:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946200/0xa762dfcbd58d127b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.236746:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1282 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.236753:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1282 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.236758:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1282 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.236773:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843540.236776:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1282 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.236782:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1282 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.236790:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd52ae8b4 (ffff9bd00658a300) 00010000:00010000:2.0:1788843540.236793:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843540.236796:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1282 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.236801:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1282 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.236856:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1274 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249089b expref: 20 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.236874:0:9517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031400/0xa762dfcbd58d1289 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249089b expref: 19 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.236881:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9bd00746cc00) 00010000:00010000:2.0:1788843540.236884:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843540.236887:0:9517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd100031400, rc 0) 00000100:00100000:2.0:1788843540.237019:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+19:10483:x1875738116514688:12345-192.168.203.33@tcp:101:rm.0 Request processed in 2315us (3272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843540.237028:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 37 00000100:00100000:2.0:1788843540.242422:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843540.242596:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116514944 00000100:00100000:0.0:1788843540.242611:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116514944 00000100:00100000:1.0:1788843540.242733:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 38 00000100:00100000:1.0:1788843540.242757:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+19:10483:x1875738116514944:12345-192.168.203.33@tcp:36:rm.0 00010000:00010000:1.0:1788843540.242834:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788843540.242874:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031400/0xa762dfcbd58d1289 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249089b expref: 19 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.242903:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1235 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249087f expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.242918:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9bd00746cc00) 00010000:00010000:1.0:1788843540.242930:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d124a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490886 expref: 17 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.242939:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9bd00658c400) 00010000:00010000:1.0:1788843540.242943:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788843540.242972:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34e00/0xa762dfcbd58d1290 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.242989:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34e00/0xa762dfcbd58d1290 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.243000:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34e00/0xa762dfcbd58d1290 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.243013:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d1297 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.243021:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d1297 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.243027:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d1297 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.243175:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d129e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.243185:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d129e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.243191:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d129e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788843540.243466:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1788843540.243478:0:6506:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 318296336260ns, next at 319296333445ns, rc = 0 00010000:00010000:1.0:1788843540.243533:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1420e5200/0xa762dfcbd58d12a5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.243542:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1420e5200/0xa762dfcbd58d12a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.243550:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1420e5200/0xa762dfcbd58d12a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.243558:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1420e5200/0xa762dfcbd58d12a5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.243564:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1420e5200/0xa762dfcbd58d12a5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.243572:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1420e5200/0xa762dfcbd58d12a5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.243607:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843540.243632:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d129e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.243648:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d129e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.243654:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d129e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.243660:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb34c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843540.243665:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d129e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.243672:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d129e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.243681:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9bd00746cc00) 00010000:00010000:1.0:1788843540.243684:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788843540.243688:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d129e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.243694:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d129e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.243711:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34e00/0xa762dfcbd58d1290 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.243717:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34e00/0xa762dfcbd58d1290 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.243722:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34e00/0xa762dfcbd58d1290 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.243726:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb34e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843540.243736:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34e00/0xa762dfcbd58d1290 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.243742:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34e00/0xa762dfcbd58d1290 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.243750:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9bd00658c400) 00010000:00010000:1.0:1788843540.243752:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843540.243755:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34e00/0xa762dfcbd58d1290 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.243760:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34e00/0xa762dfcbd58d1290 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788843540.243769:0:6506:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002571f414 reply state 00000000e44b835a transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d1297 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.243795:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d1297 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843540.243801:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd52ae8b4 (ffff9bd00658a300) 00010000:00010000:1.0:1788843540.243803:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788843540.243807:0:6506:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788843540.243914:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+18:10483:x1875738116514944:12345-192.168.203.33@tcp:36:rm.0 Request processed in 1159us (1505us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788843540.243923:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 38 00010000:00010000:2.0:1788843540.247653:0:6495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843540.247671:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1420e5200/0xa762dfcbd58d12a5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.247683:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1420e5200 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843540.247689:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1420e5200/0xa762dfcbd58d12a5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.247700:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1420e5200/0xa762dfcbd58d12a5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.247723:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9bd00746cc00) 00010000:00010000:2.0:1788843540.247726:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788843540.247732:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1420e5200/0xa762dfcbd58d12a5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.247739:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1420e5200/0xa762dfcbd58d12a5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.247761:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843540.247763:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843540.247765:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843540.248294:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843540.248361:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116515200 00000100:00100000:3.0:1788843540.248374:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116515200 00000100:00100000:3.0:1788843540.248442:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 5 00000100:00100000:3.0:1788843540.248453:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+18:10483:x1875738116515200:12345-192.168.203.33@tcp:35:rm.0 00000100:00100000:3.0:1788843540.248747:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+19:10483:x1875738116515200:12345-192.168.203.33@tcp:35:rm.0 Request processed in 295us (459us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788843540.248755:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 5 00000100:00100000:3.0:1788843540.251701:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843540.251803:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116515456 00000100:00100000:2.0:1788843540.251816:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116515456 00000100:00100000:2.0:1788843540.251892:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 39 00000100:00100000:2.0:1788843540.251906:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+19:10483:x1875738116515456:12345-192.168.203.33@tcp:36:rm.0 00010000:00010000:2.0:1788843540.251989:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788843540.252027:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1266 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490894 expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.252055:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1204 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490871 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.252102:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9bd00658c400) 00010000:00010000:2.0:1788843540.252125:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d11c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490863 expref: 17 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.252135:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd00658c300) 00010000:00010000:2.0:1788843540.252184:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788843540.252218:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031200/0xa762dfcbd58d12ac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.252233:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031200/0xa762dfcbd58d12ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.252246:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031200/0xa762dfcbd58d12ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.252273:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030e00/0xa762dfcbd58d12b3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.252281:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030e00/0xa762dfcbd58d12b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.252286:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030e00/0xa762dfcbd58d12b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.252394:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031600/0xa762dfcbd58d12ba lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.252402:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031600/0xa762dfcbd58d12ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.252422:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031600/0xa762dfcbd58d12ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843540.252725:0:6507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788843540.252744:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031600/0xa762dfcbd58d12ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.252751:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031600/0xa762dfcbd58d12ba lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.252758:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031600/0xa762dfcbd58d12ba lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.252765:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd100031600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843540.252770:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031600/0xa762dfcbd58d12ba lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.252778:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031600/0xa762dfcbd58d12ba lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.252788:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9bd00658ae00) 00010000:00010000:2.0:1788843540.252791:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788843540.252795:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031600/0xa762dfcbd58d12ba lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.252801:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031600/0xa762dfcbd58d12ba lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.252825:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031200/0xa762dfcbd58d12ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.252831:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031200/0xa762dfcbd58d12ac lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.252843:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031200/0xa762dfcbd58d12ac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.252848:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd100031200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843540.252851:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031200/0xa762dfcbd58d12ac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.252984:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031200/0xa762dfcbd58d12ac lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.252994:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd00658af00) 00010000:00010000:2.0:1788843540.252996:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843540.253000:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031200/0xa762dfcbd58d12ac lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.253006:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031200/0xa762dfcbd58d12ac lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788843540.253021:0:6507:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dca6dc43 reply state 00000000e39b5243 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030e00/0xa762dfcbd58d12b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.253032:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030e00/0xa762dfcbd58d12b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843540.253039:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bd00658a400) 00010000:00010000:2.0:1788843540.253041:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788843540.253043:0:6507:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788843540.253659:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+18:10483:x1875738116515456:12345-192.168.203.33@tcp:36:rm.0 Request processed in 1750us (1968us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788843540.253670:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 39 00000100:00100000:0.0:1788843540.380481:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134425472:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788843540.380578:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843540.380949:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134425472 00000100:00100000:2.0:1788843540.380959:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134425472 00000100:00100000:2.0:1788843540.381027:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788843540.381038:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134425472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788843540.381073:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788843540.381164:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134425472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843540.381173:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788843540.381368:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134425472:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788843540.382271:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134425600:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788843540.382347:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843540.382507:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134425600 00000100:00100000:1.0:1788843540.382516:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134425600 00000100:00100000:1.0:1788843540.382571:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788843540.382581:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134425600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788843540.382649:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788843540.382711:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134425600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843540.382728:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788843540.382903:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134425600:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788843540.635076:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843541.662067:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843542.684636:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843543.706625:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843543.962837:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141aea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134425856:0@lo:400:kworker.0 00000100:00100000:3.0:1788843543.962981:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843543.963070:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134426368:0@lo:400:kworker.0 00000100:00100000:3.0:1788843543.963098:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843543.963120:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1875738134426880:0@lo:400:kworker.0 00000100:00100000:3.0:1788843543.963317:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843543.963355:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788843543.963362:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134425984:0@lo:400:kworker.0 00000100:00100000:3.0:1788843543.963392:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843543.963414:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134426496:0@lo:400:kworker.0 00000100:00100000:3.0:1788843543.963437:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843543.963461:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134427008:0@lo:400:kworker.0 00000100:00100000:3.0:1788843543.963483:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843543.963523:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134425984 00000100:00100000:3.0:1788843543.963532:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134425984 00000100:00100000:3.0:1788843543.963601:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788843543.963611:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134425984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843543.963676:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134425984:12345-0@lo:400:kworker.0 Request processed in 65us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843543.963684:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788843543.963738:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134425984:0@lo:400:kworker.0 00000100:00100000:1.0:1788843543.963828:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141aeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134426112:0@lo:400:kworker.0 00000100:00100000:1.0:1788843543.963864:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843543.963891:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141aebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134426624:0@lo:400:kworker.0 00000100:00100000:1.0:1788843543.963916:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843543.963943:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141aeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134427136:0@lo:400:kworker.0 00000100:00100000:1.0:1788843543.963963:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843543.963991:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1788843543.963997:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134425728:0@lo:400:kworker.0 00000100:00100000:1.0:1788843543.964024:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843543.964046:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134426240:0@lo:400:kworker.0 00000100:00100000:1.0:1788843543.964068:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843543.964086:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134426752:0@lo:400:kworker.0 00000100:00100000:1.0:1788843543.964108:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843543.964127:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141aea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134427264:0@lo:400:kworker.0 00000100:00100000:1.0:1788843543.964181:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843543.964211:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134425856 00000100:00100000:1.0:1788843543.964217:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134425856 00000100:00100000:1.0:1788843543.964244:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134426368 00000100:00100000:1.0:1788843543.964247:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134426368 00000100:00100000:1.0:1788843543.964276:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134426880 00000100:00100000:1.0:1788843543.964279:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134426880 00000100:00100000:1.0:1788843543.964307:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134426496 00000100:00100000:1.0:1788843543.964310:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134426496 00000100:00100000:1.0:1788843543.964323:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134427008 00000100:00100000:1.0:1788843543.964325:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134427008 00000100:00100000:1.0:1788843543.964338:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134426112 00000100:00100000:1.0:1788843543.964340:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134426112 00000100:00100000:0.0:1788843543.964351:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788843543.964505:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134426624 00000100:00100000:3.0:1788843543.964510:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134426624 00000100:00100000:3.0:1788843543.964533:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134427136 00000100:00100000:3.0:1788843543.964536:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134427136 00000100:00100000:3.0:1788843543.964548:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134426752 00000100:00100000:3.0:1788843543.964550:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134426752 00000100:00100000:3.0:1788843543.964572:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134427264 00000100:00100000:3.0:1788843543.964575:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134427264 00000100:00100000:3.0:1788843543.964591:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788843543.964598:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134426624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843543.964648:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134426624:12345-0@lo:400:kworker.0 Request processed in 49us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843543.964654:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788843543.964669:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788843543.964676:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12036ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134427136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843543.964703:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12036ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134427136:12345-0@lo:400:kworker.0 Request processed in 28us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843543.964708:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788843543.964729:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788843543.964736:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fda9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134426752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843543.964764:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fda9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134426752:12345-0@lo:400:kworker.0 Request processed in 30us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843543.964770:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788843543.964977:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788843543.964985:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12036aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134427264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843543.965016:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12036aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134427264:12345-0@lo:400:kworker.0 Request processed in 32us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843543.965022:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788843543.967388:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134425856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843543.967537:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134425856:12345-0@lo:400:kworker.0 Request processed in 3176us (4554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843543.967656:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788843543.967675:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134426368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843543.967720:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134426368:12345-0@lo:400:kworker.0 Request processed in 55us (4620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843543.967728:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788843543.967752:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788843543.967760:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875738134426880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843543.967792:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875738134426880:12345-0@lo:400:kworker.0 Request processed in 34us (4476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843543.967800:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788843543.967812:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788843543.967820:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134426496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843543.970435:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134426496:12345-0@lo:400:kworker.0 Request processed in 2599us (6979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843543.970455:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788843543.970511:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788843543.970530:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134427008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843543.970621:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134427008:12345-0@lo:400:kworker.0 Request processed in 102us (7137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843543.970628:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788843543.970643:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788843543.970674:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12036a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134426112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843543.970713:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12036a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134426112:12345-0@lo:400:kworker.0 Request processed in 41us (6848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843543.970719:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788843543.970774:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134425728 00000100:00100000:1.0:1788843543.970786:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134425728 00000100:00100000:1.0:1788843543.970854:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1788843543.970862:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3632:x1875738134425728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843543.972927:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3632:x1875738134425728:12345-0@lo:400:kworker.0 Request processed in 2054us (8889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843543.972947:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1788843543.973068:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134426240 00000100:00100000:1.0:1788843543.973079:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134426240 00000100:00100000:1.0:1788843543.973167:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788843543.973177:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12036b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134426240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843543.973254:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12036b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134426240:12345-0@lo:400:kworker.0 Request processed in 79us (9185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843543.973260:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:1.0:1788843543.973287:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788843543.973293:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788843543.973297:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788843543.973300:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843543.973351:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134425728:0@lo:400:kworker.0 00000100:00100000:1.0:1788843543.973367:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134426240:0@lo:400:kworker.0 00010000:00080000:1.0:1788843543.973382:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141ae9c00 x1875738134426752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843543.973417:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134426752:0@lo:400:kworker.0 00010000:00080000:1.0:1788843543.973431:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141aea300 x1875738134427264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843543.973439:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141aea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134427264:0@lo:400:kworker.0 00000100:00100000:1.0:1788843543.973451:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141aeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134426112:0@lo:400:kworker.0 00010000:00080000:1.0:1788843543.973463:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141aebb80 x1875738134426624/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843543.973472:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141aebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134426624:0@lo:400:kworker.0 00010000:00080000:1.0:1788843543.973485:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141aeb100 x1875738134427136/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843543.973494:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141aeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134427136:0@lo:400:kworker.0 00000100:00100000:1.0:1788843543.973593:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788843543.973610:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134427392:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788843543.973650:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788843543.973681:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141ae8000 x1875738134426496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843543.973694:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134426496:0@lo:400:kworker.0 00000100:00100000:1.0:1788843543.973705:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134427392 00010000:00080000:2.0:1788843543.973707:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141ae8700 x1875738134427008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843543.973709:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134427392 00000100:00100000:2.0:1788843543.973715:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134427008:0@lo:400:kworker.0 00000100:00100000:2.0:1788843543.973729:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141aea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134425856:0@lo:400:kworker.0 00000100:00100000:1.0:1788843543.973739:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788843543.973741:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134426368:0@lo:400:kworker.0 00000100:00100000:1.0:1788843543.973745:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120369880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134427392:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788843543.973753:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1875738134426880:0@lo:400:kworker.0 00002000:00000024:1.0:1788843543.973771:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788843543.973808:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120369880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134427392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843543.973814:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:2.0:1788843543.973826:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141b69c00 x1875738134427392/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843559 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843543.973842:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134427392:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788843543.973985:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788843544.475483:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134427520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788843544.475590:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843544.476583:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134427520 00000100:00100000:0.0:1788843544.476609:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134427520 00000100:00100000:0.0:1788843544.476684:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788843544.476696:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134427520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788843544.476741:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843544.476821:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134427520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843544.476829:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788843544.477989:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134427648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788843544.478073:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788843544.478206:0:9761:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 322531063674ns, next at 323531060204ns, rc = 0 00000100:00100000:0.0:1788843544.478343:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134427648 00000100:00100000:0.0:1788843544.478353:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134427648 00000100:00100000:0.0:1788843544.478411:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788843544.478422:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134427648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788843544.478450:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843544.478512:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134427648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843544.478519:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788843544.478981:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134427776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843544.479029:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788843544.479186:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141b69c00 x1875738134427520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843560 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843544.479210:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134427520:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1788843544.484222:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007ba3b80 x1875738134427648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843560 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843544.484267:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134427648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843544.484552:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134427776 00000100:00100000:3.0:1788843544.484573:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134427776 00000100:00100000:3.0:1788843544.484687:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788843544.484699:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134427776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788843544.484732:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843544.484849:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134427776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (5818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843544.484858:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:1.0:1788843544.484923:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007ba1c00 x1875738134427776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843560 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843544.484941:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134427776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788843544.495415:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843544.495461:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843544.495485:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843544.495513:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843544.495532:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843544.495556:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843544.495610:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116515968 00000100:00100000:2.0:1788843544.495622:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116515968 00000100:00100000:2.0:1788843544.495694:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 92 00000100:00100000:2.0:1788843544.495705:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116515968:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843544.495799:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116515968:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 95us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843544.495807:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 92 00000100:00100000:2.0:1788843544.495835:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116515584 00000100:00100000:2.0:1788843544.495839:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116515584 00000100:00100000:2.0:1788843544.495869:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 339 00000100:00100000:2.0:1788843544.495876:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+13:2387:x1875738116515584:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843544.495904:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+13:2387:x1875738116515584:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 29us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843544.495911:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 339 00000100:00100000:2.0:1788843544.495944:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116515712 00000100:00100000:2.0:1788843544.495948:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116515712 00000100:00100000:2.0:1788843544.495980:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116516224 00000100:00100000:2.0:1788843544.495996:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116516224 00000100:00100000:2.0:1788843544.496015:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116515840 00000100:00100000:2.0:1788843544.496017:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116515840 00000100:00100000:2.0:1788843544.496030:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116516096 00000100:00100000:3.0:1788843544.496206:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 221 00000100:00100000:3.0:1788843544.496217:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+18:2387:x1875738116515712:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843544.496334:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+18:2387:x1875738116515712:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 120us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843544.496353:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 221 00000100:00100000:3.0:1788843544.496370:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 222 00000100:00100000:3.0:1788843544.496376:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2387:x1875738116516224:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843544.496403:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2387:x1875738116516224:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 27us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843544.496410:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 222 00000100:00100000:3.0:1788843544.496421:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 223 00000100:00100000:3.0:1788843544.496427:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116515840:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843544.496451:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116515840:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 24us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843544.496457:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 223 00000100:00080000:1.0:1788843544.498423:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788843544.498437:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788843544.498442:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788843544.499204:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116516096 00000100:00100000:2.0:1788843544.499303:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 224 00000100:00100000:2.0:1788843544.499315:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2387:x1875738116516096:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843544.499417:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2387:x1875738116516096:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 104us (3859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843544.499426:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 224 00000100:00080000:1.0:1788843544.500936:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788843544.731572:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788843544.876438:0:13671:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:0.0:1788843545.510189:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788843545.510221:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134427904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788843545.510314:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843545.510399:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134427904 00000100:00100000:0.0:1788843545.510409:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134427904 00000100:00100000:0.0:1788843545.510469:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788843545.510480:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134427904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788843545.510524:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788843545.510591:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134427904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843545.510599:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788843545.510668:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134427904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788843545.511309:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134428032:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788843545.511357:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843545.511467:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134428032 00000100:00100000:1.0:1788843545.511475:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134428032 00000100:00100000:1.0:1788843545.511543:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788843545.511560:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134428032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788843545.511590:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788843545.511656:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134428032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843545.511663:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788843545.511725:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134428032:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788843545.757104:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788843546.026055:0:6485:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1788843546.026114:0:6485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:3.0:1788843546.026130:0:6485:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788843546.026381:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788843546.026411:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134428160:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788843546.026515:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843546.026627:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134428160 00000100:00100000:1.0:1788843546.026637:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134428160 00000100:00100000:1.0:1788843546.026734:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788843546.026747:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134428160:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788843546.026783:0:8423:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:1.0:1788843546.026829:0:8423:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9f9613, atime: 0x6a9f9613, ctime: 0x6a9f9613, blocks: 0x0 00010000:00010000:1.0:1788843546.026839:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000264e066/0xa762dfcbd58d12c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843546.026860:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=324s v=(0 0) 00010000:00010000:1.0:1788843546.026866:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843546.026875:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000264e066/0xa762dfcbd58d12c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843546.026897:0:8423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000264e066/0xa762dfcbd58d12c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843546.026909:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000264e066/0xa762dfcbd58d12c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843546.026918:0:8423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000264e066/0xa762dfcbd58d12c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843546.026939:0:8423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788843546.027134:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3633:x1875738134428160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 389us (619us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788843546.027182:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788843546.027208:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788843546.027224:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843546.027238:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000264e066/0xa762dfcbd58d12c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843546.027246:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1420e5200 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843546.027252:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000264e066/0xa762dfcbd58d12c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843546.027262:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000264e066/0xa762dfcbd58d12c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843546.027283:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000264e066/0xa762dfcbd58d12c1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843546.027291:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000264e066/0xa762dfcbd58d12c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843546.027317:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843546.027319:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843546.027321:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788843546.027362:0:3633:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd120368e00/2, rc 0, transno 4294967301 00000100:00100000:1.0:1788843546.027369:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134428160:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788843546.027618:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1219 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843546.027629:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1219 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843546.027636:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1219 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843546.027641:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843546.027646:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1219 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843546.027653:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1219 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843546.027669:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd52ae8b4 (ffff9bd00658a300) 00010000:00010000:2.0:1788843546.027672:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843546.027686:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1219 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843546.027693:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1219 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843546.027711:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35400/0xa762dfcbd58d122e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843546.027719:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35400/0xa762dfcbd58d122e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843546.027725:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35400/0xa762dfcbd58d122e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843546.027731:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb35400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843546.027734:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35400/0xa762dfcbd58d122e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843546.027741:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35400/0xa762dfcbd58d122e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843546.027751:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9bd00746cc00) 00010000:00010000:2.0:1788843546.027754:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843546.027757:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35400/0xa762dfcbd58d122e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843546.027762:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35400/0xa762dfcbd58d122e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843546.027779:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d1297 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843546.027785:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d1297 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843546.027797:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d1297 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843546.027802:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb35800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843546.027805:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d1297 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843546.027811:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d1297 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843546.027819:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd52ae8b4 (ffff9bd00658a300) 00010000:00010000:2.0:1788843546.027821:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843546.027823:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d1297 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843546.027829:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d1297 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd52ae8b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843546.027845:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030e00/0xa762dfcbd58d12b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843546.027851:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030e00/0xa762dfcbd58d12b3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843546.027856:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030e00/0xa762dfcbd58d12b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843546.027860:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd100030e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843546.027862:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030e00/0xa762dfcbd58d12b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843546.027877:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030e00/0xa762dfcbd58d12b3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843546.027885:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bd00658a400) 00010000:00010000:2.0:1788843546.027888:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843546.027891:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030e00/0xa762dfcbd58d12b3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843546.027897:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030e00/0xa762dfcbd58d12b3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788843546.201048:0:13719:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdc67603e0 20000000:00000080:1.0:1788843546.201072:0:13719:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bd141b6c000 uarg=0000000000000000 20000000:01000000:1.0:1788843546.201130:0:13719:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788843546.201193:0:13719:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788843546.201200:0:13719:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1788843546.203008:0:13720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1788843546.203314:0:13719:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1788843546.209575:0:13719:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1788843546.209624:0:13719:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1788843546.209674:0:13719:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1788843546.209700:0:13719:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788843546.209725:0:13719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d12c8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843546.209826:0:13719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd13fb34600/0xa762dfcbd58d114e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249084e expref: 12 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843546.209837:0:13719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d1155 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490855 expref: 12 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843546.209846:0:13719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd13fb34a00/0xa762dfcbd58d1163 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d115c expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843546.209853:0:13719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd13fb34800/0xa762dfcbd58d1171 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d116a expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843546.209860:0:13719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d117f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d1178 expref: 23 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843546.209868:0:13719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd007947800/0xa762dfcbd58d118d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d1186 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843546.209876:0:13719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d12c8 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843546.209930:0:13719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd007947800/0xa762dfcbd58d118d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d1186 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843546.209947:0:13719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd007947800/0xa762dfcbd58d118d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d1186 expref: 23 pid: 6500 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843546.209972:0:13719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13719:1875738134428288:0@lo:104: 00000100:00100000:1.0:1788843546.210195:0:13719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788843546.210265:0:13719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d117f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d1178 expref: 23 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843546.210275:0:13719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d117f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d1178 expref: 23 pid: 6498 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843546.210285:0:13719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13719:1875738134428416:0@lo:104: 00000100:00100000:0.0:1788843546.210309:0:6490:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1788843546.210313:0:13719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd13fb34800/0xa762dfcbd58d1171 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d116a expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843546.210321:0:13719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd13fb34800/0xa762dfcbd58d1171 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d116a expref: 23 pid: 6501 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843546.210329:0:13719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd12036ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13719:1875738134428544:0@lo:104: 00000100:00100000:0.0:1788843546.210340:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843546.210369:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134428288 00000100:00100000:0.0:1788843546.210378:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134428288 00000100:00100000:0.0:1788843546.210426:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134428416 00000100:00100000:0.0:1788843546.210429:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134428416 00000100:00100000:0.0:1788843546.210445:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788843546.210454:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007257450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+4:13719:x1875738134428288:12345-0@lo:104: 00010000:00010000:0.0:1788843546.210468:0:6490:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35a00/0xa762dfcbd58d1186 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d118d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843546.210525:0:6490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788843546.210530:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007257450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+4:13719:x1875738134428288:12345-0@lo:104: Request processed in 77us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843546.210537:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788843546.210596:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788843546.210602:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+3:13719:x1875738134428416:12345-0@lo:104: 00010000:00010000:0.0:1788843546.210610:0:6490:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d1178 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d117f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843546.210642:0:6490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788843546.210646:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e79d9884-ba2e-42e7-accb-b4784b9c1837+3:13719:x1875738134428416:12345-0@lo:104: Request processed in 45us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843546.210652:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:0.0:1788843546.210668:0:6495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788843546.210675:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35a00/0xa762dfcbd58d1186 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d118d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843546.210691:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb35a00 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:0.0:1788843546.210697:0:6495:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35a00/0xa762dfcbd58d1186 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d118d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843546.210707:0:6495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35a00/0xa762dfcbd58d1186 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d118d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843546.210715:0:6495:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35a00/0xa762dfcbd58d1186 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d118d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843546.210721:0:6495:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1788843546.210728:0:13719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788843546.210759:0:6495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35a00/0xa762dfcbd58d1186 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d118d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843546.210767:0:6495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843546.210792:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35a00/0xa762dfcbd58d1186 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d118d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843546.210799:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35a00/0xa762dfcbd58d1186 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d118d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843546.210812:0:6495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843546.210816:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d1178 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d117f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843546.210822:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb34200 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:0.0:1788843546.210825:0:6495:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d1178 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d117f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843546.210827:0:13719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd13fb34a00/0xa762dfcbd58d1163 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d115c expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843546.210837:0:13719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd13fb34a00/0xa762dfcbd58d1163 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d115c expref: 23 pid: 6501 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843546.210843:0:6495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d1178 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d117f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843546.210846:0:13719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe20380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13719:1875738134428800:0@lo:104: 10000000:00010000:0.0:1788843546.210850:0:6495:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d1178 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d117f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843546.210856:0:6495:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1788843546.210869:0:13719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788843546.210869:0:6495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d1178 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d117f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843546.210875:0:6495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788843546.210887:0:13719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d1155 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490855 expref: 12 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843546.210893:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d1178 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d117f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843546.210901:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd13fb34200/0xa762dfcbd58d1178 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d117f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843546.210909:0:13719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d1155 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490855 expref: 12 pid: 6500 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843546.210910:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843546.210912:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843546.210914:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843546.210921:0:13719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe22300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13719:1875738134429056:192.168.203.33@tcp:104: 00010000:00010000:0.0:1788843546.210921:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843546.210933:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134428672:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788843546.210982:0:13719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd13fb34600/0xa762dfcbd58d114e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249084e expref: 12 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843546.210985:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134428544 00000100:00100000:2.0:1788843546.210990:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134428544 00010000:00010000:1.0:1788843546.210991:0:13719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd13fb34600/0xa762dfcbd58d114e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249084e expref: 12 pid: 6498 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843546.210999:0:13719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe20e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13719:1875738134429184:192.168.203.33@tcp:104: 00000100:00100000:2.0:1788843546.211008:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134428800 00000100:00100000:2.0:1788843546.211011:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134428800 00000100:00100000:2.0:1788843546.211022:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788843546.211029:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120369c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+4:13719:x1875738134428544:12345-0@lo:104: 00010000:00010000:2.0:1788843546.211039:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd007946e00/0xa762dfcbd58d116a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d1171 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843546.211089:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843546.211128:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134428928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788843546.211180:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843546.211211:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134428672 00000100:00100000:0.0:1788843546.211227:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134428672 00010000:00010000:0.0:1788843546.211246:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd007947800/0xa762dfcbd58d118d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d1186 expref: 24 pid: 6500 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843546.211275:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134428928 00000100:00100000:0.0:1788843546.211278:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134428928 00010000:00010000:0.0:1788843546.211289:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d117f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d1178 expref: 25 pid: 6498 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843546.211306:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788843546.211312:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e79d9884-ba2e-42e7-accb-b4784b9c1837+25:3633:x1875738134428672:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843546.211318:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00010000:00010000:0.0:1788843546.211324:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788843546.211326:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007aca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+25:3630:x1875738134428928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788843546.211329:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd007947800/0xa762dfcbd58d118d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d1186 expref: 25 pid: 6500 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843546.211342:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd007947800/0xa762dfcbd58d118d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d1186 expref: 25 pid: 6500 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843546.211362:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843546.211390:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e79d9884-ba2e-42e7-accb-b4784b9c1837+25:3633:x1875738134428672:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843546.211397:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788843546.211411:0:13719:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0077bbf00 going to sleep for 11 seconds 00010000:00010000:3.0:1788843546.211435:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788843546.211436:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134428672:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788843546.211440:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d117f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d1178 expref: 24 pid: 6498 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843546.211448:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d117f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d1178 expref: 24 pid: 6498 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843546.211458:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788843546.211499:0:13719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd007947800/0xa762dfcbd58d118d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d1186 expref: 24 pid: 6500 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843546.211511:0:13719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13719:1875738134428288:0@lo:104: 00010000:00010000:1.0:1788843546.211521:0:13719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d117f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d1178 expref: 23 pid: 6498 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843546.211529:0:13719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13719:1875738134428416:0@lo:104: 00000100:00100000:3.0:1788843546.211605:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007aca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:3630:x1875738134428928:12345-0@lo:103:ldlm_bl.0 Request processed in 279us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843546.211683:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788843546.211782:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134428928:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788843546.212988:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788843546.213003:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120369c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+4:13719:x1875738134428544:12345-0@lo:104: Request processed in 1971us (2270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843546.213014:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788843546.213105:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788843546.213117:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+3:13719:x1875738134428800:12345-0@lo:104: 00010000:00010000:0.0:1788843546.213199:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3cc00/0xa762dfcbd58d115c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d1163 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843546.213425:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788843546.213432:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+3:13719:x1875738134428800:12345-0@lo:104: Request processed in 319us (2562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843546.213438:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:2.0:1788843546.213476:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788843546.213486:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd007946e00/0xa762dfcbd58d116a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d1171 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843546.213494:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946e00 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:2.0:1788843546.213500:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd007946e00/0xa762dfcbd58d116a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d1171 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843546.213576:0:13719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd12036ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13719:1875738134428544:0@lo:104: 00000100:00100000:1.0:1788843546.213587:0:13719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe20380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13719:1875738134428800:0@lo:104: 00010000:00010000:3.0:1788843546.213690:0:10329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843546.213832:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3cc00/0xa762dfcbd58d115c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d1163 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843546.213895:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd007946e00/0xa762dfcbd58d116a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d1171 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843546.217626:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3cc00 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:3.0:1788843546.217643:0:10329:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3cc00/0xa762dfcbd58d115c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d1163 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843546.217665:0:10329:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3cc00/0xa762dfcbd58d115c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d1163 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843546.217675:0:10329:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3cc00/0xa762dfcbd58d115c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d1163 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843546.217682:0:10329:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788843546.217898:0:10329:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3cc00/0xa762dfcbd58d115c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d1163 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843546.217906:0:10329:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843546.217947:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3cc00/0xa762dfcbd58d115c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d1163 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843546.217955:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3cc00/0xa762dfcbd58d115c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d1163 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843546.217970:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843546.217972:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843546.217975:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843546.218131:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134429312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788843546.218282:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843546.218367:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134429312 00000100:00100000:0.0:1788843546.218379:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134429312 00010000:00010000:1.0:1788843546.218472:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd13fb34a00/0xa762dfcbd58d1163 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d115c expref: 22 pid: 6501 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843546.218515:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788843546.218534:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:3631:x1875738134429312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788843546.218562:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843546.218569:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd13fb34a00/0xa762dfcbd58d1163 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d115c expref: 22 pid: 6501 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843546.218581:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd13fb34a00/0xa762dfcbd58d1163 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d115c expref: 22 pid: 6501 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843546.218600:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd13fb34a00/0xa762dfcbd58d1163 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d115c expref: 22 pid: 6501 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843546.218617:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843546.218666:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:3631:x1875738134429312:12345-0@lo:103:ldlm_bl.0 Request processed in 134us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843546.218673:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788843546.218852:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134429312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788843546.219073:0:13719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe22300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13719:1875738134429056:192.168.203.33@tcp:104: 00000100:00100000:1.0:1788843546.219302:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843546.219402:0:13719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe20e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13719:1875738134429184:192.168.203.33@tcp:104: 00010000:00010000:0.0:1788843546.219502:0:13719:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d12c8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843546.219942:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116516352 00000100:00100000:3.0:1788843546.219950:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116516352 10000000:00010000:2.0:1788843546.220010:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd007946e00/0xa762dfcbd58d116a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d1171 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843546.220022:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788843546.220111:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d1155 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490855 expref: 13 pid: 6500 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843546.220165:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 49 00000100:00100000:3.0:1788843546.220175:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7928f422-fe0e-4906-b099-11067616e1bb+13:2390:x1875738116516352:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843546.220189:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843546.220195:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d1155 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490855 expref: 13 pid: 6500 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843546.220204:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d1155 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490855 expref: 13 pid: 6500 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843546.220220:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d1155 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490855 expref: 13 pid: 6500 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843546.220235:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843546.220294:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7928f422-fe0e-4906-b099-11067616e1bb+12:2390:x1875738116516352:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 121us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843546.220302:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 49 00000100:00100000:1.0:1788843546.220570:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843546.220625:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116516480 00000100:00100000:3.0:1788843546.220630:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116516480 00010000:00010000:3.0:1788843546.220648:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd13fb34600/0xa762dfcbd58d114e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249084e expref: 12 pid: 6498 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843546.220670:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 50 00010000:00010000:0.0:1788843546.220671:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd007946e00/0xa762dfcbd58d116a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d1171 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843546.220676:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7928f422-fe0e-4906-b099-11067616e1bb+12:2390:x1875738116516480:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843546.220680:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843546.220685:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843546.220700:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd13fb34600/0xa762dfcbd58d114e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249084e expref: 12 pid: 6498 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843546.220703:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd007946e00/0xa762dfcbd58d116a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d1171 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843546.220709:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd13fb34600/0xa762dfcbd58d114e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249084e expref: 12 pid: 6498 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843546.220711:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd007946e00/0xa762dfcbd58d116a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d1171 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843546.220721:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd13fb34600/0xa762dfcbd58d114e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249084e expref: 12 pid: 6498 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843546.220731:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788843546.220731:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843546.220733:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843546.220736:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843546.220756:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd12036ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134429440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843546.220844:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7928f422-fe0e-4906-b099-11067616e1bb+11:2390:x1875738116516480:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 166us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843546.220852:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 50 00000100:00100000:1.0:1788843546.224492:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843546.224632:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134429440 00000100:00100000:3.0:1788843546.224644:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134429440 00010000:00010000:3.0:1788843546.224692:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd13fb34800/0xa762dfcbd58d1171 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d116a expref: 21 pid: 6501 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843546.224739:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788843546.224819:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:3632:x1875738134429440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788843546.224840:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843546.224847:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd13fb34800/0xa762dfcbd58d1171 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d116a expref: 21 pid: 6501 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843546.224862:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd13fb34800/0xa762dfcbd58d1171 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d116a expref: 21 pid: 6501 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843546.224885:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd13fb34800/0xa762dfcbd58d1171 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d116a expref: 21 pid: 6501 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843546.224926:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d12c8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843546.224935:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d12c8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843546.224956:0:6491:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d12c8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843546.224963:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d12c8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843546.224971:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d12c8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843546.224978:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d12c8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843546.224984:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1420e5200 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:3.0:1788843546.224990:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d12c8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843546.224998:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d12c8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843546.225350:0:13719:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d12c8 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843546.225361:0:13719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d12c8 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843546.227970:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d12c8 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843546.227994:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d12c8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843546.228104:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843546.228443:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:3632:x1875738134429440:12345-0@lo:103:ldlm_bl.0 Request processed in 3689us (3955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843546.228456:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788843546.228681:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd12036ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134429440:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788843546.779283:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788843547.065768:0:13768:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef13254f0 20000000:00000080:3.0:1788843547.065786:0:13768:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bd00793ec00 uarg=0000000000000000 20000000:01000000:3.0:1788843547.065830:0:13768:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1788843547.065838:0:13768:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1788843547.065843:0:13768:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1788843547.066599:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1788843547.066747:0:13768:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1788843547.066815:0:13768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1788843547.066844:0:13768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1788843547.066858:0:13768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1788843547.066869:0:13768:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788843547.066887:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd10f7afe00/0xa762dfcbd58d12cf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843547.066904:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd10f7afe00/0xa762dfcbd58d12cf lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843547.066914:0:13768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd10f7afe00/0xa762dfcbd58d12cf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843547.066922:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd10f7afe00/0xa762dfcbd58d12cf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843547.066930:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd10f7afe00/0xa762dfcbd58d12cf lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843547.066938:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd10f7afe00/0xa762dfcbd58d12cf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843547.066945:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7afe00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:3.0:1788843547.066957:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd10f7afe00/0xa762dfcbd58d12cf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843547.066966:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd10f7afe00/0xa762dfcbd58d12cf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843547.066979:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd10f7afe00/0xa762dfcbd58d12cf lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843547.066987:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd10f7afe00/0xa762dfcbd58d12cf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843547.066994:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd10f7afe00/0xa762dfcbd58d12cf lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843547.802526:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788843547.930295:0:6503:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788843547.930302:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd006461000 from 7 10000000:01000000:1.0:1788843547.930308:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788843547.930358:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5200/0xa762dfcbd58d12d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843547.930370:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5200/0xa762dfcbd58d12d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843547.930396:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5200/0xa762dfcbd58d12d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843547.930422:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe21c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134429568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788843547.930505:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843547.930769:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12e0039c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843547.930866:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134429568 00000100:00100000:2.0:1788843547.930875:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134429568 00000100:00100000:2.0:1788843547.930922:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1788843547.930931:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:6503:x1875738134429568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843547.930943:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843547.930957:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d12dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d12d6 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843547.930981:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d12dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d12d6 expref: 21 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843547.931003:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d12dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d12d6 expref: 21 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843547.931014:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd100030e00, rc 0) 00000100:00100000:2.0:1788843547.931059:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:6503:x1875738134429568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843547.931067:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1788843547.933658:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe21c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134429568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843547.933688:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5200/0xa762dfcbd58d12d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d12dd expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843547.933701:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5200/0xa762dfcbd58d12d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d12dd expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843547.933783:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe21c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134429696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788843547.933835:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843547.939269:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12e0039c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843547.942696:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134429696 00000100:00100000:2.0:1788843547.942710:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134429696 00000100:00100000:2.0:1788843547.942854:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788843547.942865:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:6503:x1875738134429696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843547.943990:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:6503:x1875738134429696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1122us (10149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843547.944001:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1788843547.944275:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe21c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134429696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788843547.944332:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe21c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134429824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788843547.944385:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843547.944461:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12e0039c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843547.944500:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134429824 00000100:00100000:2.0:1788843547.944506:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134429824 00000100:00100000:2.0:1788843547.944588:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1788843547.944597:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:6503:x1875738134429824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843547.944929:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:6503:x1875738134429824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 333us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843547.944938:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1788843547.947005:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe21c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134429824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788843547.949256:0:13781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe23800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:13781:1875738134429952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843547.949344:0:13781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843547.949389:0:13781:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12e003f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788843547.949621:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134429952 00000100:00100000:2.0:1788843547.949629:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134429952 00000100:00100000:2.0:1788843547.949678:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1788843547.949688:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:13781:x1875738134429952:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843547.950002:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:13781:x1875738134429952:12345-0@lo:502:llog_process_th.0 Request processed in 315us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843547.950010:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788843547.950487:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843547.950609:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116516608 00000100:00100000:2.0:1788843547.950615:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116516608 00000100:00100000:2.0:1788843547.950658:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 344 00000100:00100000:2.0:1788843547.950666:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+11:6164:x1875738116516608:12345-192.168.203.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843547.950678:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843547.950696:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd100031600/0xa762dfcbd58d12e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf24d95f224908a2 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843547.950721:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd100031600/0xa762dfcbd58d12e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908a2 expref: 12 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843547.950886:0:13781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe23800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:13781:1875738134429952:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788843547.950921:0:13781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843547.950931:0:13781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843547.950933:0:13781:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788843547.950941:0:13781:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd006461000 00000020:00000080:0.0:1788843547.950944:0:13781:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788843547.951000:0:13781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843547.951319:0:13781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843547.951328:0:13781:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788843547.951337:0:13781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843547.951341:0:13781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843547.951343:0:13781:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788843547.951348:0:13781:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd006461000 00000020:00000080:1.0:1788843547.951351:0:13781:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788843547.951413:0:13781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe23100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:13781:1875738134430080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843547.951470:0:13781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843547.951501:0:13781:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12e003840 going to sleep for 11 seconds 00010000:00010000:2.0:1788843547.951595:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd100031600/0xa762dfcbd58d12e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908a2 expref: 12 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843547.951607:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd100031600, rc 0) 00000100:00100000:2.0:1788843547.951660:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+12:6164:x1875738116516608:12345-192.168.203.33@tcp:101:ll_cfg_requeue.0 Request processed in 994us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843547.951667:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 344 00000100:00100000:2.0:1788843547.951692:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134430080 00000100:00100000:2.0:1788843547.951697:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134430080 00000100:00100000:2.0:1788843547.951719:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1788843547.951726:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:13781:x1875738134430080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843547.951838:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:13781:x1875738134430080:12345-0@lo:502:llog_process_th.0 Request processed in 112us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843547.951845:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1788843547.952277:0:13781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe23100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:13781:1875738134430080:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788843547.952302:0:13781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843547.952307:0:13781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843547.952309:0:13781:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788843547.952316:0:13781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788843547.952549:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788843547.952572:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788843547.952581:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5200/0xa762dfcbd58d12d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d12dd expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843547.952591:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5200/0xa762dfcbd58d12d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d12dd expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843547.952600:0:6503:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788843547.952603:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd10c0f0000 from 7 10000000:01000000:3.0:1788843547.952606:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788843547.952631:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d12eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843547.952639:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d12eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843547.952656:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d12eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843547.952672:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134430208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788843547.952709:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843547.952752:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00749b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788843547.952896:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134430208 00000100:00100000:1.0:1788843547.952902:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134430208 00000100:00100000:1.0:1788843547.952936:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788843547.952943:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:6503:x1875738134430208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843547.952952:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843547.952962:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd13fb34600/0xa762dfcbd58d12f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d12eb expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843547.952981:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd13fb34600/0xa762dfcbd58d12f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d12eb expref: 22 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843547.952991:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd13fb34600/0xa762dfcbd58d12f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d12eb expref: 22 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843547.952998:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fb34600, rc 0) 00000100:00100000:1.0:1788843547.953045:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:6503:x1875738134430208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843547.953052:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1788843547.953672:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134430208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843547.953689:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d12eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d12f2 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843547.953698:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d12eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d12f2 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843547.953776:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134430336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843547.953814:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843547.953849:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00749b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788843547.953977:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134430336 00000100:00100000:2.0:1788843547.953983:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134430336 00000100:00100000:2.0:1788843547.954025:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1788843547.954034:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:6503:x1875738134430336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843547.954174:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:6503:x1875738134430336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843547.954180:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1788843547.954418:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134430336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843547.954450:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134430464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843547.954489:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843547.954510:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1116c1240 going to sleep for 11 seconds 00000100:00100000:2.0:1788843547.954606:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134430464 00000100:00100000:2.0:1788843547.954610:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134430464 00000100:00100000:2.0:1788843547.954643:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1788843547.954651:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:6503:x1875738134430464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843547.954825:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134430464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843547.954994:0:13783:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:13783:1875738134430592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843547.955226:0:13783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843547.955250:0:13783:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1116c1180 going to sleep for 11 seconds 00000100:00100000:2.0:1788843547.955303:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:6503:x1875738134430464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843547.955312:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1788843547.955342:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134430592 00000100:00100000:2.0:1788843547.955346:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134430592 00000100:00100000:2.0:1788843547.955379:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1788843547.955387:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:13783:x1875738134430592:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843547.955466:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:13783:x1875738134430592:12345-0@lo:502:llog_process_th.0 Request processed in 81us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843547.955473:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788843547.955571:0:13783:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:13783:1875738134430592:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788843547.955593:0:13783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843547.955608:0:13783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843547.955611:0:13783:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788843547.955619:0:13783:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd10c0f0000 00000020:00000080:0.0:1788843547.955621:0:13783:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788843547.955671:0:13783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843547.955676:0:13783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843547.955677:0:13783:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788843547.955680:0:13783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843547.955683:0:13783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843547.955685:0:13783:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788843547.955689:0:13783:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd10c0f0000 00000020:00000080:0.0:1788843547.955692:0:13783:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788843547.955880:0:13783:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:13783:1875738134430720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843547.955927:0:13783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843547.955951:0:13783:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1116c1180 going to sleep for 11 seconds 00000100:00100000:2.0:1788843547.956339:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134430720 00000100:00100000:2.0:1788843547.956344:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134430720 00000100:00100000:2.0:1788843547.956384:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1788843547.956392:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:13783:x1875738134430720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843547.956474:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:13783:x1875738134430720:12345-0@lo:502:llog_process_th.0 Request processed in 83us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843547.956481:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788843547.956618:0:13783:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:13783:1875738134430720:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788843547.956640:0:13783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843547.956646:0:13783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843547.956648:0:13783:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788843547.956652:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788843547.956786:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788843547.956807:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788843547.956817:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d12eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d12f2 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843547.956828:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d12eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d12f2 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843547.956839:0:6503:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788843547.956842:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd12e2b3800 from 7 10000000:01000000:2.0:1788843547.956850:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788843547.956875:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd100030a00/0xa762dfcbd58d12f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843547.956883:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd100030a00/0xa762dfcbd58d12f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843547.956892:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd100030a00/0xa762dfcbd58d12f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843547.956907:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134430848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788843547.956936:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843547.956959:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1050cfb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788843547.961319:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134430848 00000100:00100000:1.0:1788843547.961344:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134430848 00000100:00100000:1.0:1788843547.961408:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1788843547.961419:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:6503:x1875738134430848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843547.965184:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843547.965716:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd13fb34a00/0xa762dfcbd58d1300 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d12f9 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843547.965756:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd13fb34a00/0xa762dfcbd58d1300 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d12f9 expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843547.965768:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd13fb34a00/0xa762dfcbd58d1300 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d12f9 expref: 23 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843547.965779:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fb34a00, rc 0) 00000100:00100000:1.0:1788843547.965866:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:6503:x1875738134430848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 4448us (8928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843547.965874:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1788843547.966885:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134430848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843547.966913:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd100030a00/0xa762dfcbd58d12f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d1300 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843547.966925:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd100030a00/0xa762dfcbd58d12f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d1300 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843547.967026:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134430976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843547.967074:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843547.967123:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1116c1180 going to sleep for 11 seconds 00000100:00100000:1.0:1788843547.968285:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134430976 00000100:00100000:1.0:1788843547.968297:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134430976 00000100:00100000:1.0:1788843547.968358:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1788843547.968368:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:6503:x1875738134430976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788843547.968515:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:6503:x1875738134430976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (1439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843547.968523:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788843547.968848:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134430976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843547.968890:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134431104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843547.968930:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843547.968971:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1116c1180 going to sleep for 11 seconds 00000100:00100000:3.0:1788843547.970851:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843547.970851:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134431104 00000100:00100000:1.0:1788843547.970862:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134431104 00000100:00100000:3.0:1788843547.970882:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116516736 00000100:00100000:3.0:1788843547.970887:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116516736 00000100:00100000:3.0:1788843547.970915:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788843547.970923:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:6503:x1875738134431104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788843547.971037:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:6503:x1875738134431104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (2106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843547.972255:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 354 00000100:00100000:1.0:1788843547.972273:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+12:6164:x1875738116516736:12345-192.168.203.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788843547.972398:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+12:6164:x1875738116516736:12345-192.168.203.33@tcp:501:ll_cfg_requeue.0 Request processed in 132us (1556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843547.972407:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 354 00000100:00100000:3.0:1788843547.972506:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788843547.972583:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134431104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788843547.974010:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788843547.978107:0:13786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:13786:1875738134431232:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843547.978799:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843547.978839:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116516864 00000100:00100000:2.0:1788843547.978846:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116516864 00000100:00100000:2.0:1788843547.978897:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 355 00000100:00100000:2.0:1788843547.978907:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+12:6164:x1875738116516864:12345-192.168.203.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843547.979039:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+12:6164:x1875738116516864:12345-192.168.203.33@tcp:503:ll_cfg_requeue.0 Request processed in 132us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843547.979047:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 355 00000100:00100000:3.0:1788843547.984772:0:13786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843547.984821:0:13786:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00749b840 going to sleep for 11 seconds 00000100:00100000:2.0:1788843547.984884:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134431232 00000100:00100000:2.0:1788843547.984893:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134431232 00000100:00100000:2.0:1788843547.985623:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1788843547.985640:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:13786:x1875738134431232:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843547.985809:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:13786:x1875738134431232:12345-0@lo:502:llog_process_th.0 Request processed in 175us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843547.985827:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788843547.985929:0:13786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:13786:1875738134431232:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788843547.985963:0:13786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843547.985972:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843547.985975:0:13786:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788843547.985986:0:13786:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd12e2b3800 00000020:00000080:1.0:1788843547.985988:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788843547.986041:0:13786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843547.986294:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843547.986297:0:13786:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788843547.986302:0:13786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843547.986306:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843547.986307:0:13786:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788843547.986310:0:13786:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd12e2b3800 00000020:00000080:1.0:1788843547.986313:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788843547.986688:0:13786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe23100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:13786:1875738134431360:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843547.986738:0:13786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843547.997814:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134431360 00000100:00100000:3.0:1788843547.997829:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134431360 00000100:00100000:3.0:1788843547.997892:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1788843547.997903:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:13786:x1875738134431360:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843547.998060:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:13786:x1875738134431360:12345-0@lo:502:llog_process_th.0 Request processed in 157us (11319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843547.998067:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1788843547.998235:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843547.998261:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116516992 00000100:00100000:3.0:1788843547.998265:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116516992 00000100:00100000:3.0:1788843547.998286:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 358 00000100:00100000:3.0:1788843547.998293:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+12:10768:x1875738116516992:12345-192.168.203.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788843547.998369:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+12:10768:x1875738116516992:12345-192.168.203.33@tcp:502:llog_process_th.0 Request processed in 75us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843547.998376:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 358 00000100:00100000:3.0:1788843547.999883:0:13786:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1102fc900 going to sleep for 11 seconds 00000100:00100000:3.0:1788843547.999915:0:13786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe23100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:13786:1875738134431360:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788843547.999947:0:13786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843547.999954:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843547.999956:0:13786:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788843547.999960:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788843548.000029:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788843548.000053:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788843548.000070:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd100030a00/0xa762dfcbd58d12f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d1300 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843548.000081:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd100030a00/0xa762dfcbd58d12f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d1300 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843548.000092:0:6503:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788843548.000094:0:6503:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd118db4800 from 7 10000000:01000000:3.0:1788843548.000097:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788843548.000127:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af600/0xa762dfcbd58d1307 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843548.000134:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af600/0xa762dfcbd58d1307 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843548.000162:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af600/0xa762dfcbd58d1307 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843548.000182:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134431488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788843548.000228:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843548.000250:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00749b780 going to sleep for 11 seconds 00000100:00100000:3.0:1788843548.000266:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134431488 00000100:00100000:3.0:1788843548.000271:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134431488 00000100:00100000:3.0:1788843548.000302:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1788843548.000311:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:6503:x1875738134431488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843548.000323:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843548.000336:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd10f7afc00/0xa762dfcbd58d130e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d1307 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843548.000362:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd10f7afc00/0xa762dfcbd58d130e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d1307 expref: 24 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843548.000382:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd10f7afc00/0xa762dfcbd58d130e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d1307 expref: 24 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843548.000390:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10f7afc00, rc 0) 00000100:00100000:0.0:1788843548.002684:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134431488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843548.002721:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af600/0xa762dfcbd58d1307 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d130e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843548.002734:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af600/0xa762dfcbd58d1307 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d130e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843548.002818:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134431616:0@lo:501:ll_cfg_requeue.0 00000040:00080000:1.0:1788843548.004312:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788843548.006749:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843548.006809:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1116c1240 going to sleep for 11 seconds 00000100:00100000:0.0:1788843548.006846:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134431616 00000100:00100000:0.0:1788843548.006853:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134431616 00000100:00100000:0.0:1788843548.006904:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1788843548.006914:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+25:6503:x1875738134431616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843548.007126:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+25:6503:x1875738134431616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 213us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843548.007136:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1788843548.007209:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134431616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843548.007259:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134431744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843548.007314:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843548.007344:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1116c1240 going to sleep for 11 seconds 00000100:00100000:0.0:1788843548.007356:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134431744 00000100:00100000:0.0:1788843548.007359:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134431744 00000100:00100000:0.0:1788843548.007378:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1788843548.007385:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+25:6503:x1875738134431744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843548.010902:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+25:6503:x1875738134431744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3510us (3581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843548.010916:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1788843548.011246:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:6503:x1875738134431488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 10934us (11015us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843548.011255:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1788843548.013572:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e79d9884-ba2e-42e7-accb-b4784b9c1837:6503:1875738134431744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788843548.014290:0:13790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:13790:1875738134431872:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843548.014369:0:13790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843548.014402:0:13790:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00749bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788843548.014900:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134431872 00000100:00100000:0.0:1788843548.014907:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134431872 00000100:00100000:0.0:1788843548.014960:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788843548.014969:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:13790:x1875738134431872:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843548.015086:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:13790:x1875738134431872:12345-0@lo:502:llog_process_th.0 Request processed in 117us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843548.015094:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1788843548.015577:0:13790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:13790:1875738134431872:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788843548.015605:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788843548.015615:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843548.015617:0:13790:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788843548.015623:0:13790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd118db4800 00000020:00000080:3.0:1788843548.015625:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788843548.015684:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843548.015687:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843548.015688:0:13790:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788843548.015690:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788843548.015692:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843548.015694:0:13790:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788843548.015697:0:13790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd118db4800 00000020:00000080:3.0:1788843548.015699:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788843548.015733:0:13790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:13790:1875738134432000:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843548.015768:0:13790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843548.015801:0:13790:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00749bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788843548.015923:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134432000 00000100:00100000:0.0:1788843548.015929:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134432000 00000100:00100000:0.0:1788843548.015961:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1788843548.015968:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:13790:x1875738134432000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843548.016058:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:13790:x1875738134432000:12345-0@lo:502:llog_process_th.0 Request processed in 91us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843548.016066:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1788843548.021506:0:13790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e79d9884-ba2e-42e7-accb-b4784b9c1837:13790:1875738134432000:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788843548.021563:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843548.021573:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843548.021575:0:13790:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788843548.021579:0:13790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788843548.022121:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788843548.022174:0:6503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788843548.022185:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af600/0xa762dfcbd58d1307 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d130e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843548.022204:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af600/0xa762dfcbd58d1307 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d130e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843548.023675:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843548.024796:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116517120 00000100:00100000:1.0:1788843548.024812:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116517120 00000100:00100000:1.0:1788843548.024878:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 364 00000100:00100000:1.0:1788843548.024890:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+12:10768:x1875738116517120:12345-192.168.203.33@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788843548.025034:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+12:10768:x1875738116517120:12345-192.168.203.33@tcp:502:llog_process_th.0 Request processed in 146us (1365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843548.025042:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 364 00000100:00100000:1.0:1788843548.039898:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843548.050715:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116517248 00000100:00100000:3.0:1788843548.050729:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116517248 00000100:00100000:3.0:1788843548.050788:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 365 00000100:00100000:3.0:1788843548.050799:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+12:6164:x1875738116517248:12345-192.168.203.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843548.050815:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843548.050833:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd10f7ae600/0xa762dfcbd58d1315 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf24d95f224908a9 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843548.050860:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd10f7ae600/0xa762dfcbd58d1315 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908a9 expref: 13 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843548.050871:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd10f7ae600/0xa762dfcbd58d1315 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908a9 expref: 13 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843548.050880:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10f7ae600, rc 0) 00000100:00100000:3.0:1788843548.050942:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+13:6164:x1875738116517248:12345-192.168.203.33@tcp:101:ll_cfg_requeue.0 Request processed in 146us (11056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843548.050950:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 365 00000100:00100000:2.0:1788843548.056626:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843548.060504:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116517376 00000100:00100000:1.0:1788843548.060518:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116517376 00000100:00100000:0.0:1788843548.060816:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 366 00000100:00100000:0.0:1788843548.060828:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+13:6164:x1875738116517376:12345-192.168.203.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843548.060972:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+13:6164:x1875738116517376:12345-192.168.203.33@tcp:501:ll_cfg_requeue.0 Request processed in 145us (4355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843548.060991:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 366 00000100:00100000:0.0:1788843548.070620:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843548.078118:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116517504 00000100:00100000:2.0:1788843548.078135:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116517504 00000100:00100000:2.0:1788843548.078210:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 367 00000100:00100000:2.0:1788843548.078219:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+13:6164:x1875738116517504:12345-192.168.203.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843548.079115:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+13:6164:x1875738116517504:12345-192.168.203.33@tcp:503:ll_cfg_requeue.0 Request processed in 889us (8497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843548.079126:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 367 00000100:00100000:2.0:1788843548.091082:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843548.091430:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116517632 00000100:00100000:1.0:1788843548.091441:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116517632 00000100:00100000:1.0:1788843548.091495:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 368 00000100:00100000:1.0:1788843548.091506:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+13:10772:x1875738116517632:12345-192.168.203.33@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788843548.097405:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+13:10772:x1875738116517632:12345-192.168.203.33@tcp:502:llog_process_th.0 Request processed in 5889us (6320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843548.097419:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 368 00000100:00100000:1.0:1788843548.104649:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843548.110878:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116517760 00000100:00100000:2.0:1788843548.110893:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116517760 00000100:00100000:2.0:1788843548.110970:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 369 00000100:00100000:2.0:1788843548.110981:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+13:10772:x1875738116517760:12345-192.168.203.33@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788843548.111346:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+13:10772:x1875738116517760:12345-192.168.203.33@tcp:502:llog_process_th.0 Request processed in 365us (6707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843548.111355:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 369 00010000:00010000:3.0:1788843548.826335:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788843549.018830:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788843549.019635:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788843549.082819:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134432512:0@lo:400:kworker.0 00000100:00100000:3.0:1788843549.082905:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843549.082985:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134433024:0@lo:400:kworker.0 00000100:00100000:3.0:1788843549.083039:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843549.083068:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134433536:0@lo:400:kworker.0 00000100:00100000:3.0:1788843549.083092:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843549.083123:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1788843549.083129:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134432128:0@lo:400:kworker.0 00000100:00100000:3.0:1788843549.083176:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843549.083194:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134432640:0@lo:400:kworker.0 00000100:00100000:3.0:1788843549.083218:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843549.083241:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134433152:0@lo:400:kworker.0 00000100:00100000:3.0:1788843549.083271:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843549.083291:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134433664:0@lo:400:kworker.0 00000100:00100000:3.0:1788843549.083320:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843549.083356:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134432256:0@lo:400:kworker.0 00000100:00100000:3.0:1788843549.083388:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843549.083412:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134432768:0@lo:400:kworker.0 00000100:00100000:3.0:1788843549.083436:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843549.083454:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1875738134433280:0@lo:400:kworker.0 00000100:00100000:3.0:1788843549.083473:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843549.083488:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788843549.083493:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134432384:0@lo:400:kworker.0 00000100:00100000:3.0:1788843549.083513:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843549.083543:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134432896:0@lo:400:kworker.0 00000100:00100000:3.0:1788843549.083573:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843549.083592:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134433408:0@lo:400:kworker.0 00000100:00100000:3.0:1788843549.083632:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843549.083664:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134433024 00000100:00100000:3.0:1788843549.083671:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134433024 00000100:00100000:3.0:1788843549.083723:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134433536 00000100:00100000:3.0:1788843549.083726:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134433536 00000100:00100000:3.0:1788843549.083740:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134433152 00000100:00100000:3.0:1788843549.083743:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134433152 00000100:00100000:3.0:1788843549.083753:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134433664 00000100:00100000:3.0:1788843549.083755:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134433664 00000100:00100000:3.0:1788843549.083769:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788843549.083777:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134433024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843549.083840:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134433024:12345-0@lo:400:kworker.0 Request processed in 64us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843549.083851:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788843549.083873:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788843549.083879:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134433536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843549.083919:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134433536:12345-0@lo:400:kworker.0 Request processed in 37us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843549.083924:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788843549.083941:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788843549.083951:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134433152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843549.083983:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134433152:12345-0@lo:400:kworker.0 Request processed in 36us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843549.083988:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788843549.083998:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788843549.084003:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3632:x1875738134433664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843549.084037:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3632:x1875738134433664:12345-0@lo:400:kworker.0 Request processed in 34us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843549.084054:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788843549.084081:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134432640 00000100:00100000:3.0:1788843549.084085:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134432640 00000100:00100000:3.0:1788843549.084109:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134432384 00000100:00100000:3.0:1788843549.084112:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134432384 00000100:00100000:3.0:1788843549.084124:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788843549.084130:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134432640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843549.084186:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134432640:12345-0@lo:400:kworker.0 Request processed in 55us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843549.084192:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788843549.084204:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788843549.084209:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134432384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843549.084253:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134432384:12345-0@lo:400:kworker.0 Request processed in 43us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843549.084263:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788843549.084382:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134432128 00000100:00100000:1.0:1788843549.084386:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134432128 00000100:00100000:1.0:1788843549.084422:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1788843549.084429:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3632:x1875738134432128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843549.084473:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3632:x1875738134432128:12345-0@lo:400:kworker.0 Request processed in 44us (1296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843549.084479:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1788843549.084509:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134432512 00000100:00100000:1.0:1788843549.084513:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134432512 00000100:00100000:1.0:1788843549.084544:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134432256 00000100:00100000:1.0:1788843549.084547:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134432256 00000100:00100000:1.0:1788843549.084557:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134432768 00000100:00100000:1.0:1788843549.084560:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134432768 00000100:00100000:1.0:1788843549.084572:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134433280 00000100:00100000:1.0:1788843549.084574:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134433280 00000100:00100000:1.0:1788843549.084583:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134432896 00000100:00100000:1.0:1788843549.084585:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134432896 00000100:00100000:1.0:1788843549.084595:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134433408 00000100:00100000:1.0:1788843549.084597:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134433408 00000100:00100000:1.0:1788843549.084609:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788843549.084615:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134432512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843549.084652:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134432512:12345-0@lo:400:kworker.0 Request processed in 37us (1750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843549.084658:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788843549.084674:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788843549.084684:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134432256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843549.084714:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134432256:12345-0@lo:400:kworker.0 Request processed in 35us (1325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843549.084719:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788843549.084730:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788843549.084736:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134432768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843549.084760:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134432768:12345-0@lo:400:kworker.0 Request processed in 26us (1324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843549.084772:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788843549.084788:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788843549.084794:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875738134433280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843549.084830:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875738134433280:12345-0@lo:400:kworker.0 Request processed in 36us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843549.084841:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788843549.084852:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788843549.084858:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134432896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843549.084891:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134432896:12345-0@lo:400:kworker.0 Request processed in 33us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843549.084896:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788843549.084911:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788843549.084921:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134433408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843549.084950:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134433408:12345-0@lo:400:kworker.0 Request processed in 34us (1320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843549.084956:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00080000:1.0:1788843549.084976:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788843549.084980:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788843549.084983:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788843549.084985:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788843549.085040:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134432128:0@lo:400:kworker.0 00000100:00100000:1.0:1788843549.085059:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134432640:0@lo:400:kworker.0 00010000:00080000:1.0:1788843549.085078:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141b69880 x1875738134433152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843549.085111:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134433152:0@lo:400:kworker.0 00000100:00100000:1.0:1788843549.085128:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134433664:0@lo:400:kworker.0 00000100:00100000:1.0:1788843549.085138:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134432512:0@lo:400:kworker.0 00010000:00080000:1.0:1788843549.085176:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141b6b480 x1875738134433024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843549.085184:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134433024:0@lo:400:kworker.0 00000100:00100000:1.0:1788843549.085197:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134433536:0@lo:400:kworker.0 00000100:00100000:3.0:1788843549.085318:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134432384:0@lo:400:kworker.0 00010000:00080000:3.0:1788843549.085342:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141b6b800 x1875738134432896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843549.085353:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134432896:0@lo:400:kworker.0 00010000:00080000:3.0:1788843549.085364:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141b6bb80 x1875738134433408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843549.085378:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134433408:0@lo:400:kworker.0 00000100:00100000:3.0:1788843549.085392:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134432256:0@lo:400:kworker.0 00000100:00100000:3.0:1788843549.085402:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134432768:0@lo:400:kworker.0 00000100:00100000:3.0:1788843549.085423:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1875738134433280:0@lo:400:kworker.0 00000100:00100000:2.0:1788843549.085631:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788843549.085642:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134433792:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788843549.085678:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843549.085809:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134433792 00000100:00100000:1.0:1788843549.085815:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134433792 00000100:00100000:1.0:1788843549.085851:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788843549.085858:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134433792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788843549.085880:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788843549.085911:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134433792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843549.085918:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:2.0:1788843549.086006:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd120368a80 x1875738134433792/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843565 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843549.086020:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134433792:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788843549.594368:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843549.594783:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134434176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843549.594851:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843549.594924:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788843549.594931:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134434048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788843549.594961:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843549.595039:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134434176 00000100:00100000:2.0:1788843549.595047:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134434176 00000100:00100000:2.0:1788843549.595094:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134434048 00000100:00100000:2.0:1788843549.595097:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134434048 00000100:00100000:2.0:1788843549.595114:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788843549.595122:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134434176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788843549.595161:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788843549.595206:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134434176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843549.595213:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788843549.595229:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788843549.595249:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1875738134434048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788843549.595264:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788843549.595290:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1875738134434048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843549.595296:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788843549.596260:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134434048:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788843549.596278:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007769f80 x1875738134434176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843565 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843549.596309:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134434176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843549.598677:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134433920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788843549.598759:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843549.603640:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134433920 00000100:00100000:2.0:1788843549.603656:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134433920 00000100:00100000:2.0:1788843549.603796:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788843549.603807:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134433920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788843549.603834:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788843549.604038:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134433920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 233us (5278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843549.604046:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788843549.604129:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134433920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788843549.613851:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843549.614192:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843549.614226:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843549.614259:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843549.614277:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843549.614300:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843549.614333:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116518016 00000100:00100000:3.0:1788843549.614343:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116518016 00000100:00100000:1.0:1788843549.614360:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116518528 00000100:00100000:1.0:1788843549.614364:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116518528 00000100:00100000:1.0:1788843549.614395:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116518144 00000100:00100000:1.0:1788843549.614397:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116518144 00000100:00100000:2.0:1788843549.614449:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116517888 00000100:00100000:2.0:1788843549.614453:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116517888 00000100:00100000:2.0:1788843549.614482:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 371 00000100:00100000:2.0:1788843549.614504:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+13:2387:x1875738116517888:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843549.614574:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+13:2387:x1875738116517888:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 71us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843549.614581:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 371 00000100:00100000:2.0:1788843549.614614:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116518272 00000100:00100000:2.0:1788843549.614617:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116518272 00000100:00100000:2.0:1788843549.614644:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 97 00000100:00100000:2.0:1788843549.614649:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116518272:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843549.614674:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116518272:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 25us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843549.614680:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 97 00000100:00100000:3.0:1788843549.617079:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116518400 00000100:00100000:3.0:1788843549.617092:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116518400 00000100:00100000:3.0:1788843549.617159:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 231 00000100:00100000:3.0:1788843549.617169:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2387:x1875738116518528:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843549.617232:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2387:x1875738116518528:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 66us (3005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843549.617239:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 231 00000100:00100000:3.0:1788843549.617259:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 232 00000100:00100000:3.0:1788843549.617266:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116518016:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843549.617290:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116518016:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 26us (3451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843549.617297:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 232 00000100:00100000:3.0:1788843549.617326:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 233 00000100:00100000:3.0:1788843549.617333:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116518144:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843549.617358:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116518144:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 26us (3081us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843549.617364:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 233 00000100:00100000:3.0:1788843549.617376:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 234 00000100:00100000:3.0:1788843549.617382:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2387:x1875738116518400:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843549.617403:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2387:x1875738116518400:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 22us (3102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843549.617409:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 234 00000100:00080000:3.0:1788843549.617633:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788843549.617639:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788843549.617642:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788843549.850382:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843550.618529:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788843550.618554:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134434304:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788843550.618627:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843550.618717:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134434432:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788843550.618752:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843550.620883:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134434304 00000100:00100000:2.0:1788843550.620895:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134434304 00000100:00100000:2.0:1788843550.621013:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134434432 00000100:00100000:2.0:1788843550.621018:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134434432 00000100:00100000:2.0:1788843550.621037:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788843550.621046:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12036ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134434304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788843550.621091:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788843550.621191:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12036ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134434304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 144us (2563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843550.621198:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788843550.621214:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788843550.621220:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134434432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788843550.621236:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788843550.621265:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134434432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 45us (2512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843550.621289:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788843550.621659:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134434432:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788843550.621676:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134434304:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788843550.874618:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843551.901016:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788843552.158368:0:9500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:3.0:1788843552.922293:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843553.946476:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843554.202405:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134434688:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788843554.202448:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134434560:0@lo:400:kworker.0 00000100:00100000:1.0:1788843554.202482:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843554.202506:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843554.202556:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007935180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134435200:0@lo:400:kworker.0 00000100:00100000:2.0:1788843554.202585:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843554.202587:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134434816:0@lo:400:kworker.0 00000100:00100000:2.0:1788843554.202606:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd136c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134435712:0@lo:400:kworker.0 00000100:00100000:3.0:1788843554.202632:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843554.202642:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843554.202658:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134435328:0@lo:400:kworker.0 00000100:00100000:2.0:1788843554.202670:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd136c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134436224:0@lo:400:kworker.0 00000100:00100000:3.0:1788843554.202689:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843554.202703:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843554.202713:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd136c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1875738134435840:0@lo:400:kworker.0 00000100:00100000:2.0:1788843554.202737:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788843554.202743:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843554.202748:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134435584:0@lo:400:kworker.0 00000100:00100000:3.0:1788843554.202770:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788843554.202779:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843554.202780:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134434944:0@lo:400:kworker.0 00000100:00100000:2.0:1788843554.202803:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd136c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134436096:0@lo:400:kworker.0 00000100:00100000:3.0:1788843554.202827:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843554.202832:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843554.202852:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134435456:0@lo:400:kworker.0 00000100:00100000:3.0:1788843554.202881:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843554.202888:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134435200 00000100:00100000:2.0:1788843554.202897:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134435200 00000100:00100000:3.0:1788843554.202920:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd136c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134435968:0@lo:400:kworker.0 00000100:00100000:2.0:1788843554.202939:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134434944 00000100:00100000:2.0:1788843554.202944:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134434944 00000100:00100000:3.0:1788843554.202949:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843554.202969:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788843554.202979:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134435200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843554.202985:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134434816 00000100:00100000:3.0:1788843554.202990:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134434816 00000100:00100000:3.0:1788843554.203019:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134435328 00000100:00100000:3.0:1788843554.203023:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134435328 00000100:00100000:2.0:1788843554.203032:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134435200:12345-0@lo:400:kworker.0 Request processed in 54us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843554.203040:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788843554.203050:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134435840 00000100:00100000:3.0:1788843554.203055:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134435840 00000100:00100000:2.0:1788843554.203061:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788843554.203072:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134434944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843554.203074:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134435456 00000100:00100000:3.0:1788843554.203078:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134435456 00000100:00100000:3.0:1788843554.203094:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134435968 00000100:00100000:3.0:1788843554.203098:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134435968 00000100:00100000:3.0:1788843554.203117:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788843554.203123:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134434944:12345-0@lo:400:kworker.0 Request processed in 53us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843554.203126:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134434816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843554.203135:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788843554.203178:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134435712 00000100:00100000:2.0:1788843554.203183:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134435712 00000100:00100000:3.0:1788843554.203191:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134434816:12345-0@lo:400:kworker.0 Request processed in 66us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843554.203199:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788843554.203204:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134436224 00000100:00100000:2.0:1788843554.203208:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134436224 00000100:00100000:3.0:1788843554.203221:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788843554.203225:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134435584 00000100:00100000:2.0:1788843554.203229:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134435584 00000100:00100000:3.0:1788843554.203231:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134435328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843554.203245:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134436096 00000100:00100000:2.0:1788843554.203249:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134436096 00000100:00100000:3.0:1788843554.203269:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134435328:12345-0@lo:400:kworker.0 Request processed in 39us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843554.203269:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788843554.203280:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00799b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134435712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843554.203281:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788843554.203302:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788843554.203319:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00799b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134435712:12345-0@lo:400:kworker.0 Request processed in 40us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843554.203320:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875738134435840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843554.203333:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788843554.203346:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788843554.203353:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134436224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843554.203366:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875738134435840:12345-0@lo:400:kworker.0 Request processed in 55us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843554.203373:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788843554.203388:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134436224:12345-0@lo:400:kworker.0 Request processed in 35us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843554.203394:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788843554.203397:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788843554.203410:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134435456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843554.203414:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788843554.203425:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134435584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843554.203525:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788843554.203535:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134435968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843554.204204:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134435968:12345-0@lo:400:kworker.0 Request processed in 600us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843554.204213:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788843554.204242:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788843554.204251:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00799aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134436096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843554.204285:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00799aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134436096:12345-0@lo:400:kworker.0 Request processed in 36us (1455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843554.204291:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788843554.204384:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134434688 00000100:00100000:0.0:1788843554.204390:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134434688 00000100:00100000:0.0:1788843554.204419:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788843554.204427:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3632:x1875738134434688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788843554.204448:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843554.204481:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3632:x1875738134434688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (2000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843554.204487:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788843554.204524:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134434560 00000100:00100000:0.0:1788843554.204528:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134434560 00000100:00100000:0.0:1788843554.204756:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1788843554.204763:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3633:x1875738134434560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843554.204811:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3633:x1875738134434560:12345-0@lo:400:kworker.0 Request processed in 38us (2305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843554.204818:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00010000:00080000:0.0:1788843554.204911:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00723d180 x1875738134435584/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843554.204926:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134435584:0@lo:400:kworker.0 00000100:00100000:0.0:1788843554.204939:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd136c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134436096:0@lo:400:kworker.0 00000100:00100000:0.0:1788843554.204948:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134434560:0@lo:400:kworker.0 00000100:00100000:0.0:1788843554.204958:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007935180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134435200:0@lo:400:kworker.0 00010000:00080000:0.0:1788843554.204968:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd136c45f80 x1875738134435712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843554.204976:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd136c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134435712:0@lo:400:kworker.0 00000100:00100000:0.0:1788843554.204999:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1788843554.205003:0:3633:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd120368e00, transno 4294967301 00000100:00100000:0.0:1788843554.205015:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd136c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134436224:0@lo:400:kworker.0 00000100:00080000:0.0:1788843554.205744:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788843554.205751:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788843554.205754:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788843554.205757:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843554.205862:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134434944:0@lo:400:kworker.0 00010000:00080000:0.0:1788843554.205880:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00723f100 x1875738134435456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843554.205891:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134435456:0@lo:400:kworker.0 00010000:00080000:0.0:1788843554.205903:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd136c45880 x1875738134435968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843554.205912:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd136c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134435968:0@lo:400:kworker.0 00000100:00100000:0.0:1788843554.205926:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134434816:0@lo:400:kworker.0 00000100:00100000:0.0:1788843554.205940:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134435328:0@lo:400:kworker.0 00000100:00100000:2.0:1788843554.205946:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134435584:12345-0@lo:400:kworker.0 Request processed in 2518us (3164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843554.205957:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd136c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1875738134435840:0@lo:400:kworker.0 00000100:00100000:2.0:1788843554.205958:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:1.0:1788843554.206795:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd120368a80 x1875738134434688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843570 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843554.206826:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134434688:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788843554.206837:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007937b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134435072:0@lo:400:kworker.0 00000100:00100000:1.0:1788843554.206890:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843554.207101:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134435456:12345-0@lo:400:kworker.0 Request processed in 3691us (4218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843554.207111:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788843554.207183:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134435072 00000100:00100000:3.0:1788843554.207190:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134435072 00000100:00100000:3.0:1788843554.208912:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788843554.208934:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134435072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843554.209024:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134435072:12345-0@lo:400:kworker.0 Request processed in 99us (2133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843554.209031:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788843554.209230:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007937b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134435072:0@lo:400:kworker.0 00000100:00100000:2.0:1788843554.715877:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134436480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788843554.716717:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843554.716792:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788843554.716802:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134436352:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788843554.716827:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843554.716866:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134436480 00000100:00100000:2.0:1788843554.716874:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134436480 00000100:00100000:2.0:1788843554.716926:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134436352 00000100:00100000:2.0:1788843554.716930:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134436352 00000100:00100000:2.0:1788843554.716947:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788843554.716956:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134436480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788843554.716979:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788843554.717021:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134436480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843554.717028:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788843554.717046:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788843554.717052:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134436352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788843554.717070:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788843554.717096:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134436352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843554.717102:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788843554.717173:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134436352:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1788843554.717188:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd1203d2d80 x1875738134436480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843570 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843554.717201:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134436480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788843554.717364:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788843554.717384:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134436608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788843554.717412:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843554.717438:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134436608 00000100:00100000:2.0:1788843554.717442:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134436608 00000100:00100000:2.0:1788843554.717466:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788843554.717473:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134436608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788843554.717482:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788843554.717524:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134436608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843554.717530:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788843554.717558:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134436608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843554.734522:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843554.734579:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843554.734610:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116518656 00000100:00100000:3.0:1788843554.734621:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843554.734631:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116518656 00000100:00100000:3.0:1788843554.734656:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843554.734698:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843554.734714:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 373 00000100:00100000:1.0:1788843554.734731:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+13:2388:x1875738116518656:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843554.734742:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843554.734784:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116518912 00000100:00100000:3.0:1788843554.734793:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116518912 00000100:00100000:1.0:1788843554.734828:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+13:2388:x1875738116518656:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 101us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843554.734838:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 373 00000100:00100000:3.0:1788843554.734864:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116519168 00000100:00100000:3.0:1788843554.734870:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116519168 00000100:00100000:3.0:1788843554.734895:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116518784 00000100:00100000:3.0:1788843554.734898:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116518784 00000100:00100000:3.0:1788843554.734914:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116519296 00000100:00100000:3.0:1788843554.734917:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116519296 00000100:00100000:3.0:1788843554.734943:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 241 00000100:00100000:3.0:1788843554.734954:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2388:x1875738116518912:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843554.735024:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2388:x1875738116518912:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 72us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843554.735093:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 242 00000100:00100000:0.0:1788843554.735108:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2388:x1875738116519168:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843554.736916:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 241 00000100:00100000:3.0:1788843554.736968:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 243 00000100:00100000:3.0:1788843554.736983:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2388:x1875738116518784:12345-192.168.203.33@tcp:400:kworker.0 00000100:00080000:1.0:1788843554.738411:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788843554.738420:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788843554.738438:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116519040 00000100:00100000:1.0:1788843554.738449:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116519040 00000100:00100000:1.0:1788843554.738545:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 102 00000100:00100000:1.0:1788843554.738555:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2388:x1875738116519040:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843554.738631:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2388:x1875738116519040:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 77us (3932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843554.738639:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 102 00000100:00100000:1.0:1788843554.738665:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 244 00000100:00100000:1.0:1788843554.738673:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2388:x1875738116519296:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843554.738702:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2388:x1875738116519296:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 31us (3964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843554.738708:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 244 00000100:00080000:1.0:1788843554.738798:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788843554.741273:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2388:x1875738116519168:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 6159us (6645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843554.741287:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 242 00000100:00100000:3.0:1788843554.742513:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2388:x1875738116518784:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 5510us (7831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843554.742531:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 243 00010000:00010000:0.0:1788843554.971662:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843555.740239:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788843555.740271:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134436736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788843555.740342:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843555.740514:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134436736 00000100:00100000:2.0:1788843555.740523:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134436736 00000100:00100000:2.0:1788843555.740570:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788843555.740579:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134436736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788843555.740611:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788843555.740661:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134436736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843555.740668:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788843555.740852:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134436864:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788843555.741369:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134436736:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788843555.747091:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843555.748760:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134436864 00000100:00100000:0.0:1788843555.748772:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134436864 00000100:00100000:0.0:1788843555.748840:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788843555.748851:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141a74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134436864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788843555.748888:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788843555.748960:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141a74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134436864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (1876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843555.748967:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788843555.749621:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134436864:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788843556.008663:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843557.018302:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843558.042426:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843559.066558:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788843559.258814:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788843559.259567:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788843559.322424:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141a75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134437120:0@lo:400:kworker.0 00000100:00100000:0.0:1788843559.322440:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134437248:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788843559.322512:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843559.322513:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843559.322563:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788843559.322580:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141a77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134436992:0@lo:400:kworker.0 00000100:00100000:1.0:1788843559.322609:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134437120 00000100:00100000:1.0:1788843559.322618:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134437120 00000100:00100000:1.0:1788843559.322672:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788843559.322683:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141a76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134437120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843559.326227:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788843559.326242:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141a74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134437376:0@lo:400:kworker.0 00000100:00100000:3.0:1788843559.326316:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843559.326349:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134437376 00000100:00100000:3.0:1788843559.326356:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134437376 00000100:00100000:3.0:1788843559.326400:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788843559.326409:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141a77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134437376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843559.326471:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141a77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134437376:12345-0@lo:400:kworker.0 Request processed in 52us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843559.326478:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788843559.326522:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141a74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134437376:0@lo:400:kworker.0 00000100:00100000:3.0:1788843559.326558:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141a74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1875738134437504:0@lo:400:kworker.0 00000100:00100000:3.0:1788843559.326601:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843559.326635:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134437504 00000100:00100000:3.0:1788843559.326640:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134437504 00000100:00100000:3.0:1788843559.326663:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788843559.326669:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1875738134437504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843559.326703:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1875738134437504:12345-0@lo:400:kworker.0 Request processed in 34us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843559.326708:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788843559.326736:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141a74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1875738134437504:0@lo:400:kworker.0 00000100:00100000:3.0:1788843559.326784:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141a74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134437632:0@lo:400:kworker.0 00000100:00100000:3.0:1788843559.326807:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843559.326847:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788843559.326864:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134437760:0@lo:400:kworker.0 00000100:00100000:3.0:1788843559.326888:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843559.326910:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134437760 00000100:00100000:3.0:1788843559.326914:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134437760 00000100:00100000:3.0:1788843559.326945:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788843559.326952:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134437760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843559.326987:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134437760:12345-0@lo:400:kworker.0 Request processed in 36us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843559.326993:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:3.0:1788843559.327010:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843559.327583:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134437632 00000100:00100000:0.0:1788843559.327590:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134437632 00000100:00100000:0.0:1788843559.327622:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788843559.327630:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134437632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843559.327674:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134437632:12345-0@lo:400:kworker.0 Request processed in 45us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843559.328225:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134437760:0@lo:400:kworker.0 00000100:00100000:2.0:1788843559.328360:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843559.328406:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134437248 00000100:00100000:2.0:1788843559.328411:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134437248 00000100:00100000:2.0:1788843559.328473:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788843559.328481:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134437248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788843559.328502:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788843559.328541:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134437248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (6032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843559.328547:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1788843559.328567:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788843559.328589:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd120368e00 x1875738134437248/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843575 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843559.328606:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134437248:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788843559.328663:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134437888:0@lo:400:kworker.0 00000100:00100000:2.0:1788843559.328698:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843559.328736:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788843559.328742:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134438016:0@lo:400:kworker.0 00000100:00100000:0.0:1788843559.328782:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788843559.328808:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134436992 00000100:00100000:0.0:1788843559.328812:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134436992 00000100:00100000:0.0:1788843559.328845:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1788843559.328853:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3630:x1875738134436992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843559.328889:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3630:x1875738134436992:12345-0@lo:400:kworker.0 Request processed in 37us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843559.328902:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1788843559.328958:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141a74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134437632:0@lo:400:kworker.0 00000100:00100000:3.0:1788843559.328988:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134437888 00000100:00100000:3.0:1788843559.328997:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134437888 00000100:00100000:3.0:1788843559.329105:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788843559.329113:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134437888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843559.329378:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134437888:12345-0@lo:400:kworker.0 Request processed in 267us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843559.329385:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788843559.329435:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1875738134438144:0@lo:400:kworker.0 00000100:00100000:3.0:1788843559.329471:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843559.329497:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134438144 00000100:00100000:3.0:1788843559.329500:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134438144 00000100:00100000:3.0:1788843559.329524:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788843559.329530:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1875738134438144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843559.329564:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1875738134438144:12345-0@lo:400:kworker.0 Request processed in 34us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843559.329569:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788843559.329595:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1875738134438144:0@lo:400:kworker.0 00000100:00100000:3.0:1788843559.329618:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788843559.329623:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1875738134438272:0@lo:400:kworker.0 00000100:00100000:3.0:1788843559.329644:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843559.329661:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134438272 00000100:00100000:3.0:1788843559.329664:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134438272 00000100:00100000:3.0:1788843559.329682:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788843559.329686:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1875738134438272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843559.329712:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1875738134438272:12345-0@lo:400:kworker.0 Request processed in 25us (68us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843559.329717:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00010000:00080000:3.0:1788843559.329750:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd13e874e00 x1875738134438272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843559.329926:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843559.329936:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141a76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134437120:12345-0@lo:400:kworker.0 Request processed in 7252us (7424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843559.329946:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00010000:00080000:2.0:1788843559.329961:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd1203d2d80 x1875738134437888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843559.329973:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134437888:0@lo:400:kworker.0 00000100:00100000:2.0:1788843559.329985:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141a77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134436992:0@lo:400:kworker.0 00000100:00100000:0.0:1788843559.330047:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134438016 00000100:00100000:0.0:1788843559.330052:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134438016 00000100:00100000:3.0:1788843559.330104:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1875738134438272:0@lo:400:kworker.0 00000100:00100000:3.0:1788843559.330122:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141a75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134437120:0@lo:400:kworker.0 00000100:00100000:0.0:1788843559.330130:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788843559.330155:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134438016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843559.330203:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134438016:12345-0@lo:400:kworker.0 Request processed in 65us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843559.330209:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:3.0:1788843559.330546:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141aead80 x1875738134438016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843559.330555:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134438016:0@lo:400:kworker.0 00000100:00080000:3.0:1788843559.330581:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788843559.330584:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788843559.330587:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788843559.330650:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788843559.330660:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141aea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134438400:0@lo:400:kworker.0 00000100:00100000:2.0:1788843559.330688:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843559.330739:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788843559.330746:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134438528:0@lo:400:kworker.0 00000100:00100000:2.0:1788843559.342684:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843559.345247:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134438400 00000100:00100000:1.0:1788843559.345264:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134438400 00000100:00100000:3.0:1788843559.346249:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788843559.346281:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134438400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843559.346392:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134438400:12345-0@lo:400:kworker.0 Request processed in 122us (15702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843559.346400:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788843559.346484:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141aea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134438400:0@lo:400:kworker.0 00000100:00080000:3.0:1788843559.346524:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788843559.347546:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134438528 00000100:00100000:3.0:1788843559.347556:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134438528 00000100:00100000:3.0:1788843559.347651:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788843559.347659:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134438528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843559.347714:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134438528:12345-0@lo:400:kworker.0 Request processed in 56us (5037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843559.347737:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788843559.347786:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134438528:0@lo:400:kworker.0 00000100:00080000:2.0:1788843559.355132:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788843559.834408:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788843559.834432:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd13e874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134438912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843559.834516:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843559.834580:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141aeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134438656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843559.834606:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843559.834628:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788843559.834635:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134438784:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788843559.834657:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843559.834694:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134438912 00000100:00100000:1.0:1788843559.834703:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134438912 00000100:00100000:3.0:1788843559.834704:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134438656 00000100:00100000:3.0:1788843559.834709:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134438656 00000100:00100000:3.0:1788843559.834747:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134438784 00000100:00100000:3.0:1788843559.834751:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134438784 00000100:00100000:1.0:1788843559.834756:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788843559.834767:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141a77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134438656:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843559.834770:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788843559.834780:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141a75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134438912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788843559.834797:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1788843559.834803:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843559.834849:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141a75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134438912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843559.834859:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788843559.834861:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141a77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134438656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843559.834871:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788843559.834883:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788843559.834891:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141a74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134438784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788843559.834901:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843559.834925:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141a74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134438784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843559.834939:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:3.0:1788843559.834970:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd13e874e00 x1875738134438912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843575 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843559.834986:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd13e874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134438912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843559.835011:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134438784:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788843559.835021:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141aeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134438656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788843559.852775:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843559.852823:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843559.852852:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843559.852876:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843559.852897:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843559.852927:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843559.852932:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116519424 00000100:00100000:2.0:1788843559.853008:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116519424 00000100:00100000:2.0:1788843559.853057:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 375 00000100:00100000:2.0:1788843559.853068:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+13:2388:x1875738116519424:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843559.853156:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+13:2388:x1875738116519424:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 71us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843559.853164:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 375 00000100:00100000:1.0:1788843559.860065:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116519808 00000100:00100000:1.0:1788843559.860078:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116519808 00000100:00100000:1.0:1788843559.860169:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 106 00000100:00100000:1.0:1788843559.860179:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2388:x1875738116519808:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843559.860246:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2388:x1875738116519808:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 68us (7347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843559.860254:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 106 00000100:00080000:1.0:1788843559.860274:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788843559.860335:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116519680 00000100:00100000:3.0:1788843559.860340:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116519680 00000100:00100000:3.0:1788843559.860417:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116519936 00000100:00100000:3.0:1788843559.860421:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116519936 00000100:00100000:3.0:1788843559.860436:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116519552 00000100:00100000:3.0:1788843559.860439:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116519552 00000100:00100000:3.0:1788843559.860452:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116520064 00000100:00100000:3.0:1788843559.860468:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116520064 00000100:00100000:3.0:1788843559.860485:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 251 00000100:00100000:3.0:1788843559.860492:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2388:x1875738116519680:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843559.860525:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2388:x1875738116519680:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 33us (7701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843559.860531:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 251 00000100:00100000:3.0:1788843559.860546:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 252 00000100:00100000:3.0:1788843559.860552:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2388:x1875738116519936:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843559.860576:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2388:x1875738116519936:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 25us (7726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843559.860581:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 252 00000100:00100000:3.0:1788843559.860609:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 253 00000100:00100000:3.0:1788843559.860615:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2388:x1875738116519552:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843559.860638:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2388:x1875738116519552:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 24us (7763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843559.860645:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 253 00000100:00100000:3.0:1788843559.860656:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 254 00000100:00100000:3.0:1788843559.860662:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2388:x1875738116520064:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843559.860685:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2388:x1875738116520064:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 23us (7758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843559.860690:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 254 00000100:00080000:3.0:1788843559.860830:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788843559.860834:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788843560.090399:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843560.858521:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141aebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134439040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788843560.858595:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843560.859001:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788843560.859013:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134439168:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788843560.859045:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843560.859130:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134439040 00000100:00100000:0.0:1788843560.859159:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134439040 00000100:00100000:0.0:1788843560.859213:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134439168 00000100:00100000:0.0:1788843560.859217:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134439168 00000100:00100000:0.0:1788843560.859234:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788843560.859242:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134439040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788843560.859275:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788843560.859334:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134439040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843560.859342:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788843560.859358:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788843560.859363:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134439168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788843560.859379:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788843560.859412:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134439168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 48us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843560.859418:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788843560.859466:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134439168:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788843560.859612:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141aebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134439040:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788843561.115178:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843562.141046:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843563.162633:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843564.187177:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843564.443507:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134439680:0@lo:400:kworker.0 00000100:00100000:2.0:1788843564.443540:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141aea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134439424:0@lo:400:kworker.0 00000100:00100000:3.0:1788843564.443548:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141aebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134439296:0@lo:400:kworker.0 00000100:00100000:3.0:1788843564.443621:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843564.443621:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843564.443694:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134439808:0@lo:400:kworker.0 00000100:00100000:0.0:1788843564.443694:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134439680 00000100:00100000:0.0:1788843564.443706:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134439680 00000100:00100000:3.0:1788843564.443741:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843564.443767:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141aea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134440320:0@lo:400:kworker.0 00000100:00100000:0.0:1788843564.443792:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788843564.443799:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843564.443808:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134439680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843564.443823:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134440832:0@lo:400:kworker.0 00000100:00100000:0.0:1788843564.443890:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134439680:12345-0@lo:400:kworker.0 Request processed in 86us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843564.443897:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788843564.443932:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134440320 00000100:00100000:0.0:1788843564.443936:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134440320 00000100:00100000:0.0:1788843564.443977:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788843564.443986:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134440320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843564.443995:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843564.444028:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788843564.444036:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134440704:0@lo:400:kworker.0 00000100:00100000:0.0:1788843564.444052:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134440320:12345-0@lo:400:kworker.0 Request processed in 66us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843564.444060:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788843564.444072:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134440832 00000100:00100000:0.0:1788843564.444076:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134440832 00000100:00100000:3.0:1788843564.444082:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843564.444101:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134440704 00000100:00100000:0.0:1788843564.444105:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134440704 00000100:00100000:0.0:1788843564.444121:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788843564.444128:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134440832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843564.444186:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134440832:12345-0@lo:400:kworker.0 Request processed in 58us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843564.444192:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788843564.444205:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00010000:00080000:3.0:1788843564.444222:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141aea680 x1875738134440320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843564.444222:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134440704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843564.444245:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141aea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134440320:0@lo:400:kworker.0 00000100:00100000:3.0:1788843564.444265:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134440832:0@lo:400:kworker.0 00000100:00100000:0.0:1788843564.444269:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134440704:12345-0@lo:400:kworker.0 Request processed in 49us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843564.444277:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788843564.444307:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134440704:0@lo:400:kworker.0 00000100:00080000:3.0:1788843564.444331:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788843564.444336:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843564.444343:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134439808 00000100:00100000:0.0:1788843564.444349:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134439808 00000100:00100000:3.0:1788843564.444367:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134439552:0@lo:400:kworker.0 00000100:00100000:0.0:1788843564.444384:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788843564.444393:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134439808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843564.444401:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843564.444461:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134439808:12345-0@lo:400:kworker.0 Request processed in 69us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843564.444468:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788843564.444479:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134439552 00000100:00100000:0.0:1788843564.444482:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134439552 00000100:00100000:0.0:1788843564.444498:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788843564.444568:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1875738134440064:0@lo:400:kworker.0 00000100:00100000:3.0:1788843564.444665:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843564.444685:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1203d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1875738134440576:0@lo:400:kworker.0 00000100:00100000:3.0:1788843564.444708:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843564.444733:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788843564.444739:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134440960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788843564.444767:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843564.444802:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134440064 00000100:00100000:3.0:1788843564.444807:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134440064 00000100:00100000:0.0:1788843564.444981:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134439552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843564.445027:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134439552:12345-0@lo:400:kworker.0 Request processed in 523us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843564.445048:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788843564.445072:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134439296 00000100:00100000:0.0:1788843564.445076:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134439296 00000100:00100000:0.0:1788843564.445106:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788843564.445112:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3633:x1875738134439296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843564.445172:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3633:x1875738134439296:12345-0@lo:400:kworker.0 Request processed in 60us (1553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843564.445178:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788843564.445226:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134440576 00000100:00100000:0.0:1788843564.445230:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134440576 00000100:00100000:3.0:1788843564.445234:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788843564.445247:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1875738134440064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843564.445273:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788843564.445283:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1875738134440576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843564.445292:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1875738134440064:12345-0@lo:400:kworker.0 Request processed in 49us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843564.445299:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00080000:3.0:1788843564.445328:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788843564.445329:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1875738134440576:12345-0@lo:400:kworker.0 Request processed in 47us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843564.445338:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788843564.445358:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141aebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134439296:0@lo:400:kworker.0 00000100:00100000:3.0:1788843564.445376:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134439808:0@lo:400:kworker.0 00000100:00100000:0.0:1788843564.445378:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134440960 00000100:00100000:0.0:1788843564.445383:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134440960 00000100:00080000:3.0:1788843564.445406:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843564.445436:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788843564.445445:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134440960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788843564.445470:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843564.445502:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134440960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843564.445508:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788843564.445608:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134439680:0@lo:400:kworker.0 00000100:00100000:1.0:1788843564.445617:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141aeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134440192:0@lo:400:kworker.0 00000100:00100000:1.0:1788843564.445645:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843564.445917:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134439552:0@lo:400:kworker.0 00010000:00080000:3.0:1788843564.445937:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141ae8380 x1875738134440064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843564.445947:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1875738134440064:0@lo:400:kworker.0 00010000:00080000:3.0:1788843564.445958:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd1203d2d80 x1875738134440576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843564.445967:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1203d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1875738134440576:0@lo:400:kworker.0 00010000:00080000:3.0:1788843564.445991:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd120368e00 x1875738134440960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843580 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843564.446008:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134440960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788843564.446890:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134440192 00000100:00100000:0.0:1788843564.446906:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134440192 00000100:00100000:0.0:1788843564.446980:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788843564.446991:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134440192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843564.448511:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134440192:12345-0@lo:400:kworker.0 Request processed in 1512us (2854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843564.448526:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:1.0:1788843564.448598:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141aeb100 x1875738134440192/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843564.448642:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141aeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134440192:0@lo:400:kworker.0 00000100:00100000:2.0:1788843564.451012:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843564.452229:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134439936:0@lo:400:kworker.0 00000100:00100000:2.0:1788843564.452302:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843564.452337:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1875738134440448:0@lo:400:kworker.0 00000100:00100000:2.0:1788843564.452361:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843564.452503:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134439424 00000100:00100000:1.0:1788843564.452515:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134439424 00000100:00100000:0.0:1788843564.452538:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134439936 00000100:00100000:0.0:1788843564.452545:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134439936 00000100:00100000:1.0:1788843564.452579:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134440448 00000100:00100000:1.0:1788843564.452584:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134440448 00000100:00100000:0.0:1788843564.452603:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788843564.452622:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134439424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843564.452700:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134439424:12345-0@lo:400:kworker.0 Request processed in 81us (1698us total) trans 0 rc 0/0 00000100:00080000:3.0:1788843564.453308:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843564.455500:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788843564.455571:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788843564.455588:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134439936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843564.455629:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788843564.455644:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875738134440448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843564.455714:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134439936:12345-0@lo:400:kworker.0 Request processed in 134us (3412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843564.455722:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788843564.455838:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141aea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134439424:0@lo:400:kworker.0 00000100:00100000:0.0:1788843564.455857:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134439936:0@lo:400:kworker.0 00000100:00100000:0.0:1788843564.455872:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1875738134440448:0@lo:400:kworker.0 00000100:00100000:1.0:1788843564.456028:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875738134440448:12345-0@lo:400:kworker.0 Request processed in 388us (3663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843564.456036:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788843564.954406:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788843564.954451:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134441216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788843564.954549:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134441088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843564.954551:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843564.954598:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843564.954669:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134441216 00000100:00100000:2.0:1788843564.954679:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134441216 00000100:00100000:2.0:1788843564.954798:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134441088 00000100:00100000:2.0:1788843564.954802:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134441088 00000100:00100000:0.0:1788843564.962920:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788843564.962964:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134441216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788843564.963013:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843564.963127:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134441216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 190us (8576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843564.963136:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788843564.963184:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788843564.963193:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134441088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788843564.963210:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843564.963244:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134441088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (8646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843564.963251:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788843564.963290:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788843564.963312:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134441344:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788843564.963362:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843564.963415:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134441344 00000100:00100000:0.0:1788843564.963452:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134441344 00000100:00100000:0.0:1788843564.963490:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788843564.963496:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134441344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788843564.963510:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:1.0:1788843564.966026:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd1054e4380 x1875738134441088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843580 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843564.966726:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134441344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3223us (3357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843564.966742:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788843564.967004:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134441216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788843564.967071:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134441088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843564.967105:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134441344:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788843564.979595:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843564.979695:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843564.979730:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843564.979822:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116520448 00000100:00100000:3.0:1788843564.979835:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116520448 00000100:00100000:3.0:1788843564.979930:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116520320 00000100:00100000:3.0:1788843564.979952:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116520320 00000100:00100000:3.0:1788843564.979985:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 261 00000100:00100000:3.0:1788843564.979997:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2388:x1875738116520448:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843564.980113:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2388:x1875738116520448:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 118us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843564.980122:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 261 00000100:00100000:3.0:1788843564.980181:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 262 00000100:00100000:3.0:1788843564.980190:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2388:x1875738116520320:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843564.980222:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2388:x1875738116520320:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 33us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843564.980228:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 262 00000100:00080000:1.0:1788843564.980616:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788843564.980623:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788843564.982992:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116520192 00000100:00100000:2.0:1788843564.983016:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116520192 00000100:00100000:2.0:1788843564.983335:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 377 00000100:00100000:2.0:1788843564.983349:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+13:2388:x1875738116520192:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843564.983471:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+13:2388:x1875738116520192:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 126us (3891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843564.983503:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 377 00000100:00100000:1.0:1788843565.001399:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843565.001454:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843565.001557:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843565.001762:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116520576 00000100:00100000:2.0:1788843565.001776:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116520576 00000100:00100000:2.0:1788843565.001871:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 27 00000100:00100000:2.0:1788843565.001885:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2386:x1875738116520576:12345-192.168.203.33@tcp:9:kworker.0 00000020:00000080:2.0:1788843565.001928:0:8901:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d123c 00000100:00080000:2.0:1788843565.001939:0:8901:0:(import.c:65:import_set_state_nolock()) ffff9bd141a7e800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788843565.002006:0:8901:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:2.0:1788843565.002267:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+2:2386:x1875738116520576:12345-192.168.203.33@tcp:9:kworker.0 Request processed in 385us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843565.002276:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 27 00010000:00010000:2.0:1788843565.002506:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843565.002762:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116520704 00000100:00100000:3.0:1788843565.002770:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116520704 00000100:00100000:3.0:1788843565.002824:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116520832 00000100:00100000:3.0:1788843565.002827:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116520832 00000100:00100000:3.0:1788843565.002863:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 263 00000100:00100000:3.0:1788843565.002872:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2387:x1875738116520704:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843565.002927:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2387:x1875738116520704:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 56us (1543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843565.002935:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 263 00000100:00100000:3.0:1788843565.002953:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 264 00000100:00100000:3.0:1788843565.002960:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2387:x1875738116520832:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843565.002987:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2387:x1875738116520832:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 28us (1533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843565.002994:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 264 00000100:00080000:3.0:1788843565.003506:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788843565.003512:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788843565.003514:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788843565.210394:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843565.978729:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134441472:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788843565.978854:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843565.979477:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134441472 00000100:00100000:2.0:1788843565.979490:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134441472 00000100:00100000:2.0:1788843565.979555:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788843565.979567:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134441472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788843565.979615:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788843565.979693:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134441472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843565.979700:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788843565.979820:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134441472:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788843565.980087:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843565.980099:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134441600:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788843565.980199:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843565.980261:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134441600 00000100:00100000:3.0:1788843565.980267:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134441600 00000100:00100000:3.0:1788843565.980329:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788843565.980337:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134441600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788843565.980361:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788843565.980403:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134441600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843565.980410:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788843565.980495:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134441600:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788843566.234592:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843567.261845:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843568.282311:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843569.309546:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788843569.498869:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788843569.504092:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788843569.562788:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788843569.562811:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134441728:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788843569.562881:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843569.562954:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134441728 00000100:00100000:0.0:1788843569.562962:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134441728 00000100:00100000:0.0:1788843569.563029:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788843569.563040:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134441728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788843569.563069:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843569.563116:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134441728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843569.563123:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:0.0:1788843569.563169:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788843569.563199:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007934000 x1875738134441728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843585 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843569.563232:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134441728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788843569.570114:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134441984:0@lo:400:kworker.0 00000100:00100000:1.0:1788843569.570222:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843569.570268:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134442496:0@lo:400:kworker.0 00000100:00100000:1.0:1788843569.570290:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843569.570323:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134443008:0@lo:400:kworker.0 00000100:00100000:1.0:1788843569.570344:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843569.570367:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788843569.570373:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007240a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134442112:0@lo:400:kworker.0 00000100:00100000:1.0:1788843569.570408:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843569.570426:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134442624:0@lo:400:kworker.0 00000100:00100000:1.0:1788843569.570446:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843569.570460:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134443136:0@lo:400:kworker.0 00000100:00100000:1.0:1788843569.570481:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843569.570515:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134441984 00000100:00100000:1.0:1788843569.570522:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134441984 00000100:00100000:1.0:1788843569.570562:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134442496 00000100:00100000:1.0:1788843569.570565:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134442496 00000100:00100000:1.0:1788843569.570586:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134443008 00000100:00100000:1.0:1788843569.570589:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134443008 00000100:00100000:1.0:1788843569.570599:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134442624 00000100:00100000:1.0:1788843569.570602:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134442624 00000100:00100000:1.0:1788843569.570616:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788843569.570626:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134441984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843569.570699:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134441984:12345-0@lo:400:kworker.0 Request processed in 74us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843569.570707:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788843569.570725:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788843569.570732:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134442496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843569.570756:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134442496:12345-0@lo:400:kworker.0 Request processed in 25us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843569.570761:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788843569.570771:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788843569.570776:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134443008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843569.570801:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134443008:12345-0@lo:400:kworker.0 Request processed in 25us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843569.570806:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788843569.570816:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788843569.570822:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134442624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843569.570863:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134442624:12345-0@lo:400:kworker.0 Request processed in 41us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843569.570869:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788843569.570896:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134442112 00000100:00100000:1.0:1788843569.570900:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134442112 00000100:00100000:1.0:1788843569.570925:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788843569.570932:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134442112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843569.570966:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134442112:12345-0@lo:400:kworker.0 Request processed in 35us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843569.570972:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788843569.571002:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134443136 00000100:00100000:1.0:1788843569.571006:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134443136 00000100:00100000:1.0:1788843569.571033:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788843569.571040:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134443136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843569.571072:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134443136:12345-0@lo:400:kworker.0 Request processed in 33us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843569.571078:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788843569.571116:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007240a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134442112:0@lo:400:kworker.0 00010000:00080000:1.0:1788843569.571133:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0079a7b80 x1875738134442624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843569.571166:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134442624:0@lo:400:kworker.0 00000100:00100000:1.0:1788843569.571177:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134443136:0@lo:400:kworker.0 00000100:00100000:1.0:1788843569.571188:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134441984:0@lo:400:kworker.0 00000100:00100000:1.0:1788843569.571197:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134442496:0@lo:400:kworker.0 00010000:00080000:1.0:1788843569.571206:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0079a6680 x1875738134443008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843569.571215:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134443008:0@lo:400:kworker.0 00000100:00080000:1.0:1788843569.571257:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788843569.571262:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788843569.571264:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843569.571275:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134442240:0@lo:400:kworker.0 00000100:00100000:1.0:1788843569.571304:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843569.571322:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134442752:0@lo:400:kworker.0 00000100:00100000:1.0:1788843569.571355:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843569.571375:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134443264:0@lo:400:kworker.0 00000100:00100000:1.0:1788843569.571407:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843569.571429:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788843569.571436:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134441856:0@lo:400:kworker.0 00000100:00100000:1.0:1788843569.571462:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843569.571488:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007242a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134442368:0@lo:400:kworker.0 00000100:00100000:1.0:1788843569.571507:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843569.571521:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1875738134442880:0@lo:400:kworker.0 00000100:00100000:1.0:1788843569.571538:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843569.571557:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134442240 00000100:00100000:1.0:1788843569.571561:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134442240 00000100:00100000:1.0:1788843569.571580:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134442880 00000100:00100000:1.0:1788843569.571583:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134442880 00000100:00100000:1.0:1788843569.571599:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788843569.571604:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134442240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843569.571636:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134442240:12345-0@lo:400:kworker.0 Request processed in 31us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843569.571642:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788843569.571653:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788843569.571658:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1875738134442880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843569.571681:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1875738134442880:12345-0@lo:400:kworker.0 Request processed in 23us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843569.571686:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788843569.571701:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134442752 00000100:00100000:1.0:1788843569.571704:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134442752 00000100:00100000:1.0:1788843569.571738:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134443264 00000100:00100000:1.0:1788843569.571742:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134443264 00000100:00100000:1.0:1788843569.571765:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788843569.571771:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134442752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843569.571803:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134442752:12345-0@lo:400:kworker.0 Request processed in 34us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843569.571809:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788843569.571822:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788843569.571829:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134443264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843569.571858:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134443264:12345-0@lo:400:kworker.0 Request processed in 30us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843569.571864:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788843569.571887:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134441856 00000100:00100000:1.0:1788843569.571891:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134441856 00000100:00100000:1.0:1788843569.571920:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1788843569.571928:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3632:x1875738134441856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843569.571957:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3632:x1875738134441856:12345-0@lo:400:kworker.0 Request processed in 31us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843569.571964:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1788843569.571995:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134442368 00000100:00100000:1.0:1788843569.571999:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134442368 00000100:00100000:1.0:1788843569.572022:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788843569.572030:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134442368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843569.572064:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134442368:12345-0@lo:400:kworker.0 Request processed in 36us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843569.572070:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:1.0:1788843569.572098:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788843569.572107:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788843569.572109:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843569.572131:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134441856:0@lo:400:kworker.0 00000100:00100000:1.0:1788843569.572164:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007242a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134442368:0@lo:400:kworker.0 00000100:00100000:1.0:1788843569.572177:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1875738134442880:0@lo:400:kworker.0 00000100:00100000:1.0:1788843569.572187:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134442240:0@lo:400:kworker.0 00010000:00080000:1.0:1788843569.572197:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0079a5c00 x1875738134442752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843569.572207:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134442752:0@lo:400:kworker.0 00000100:00100000:1.0:1788843569.572220:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134443264:0@lo:400:kworker.0 00000100:00100000:0.0:1788843570.077575:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134443392:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788843570.077649:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843570.078367:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134443520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843570.078415:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843570.078514:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788843570.078525:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134443648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843570.078550:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843570.078621:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134443392 00000100:00100000:0.0:1788843570.078629:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134443392 00000100:00100000:0.0:1788843570.078662:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134443520 00000100:00100000:0.0:1788843570.078665:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134443520 00000100:00100000:0.0:1788843570.078676:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134443648 00000100:00100000:0.0:1788843570.078679:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134443648 00000100:00100000:0.0:1788843570.078692:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788843570.078700:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134443392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788843570.078797:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843570.078923:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134443392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 222us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843570.078931:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788843570.078948:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788843570.078954:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134443520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788843570.078966:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843570.078999:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134443520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843570.079005:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788843570.079017:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788843570.079023:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134443648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788843570.079032:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843570.079244:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134443392:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788843570.079359:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134443648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 332us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843570.079372:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788843570.079419:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134443648:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788843570.079445:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd1054e7800 x1875738134443520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843586 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843570.079459:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134443520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843570.100782:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843570.100820:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843570.100843:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843570.100860:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843570.100883:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843570.100910:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116521216 00000100:00100000:1.0:1788843570.100919:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116521216 00000100:00100000:1.0:1788843570.100970:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116521472 00000100:00100000:1.0:1788843570.100973:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116521472 00000100:00100000:1.0:1788843570.100985:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116521088 00000100:00100000:1.0:1788843570.100988:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116521088 00000100:00100000:1.0:1788843570.100999:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116521344 00000100:00100000:1.0:1788843570.101001:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116521344 00000100:00100000:1.0:1788843570.101015:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 271 00000100:00100000:1.0:1788843570.101024:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2390:x1875738116521216:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843570.101094:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2390:x1875738116521216:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 70us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843570.101124:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 271 00000100:00100000:1.0:1788843570.101166:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 272 00000100:00100000:1.0:1788843570.101174:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2390:x1875738116521472:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843570.101200:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2390:x1875738116521472:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 27us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843570.101206:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 272 00000100:00100000:1.0:1788843570.101219:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 273 00000100:00100000:1.0:1788843570.101226:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2390:x1875738116521088:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843570.101265:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2390:x1875738116521088:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 36us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843570.101271:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 273 00000100:00100000:1.0:1788843570.101282:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 274 00000100:00100000:1.0:1788843570.101288:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2390:x1875738116521344:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843570.101310:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2390:x1875738116521344:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 22us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843570.101316:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 274 00000100:00100000:0.0:1788843570.101324:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116520960 00000100:00100000:0.0:1788843570.101329:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116520960 00000100:00080000:1.0:1788843570.101340:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788843570.101343:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788843570.101358:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 379 00000100:00100000:0.0:1788843570.101365:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e15c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+13:2390:x1875738116520960:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1788843570.101401:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e15c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+13:2390:x1875738116520960:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 36us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843570.101407:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 379 00010000:00010000:0.0:1788843570.333682:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843571.098740:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134443776:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788843571.098809:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843571.099772:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134443776 00000100:00100000:2.0:1788843571.099783:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134443776 00000100:00100000:2.0:1788843571.099831:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788843571.099853:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134443776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788843571.099887:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788843571.106459:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134443776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6606us (7636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843571.106483:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788843571.107197:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134443904:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788843571.107260:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843571.109113:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134443776:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788843571.112210:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134443904 00000100:00100000:0.0:1788843571.112223:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134443904 00000100:00100000:0.0:1788843571.112289:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788843571.112300:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134443904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788843571.112333:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788843571.112446:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134443904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 148us (5186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843571.112454:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788843571.112508:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134443904:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1788843571.114523:0:9500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f25f61b6-5faf-4e05-81a4-dea3dba05dc5 00000020:00000080:1.0:1788843571.114533:0:9500:0:(genops.c:885:class_export_put()) final put ffff9bd141a7b000/f25f61b6-5faf-4e05-81a4-dea3dba05dc5 00000020:00000080:1.0:1788843571.114557:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd141a7b000/f25f61b6-5faf-4e05-81a4-dea3dba05dc5 for lustre-OST0001 00000020:00000080:1.0:1788843571.114601:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd141a7e800 for lustre-OST0001 00010000:00010000:0.0:1788843571.354436:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843572.378321:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788843573.004986:0:14053:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 00:59:30 (1788843570) 00010000:00010000:0.0:1788843573.402653:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843574.430884:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843574.682624:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134444032:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788843574.682747:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843574.682911:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134444032 00000100:00100000:0.0:1788843574.682922:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134444032 00000100:00100000:0.0:1788843574.683005:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788843574.683020:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134444032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788843574.683070:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843574.683128:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134444032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843574.683135:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:3.0:1788843574.683442:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788843574.683481:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007769f80 x1875738134444032/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843590 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843574.683531:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134444032:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788843574.694053:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788843574.694221:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134444288:0@lo:400:kworker.0 00000100:00100000:2.0:1788843574.694320:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843574.694414:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788843574.694421:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134444416:0@lo:400:kworker.0 00000100:00100000:2.0:1788843574.694451:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843574.694493:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134444416 00000100:00100000:2.0:1788843574.694503:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134444416 00000100:00100000:2.0:1788843574.694569:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788843574.694580:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134444416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843574.694644:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134444416:12345-0@lo:400:kworker.0 Request processed in 65us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843574.694654:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788843574.694714:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134444416:0@lo:400:kworker.0 00000100:00100000:0.0:1788843574.695654:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788843574.695688:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1875738134444544:0@lo:400:kworker.0 00000100:00100000:0.0:1788843574.695758:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843574.695853:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134444288 00000100:00100000:0.0:1788843574.695862:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134444288 00000100:00100000:0.0:1788843574.695907:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134444544 00000100:00100000:0.0:1788843574.695910:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134444544 00000100:00100000:0.0:1788843574.695931:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788843574.695940:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134444288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843574.696000:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134444288:12345-0@lo:400:kworker.0 Request processed in 60us (1680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843574.696007:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788843574.696035:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788843574.696041:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1875738134444544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843574.696074:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1875738134444544:12345-0@lo:400:kworker.0 Request processed in 33us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843574.696080:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788843574.696123:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1875738134444544:0@lo:400:kworker.0 00000100:00100000:2.0:1788843574.700882:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134444288:0@lo:400:kworker.0 00000100:00100000:1.0:1788843574.702193:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134444160:0@lo:400:kworker.0 00000100:00100000:1.0:1788843574.702303:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843574.702444:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134444160 00000100:00100000:0.0:1788843574.702455:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134444160 00000100:00100000:0.0:1788843574.702523:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1788843574.702533:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1153f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3630:x1875738134444160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843574.702603:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1153f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3630:x1875738134444160:12345-0@lo:400:kworker.0 Request processed in 71us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843574.702611:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1788843574.702838:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134444160:0@lo:400:kworker.0 00000100:00100000:0.0:1788843574.703155:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1875738134444928:0@lo:400:kworker.0 00000100:00100000:0.0:1788843574.703198:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843574.703223:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788843574.703229:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1875738134444800:0@lo:400:kworker.0 00000100:00100000:0.0:1788843574.703249:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843574.703274:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134444928 00000100:00100000:0.0:1788843574.703278:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134444928 00000100:00100000:0.0:1788843574.703318:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134444800 00000100:00100000:0.0:1788843574.703320:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134444800 00000100:00100000:0.0:1788843574.703340:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788843574.703346:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd136c47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875738134444928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843574.703399:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd136c47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875738134444928:12345-0@lo:400:kworker.0 Request processed in 52us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843574.703405:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788843574.703419:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788843574.703425:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd136c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875738134444800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843574.703452:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd136c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875738134444800:12345-0@lo:400:kworker.0 Request processed in 28us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843574.703457:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00080000:0.0:1788843574.703502:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788843574.703507:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788843574.703530:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1875738134444800:0@lo:400:kworker.0 00010000:00080000:0.0:1788843574.703543:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd1054e7100 x1875738134444928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843574.703554:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1875738134444928:0@lo:400:kworker.0 00000100:00100000:0.0:1788843574.703574:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134444672:0@lo:400:kworker.0 00000100:00100000:0.0:1788843574.703604:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843574.703892:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134445440:0@lo:400:kworker.0 00000100:00100000:0.0:1788843574.703922:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843574.703951:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788843574.703956:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134445312:0@lo:400:kworker.0 00000100:00100000:0.0:1788843574.703979:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843574.704132:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1875738134445184:0@lo:400:kworker.0 00000100:00100000:0.0:1788843574.704180:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843574.704198:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788843574.704204:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134445056:0@lo:400:kworker.0 00000100:00100000:0.0:1788843574.704227:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843574.704243:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134445568:0@lo:400:kworker.0 00000100:00100000:0.0:1788843574.704266:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843574.704290:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134445312 00000100:00100000:0.0:1788843574.704294:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134445312 00000100:00100000:0.0:1788843574.704327:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134445184 00000100:00100000:0.0:1788843574.704329:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134445184 00000100:00100000:0.0:1788843574.704346:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788843574.704351:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd136c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875738134445312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843574.704412:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd136c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875738134445312:12345-0@lo:400:kworker.0 Request processed in 60us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843574.704418:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788843574.704432:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788843574.704438:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1875738134445184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843574.704469:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1875738134445184:12345-0@lo:400:kworker.0 Request processed in 32us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843574.704475:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00080000:0.0:1788843574.704495:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788843574.704498:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788843574.704519:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd1054e7100 x1875738134445312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843574.704531:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134445312:0@lo:400:kworker.0 00000100:00100000:0.0:1788843574.704556:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1875738134445184:0@lo:400:kworker.0 00000100:00100000:1.0:1788843574.704909:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134444672 00000100:00100000:1.0:1788843574.704915:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134444672 00000100:00100000:1.0:1788843574.704960:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788843574.704969:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd136c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134444672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843574.705102:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd136c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134444672:12345-0@lo:400:kworker.0 Request processed in 134us (1495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843574.705109:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788843574.705132:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134445440 00000100:00100000:1.0:1788843574.705136:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134445440 00000100:00100000:1.0:1788843574.705199:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134445056 00000100:00100000:1.0:1788843574.705203:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134445056 00000100:00100000:1.0:1788843574.705218:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134445568 00000100:00100000:1.0:1788843574.705220:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134445568 00000100:00100000:1.0:1788843574.705234:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788843574.705240:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd136c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134445440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843574.705278:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd136c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134445440:12345-0@lo:400:kworker.0 Request processed in 39us (1356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843574.705284:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788843574.705295:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788843574.705301:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134445056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843574.705327:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134445056:12345-0@lo:400:kworker.0 Request processed in 27us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843574.705333:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788843574.705345:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788843574.705373:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134445568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843574.705403:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134445568:12345-0@lo:400:kworker.0 Request processed in 32us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843574.705408:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:1.0:1788843574.705431:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788843574.705434:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788843574.705458:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134445440:0@lo:400:kworker.0 00010000:00080000:0.0:1788843574.705818:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd1054e5880 x1875738134445056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843574.705829:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134445056:0@lo:400:kworker.0 00000100:00100000:0.0:1788843574.705842:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134445568:0@lo:400:kworker.0 00000100:00100000:0.0:1788843574.705852:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134444672:0@lo:400:kworker.0 00000100:00100000:0.0:1788843574.873405:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843574.873573:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116521600 00000100:00100000:2.0:1788843574.873586:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116521600 00000100:00100000:2.0:1788843574.873685:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 40 00000100:00100000:2.0:1788843574.873698:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:11063:x1875738116521600:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788843574.873746:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843574.873778:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031400/0xa762dfcbd58d131c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f224908b0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843574.873870:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030200/0xa762dfcbd58d1323 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843574.873888:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030200/0xa762dfcbd58d1323 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843574.873902:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030200/0xa762dfcbd58d1323 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843574.873958:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788843574.873962:0:6508:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788843574.874005:0:6508:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030200/0xa762dfcbd58d1323 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843574.874031:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031400/0xa762dfcbd58d131c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908b0 expref: 7 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843574.874052:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030200/0xa762dfcbd58d1323 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908b0 expref: 6 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843574.874061:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd13dfda500) 00010000:00010000:2.0:1788843574.874064:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788843574.874067:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd100030200, rc 0) 00000100:00100000:2.0:1788843574.874209:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:11063:x1875738116521600:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 513us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843574.874216:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 40 00000100:00080000:1.0:1788843574.874462:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843574.907723:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843574.907878:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116521728 00000100:00100000:0.0:1788843574.907901:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116521728 00000100:00100000:0.0:1788843574.907993:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 41 00000100:00100000:0.0:1788843574.908006:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:11064:x1875738116521728:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788843574.908255:0:9517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843574.908283:0:9517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d132a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f224908b7 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843574.908377:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1331 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843574.908395:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1331 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843574.908408:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1331 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843574.908424:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1338 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843574.908432:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1338 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843574.908438:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1338 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843574.908517:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c200/0xa762dfcbd58d133f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843574.908525:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c200/0xa762dfcbd58d133f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843574.908532:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c200/0xa762dfcbd58d133f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843574.908581:0:9517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788843574.908592:0:9517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788843574.908619:0:9517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c200/0xa762dfcbd58d133f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843574.908633:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1331 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843574.908640:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1331 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843574.908648:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1331 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843574.908655:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843574.908661:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1331 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843574.908670:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1331 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843574.908685:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd13dfda500) 00010000:00010000:0.0:1788843574.908689:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843574.908694:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1331 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843574.908701:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1331 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843574.908719:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1338 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843574.908726:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1338 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843574.908742:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1338 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843574.908748:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843574.908751:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1338 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843574.908759:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1338 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843574.908768:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9bd0071def00) 00010000:00010000:0.0:1788843574.908771:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843574.908774:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1338 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843574.908780:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1338 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843574.908817:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d132a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908b7 expref: 8 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843574.908833:0:9517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c200/0xa762dfcbd58d133f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908b7 expref: 7 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843574.908841:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bd0071de800) 00010000:00010000:0.0:1788843574.908843:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788843574.908846:0:9517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3c200, rc 0) 00000100:00100000:0.0:1788843574.912858:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:11064:x1875738116521728:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 4834us (5131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843574.912902:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 41 00000100:00100000:3.0:1788843574.922751:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843574.927751:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116521856 00000100:00100000:2.0:1788843574.927773:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116521856 00000100:00100000:2.0:1788843574.927883:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7 00000100:00100000:2.0:1788843574.927906:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:11064:x1875738116521856:12345-192.168.203.33@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788843574.928035:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:11064:x1875738116521856:12345-192.168.203.33@tcp:900:lhsmtool_posix.0 Request processed in 132us (5298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843574.928044:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7 00000100:00100000:3.0:1788843574.931509:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843574.931632:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116522112 00000100:00100000:1.0:1788843574.931644:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116522112 00000100:00100000:1.0:1788843574.931717:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 42 00000100:00100000:1.0:1788843574.931729:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:11064:x1875738116522112:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788843574.931758:0:11996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843574.931786:0:11996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d1346 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f224908be expref: -99 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843574.931897:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d134d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843574.931915:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d134d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843574.931929:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d134d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843574.931948:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d1354 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843574.931979:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d1354 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843574.931987:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d1354 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843574.932135:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35400/0xa762dfcbd58d135b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843574.932189:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35400/0xa762dfcbd58d135b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843574.932196:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35400/0xa762dfcbd58d135b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843574.932208:0:11996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788843574.932317:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d134d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843574.932325:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d134d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843574.932333:0:11996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d134d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843574.932340:0:11996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb35a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843574.932344:0:11996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d134d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843574.932365:0:11996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d134d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843574.932390:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bd0071de800) 00010000:00010000:1.0:1788843574.932393:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843574.932399:0:11996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d134d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843574.932405:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d134d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843574.932420:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d1354 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843574.932426:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d1354 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843574.932432:0:11996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d1354 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843574.932437:0:11996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb35800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843574.932441:0:11996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d1354 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843574.932447:0:11996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d1354 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843574.932453:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9bd00746c000) 00010000:00010000:1.0:1788843574.932456:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843574.932459:0:11996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d1354 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843574.932464:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d1354 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843574.935395:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d1346 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908be expref: 10 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843574.935430:0:11996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35400/0xa762dfcbd58d135b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908be expref: 9 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843574.935441:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd00746cd00) 00010000:00010000:1.0:1788843574.935445:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843574.935449:0:11996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fb35400, rc 0) 00000100:00100000:1.0:1788843574.935553:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+9:11064:x1875738116522112:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 3824us (4059us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788843574.935564:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 42 00000100:00100000:1.0:1788843574.945638:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843574.945954:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116522240 00000100:00100000:0.0:1788843574.945966:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116522240 00000100:00100000:0.0:1788843574.946049:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 43 00000100:00100000:0.0:1788843574.946062:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+9:11064:x1875738116522240:12345-192.168.203.33@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788843574.946458:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+9:11064:x1875738116522240:12345-192.168.203.33@tcp:59:lhsmtool_posix.0 Request processed in 397us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843574.946468:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 43 00000100:00100000:3.0:1788843574.960616:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843574.965373:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116522368 00000100:00100000:0.0:1788843574.965395:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116522368 00000100:00100000:1.0:1788843574.971739:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 44 00000100:00100000:1.0:1788843574.971757:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:11064:x1875738116522368:12345-192.168.203.33@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1788843574.972051:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1788843574.978608:0:9517:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 5639us 00000100:00100000:0.0:1788843574.994785:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:11064:x1875738116522368:12345-192.168.203.33@tcp:59:lhsmtool_posix.0 Request processed in 23019us (34172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843574.994801:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 44 00000100:00100000:1.0:1788843575.195928:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843575.195962:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134445696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788843575.196072:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843575.196167:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788843575.196176:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134445824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843575.196201:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843575.196232:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134445696 00000100:00100000:1.0:1788843575.196241:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134445696 00000100:00100000:1.0:1788843575.196291:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134445824 00000100:00100000:1.0:1788843575.196293:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134445824 00000100:00100000:1.0:1788843575.196310:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788843575.196329:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007240a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134445696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788843575.196491:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788843575.196559:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007240a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134445696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 230us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843575.196566:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788843575.196587:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788843575.196595:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134445824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788843575.196606:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788843575.196637:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134445824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843575.196642:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00080000:1.0:1788843575.196693:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007243480 x1875738134445824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843591 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843575.196714:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134445824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843575.196751:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134445696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788843575.208766:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788843575.208798:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134445952:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788843575.208907:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843575.208996:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134445952 00000100:00100000:2.0:1788843575.209006:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134445952 00000100:00100000:2.0:1788843575.209072:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788843575.209082:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134445952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788843575.209119:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788843575.209196:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134445952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 115us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843575.209204:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788843575.209260:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134445952:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788843575.216395:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843575.216438:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843575.216468:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843575.216485:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843575.216633:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116522496 00000100:00100000:0.0:1788843575.216646:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116522496 00000100:00100000:0.0:1788843575.216703:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 381 00000100:00100000:0.0:1788843575.216714:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1032f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+13:2389:x1875738116522496:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1788843575.216802:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1032f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+13:2389:x1875738116522496:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 90us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843575.216809:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 381 00000100:00100000:0.0:1788843575.216850:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116522752 00000100:00100000:0.0:1788843575.216853:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116522752 00000100:00100000:0.0:1788843575.216881:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116523008 00000100:00100000:0.0:1788843575.216895:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116523008 00000100:00100000:0.0:1788843575.216922:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116522624 00000100:00100000:0.0:1788843575.216925:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116522624 00000100:00100000:0.0:1788843575.216938:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 281 00000100:00100000:0.0:1788843575.216944:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141aead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2389:x1875738116522752:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1788843575.216975:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141aead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2389:x1875738116522752:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 31us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843575.216982:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 281 00000100:00100000:0.0:1788843575.216994:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 282 00000100:00100000:0.0:1788843575.217001:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2389:x1875738116523008:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1788843575.217035:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2389:x1875738116523008:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 34us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843575.217041:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 282 00000100:00100000:0.0:1788843575.217054:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 283 00000100:00100000:0.0:1788843575.217060:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141aea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+9:2389:x1875738116522624:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1788843575.217103:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141aea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+9:2389:x1875738116522624:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 43us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843575.217109:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 283 00000100:00080000:0.0:1788843575.217303:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788843575.217784:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843575.217822:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116522880 00000100:00100000:3.0:1788843575.217828:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116522880 00000100:00100000:3.0:1788843575.217872:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 284 00000100:00100000:3.0:1788843575.217882:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141aeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2389:x1875738116522880:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843575.217933:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141aeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2389:x1875738116522880:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 53us (1424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843575.217939:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 284 00000100:00080000:0.0:1788843575.218392:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788843575.450415:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788843575.643822:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788843575.647850:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788843576.218551:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134446080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788843576.218650:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843576.218785:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134446080 00000100:00100000:2.0:1788843576.218796:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134446080 00000100:00100000:2.0:1788843576.218858:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788843576.218871:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134446080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788843576.218920:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788843576.218999:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134446080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843576.219025:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788843576.219081:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134446080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788843576.219474:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788843576.219485:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134446208:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788843576.219529:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843576.219602:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134446208 00000100:00100000:2.0:1788843576.219608:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134446208 00000100:00100000:2.0:1788843576.219642:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788843576.219649:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134446208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788843576.219674:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788843576.219717:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134446208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843576.219724:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788843576.219753:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134446208:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788843576.475176:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843577.395692:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843577.399323:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116523136 00000100:00100000:2.0:1788843577.399350:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116523136 00000100:00080000:2.0:1788843577.399578:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843577.399645:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 45 00000100:00100000:0.0:1788843577.399660:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+9:11106:x1875738116523136:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1788843577.399687:0:11996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843577.399729:0:11996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1369 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f224908c5 expref: -99 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843577.399810:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1370 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843577.399827:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1370 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843577.399844:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1370 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843577.399860:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1377 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843577.399868:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1377 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843577.399875:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1377 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843577.399929:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1370 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843577.399937:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1370 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843577.399943:0:11996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1370 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843577.399950:0:11996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3dc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843577.399955:0:11996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1370 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843577.399974:0:11996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1370 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843577.399990:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd13dfda500) 00010000:00010000:0.0:1788843577.399994:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843577.400000:0:11996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1370 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843577.400106:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1370 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843577.400122:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1377 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843577.400128:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1377 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843577.400135:0:11996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1377 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843577.400392:0:11996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3c800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843577.400396:0:11996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1377 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843577.400404:0:11996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1377 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843577.400412:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9bd00658b700) 00010000:00010000:0.0:1788843577.400415:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843577.400418:0:11996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1377 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843577.400435:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1377 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843577.400479:0:11996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1369 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908c5 expref: 10 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843577.400491:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd13dfda500) 00010000:00010000:0.0:1788843577.400561:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843577.400566:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1369 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908c5 expref: 10 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843577.400577:0:11996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3d800, rc 0) 00000100:00100000:0.0:1788843577.400672:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+9:11106:x1875738116523136:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1016us (4994us total) trans 0 rc 301/301 00000100:00100000:0.0:1788843577.400681:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 45 00000100:00100000:3.0:1788843577.420485:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843577.423118:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116523392 00000100:00100000:3.0:1788843577.423223:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116523392 00000100:00100000:3.0:1788843577.423300:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 46 00000100:00100000:3.0:1788843577.423323:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+9:11106:x1875738116523392:12345-192.168.203.33@tcp:36:lfs.0 00010000:00010000:3.0:1788843577.423405:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843577.423442:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030200/0xa762dfcbd58d1323 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908b0 expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.423465:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd13dfda500) 00010000:00010000:3.0:1788843577.423477:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788843577.424999:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d137e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.425271:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d137e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.425285:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d137e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.425302:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae000/0xa762dfcbd58d1385 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.425310:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae000/0xa762dfcbd58d1385 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.425317:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae000/0xa762dfcbd58d1385 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.427780:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af200/0xa762dfcbd58d138c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.427820:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af200/0xa762dfcbd58d138c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.427833:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af200/0xa762dfcbd58d138c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788843577.427869:0:6508:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5a61503 reply state 000000009b905538 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af200/0xa762dfcbd58d138c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.427882:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af200/0xa762dfcbd58d138c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.427891:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bd007730100) 00010000:00010000:3.0:1788843577.427894:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788843577.427899:0:6508:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788843577.427907:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788843577.427917:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d137e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.427924:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d137e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.427931:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d137e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.427937:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7afa00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1788843577.427943:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d137e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.427952:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d137e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.427963:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd007730200) 00010000:00010000:3.0:1788843577.427965:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843577.427969:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d137e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.427986:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d137e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788843577.428023:0:6508:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5a61503 reply state 000000009b905538 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae000/0xa762dfcbd58d1385 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.428033:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae000/0xa762dfcbd58d1385 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.428040:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9bd007730e00) 00010000:00010000:3.0:1788843577.428043:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788843577.428045:0:6508:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788843577.429690:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+10:11106:x1875738116523392:12345-192.168.203.33@tcp:36:lfs.0 Request processed in 6356us (9206us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788843577.429706:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 46 00010000:00010000:0.0:1788843577.498528:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843577.516934:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843577.517048:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116523520 00000100:00100000:1.0:1788843577.517063:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116523520 00000100:00100000:2.0:1788843577.517178:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 47 00000100:00100000:2.0:1788843577.517195:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+10:11114:x1875738116523520:12345-192.168.203.33@tcp:101:lctl.0 00010000:00010000:2.0:1788843577.517229:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843577.517594:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030200/0xa762dfcbd58d1393 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f224908cc expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.517765:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d139a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.517784:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d139a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.517798:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d139a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843577.517855:0:6507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788843577.517859:0:6507:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788843577.517908:0:6507:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d139a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.517957:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030200/0xa762dfcbd58d1393 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908cc expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.517983:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d139a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908cc expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.517994:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd13dfda000) 00010000:00010000:3.0:1788843577.517997:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788843577.518001:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10f7afa00, rc 0) 00000100:00100000:3.0:1788843577.518251:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+11:11114:x1875738116523520:12345-192.168.203.33@tcp:101:lctl.0 Request processed in 1060us (1335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843577.518260:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 47 00000100:00100000:1.0:1788843577.566780:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843577.567190:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116523648 00000100:00100000:0.0:1788843577.567205:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116523648 00000100:00100000:0.0:1788843577.567289:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 48 00000100:00100000:0.0:1788843577.567301:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+11:11120:x1875738116523648:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:0.0:1788843577.567329:0:11996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843577.567367:0:11996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d13a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f224908d3 expref: -99 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843577.567844:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d13a8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843577.568078:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d13a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843577.568091:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d13a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843577.568106:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d13af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843577.568113:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d13af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843577.568118:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d13af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.568594:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031400/0xa762dfcbd58d13b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.568607:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031400/0xa762dfcbd58d13b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.568616:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031400/0xa762dfcbd58d13b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843577.568683:0:11996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788843577.568687:0:11996:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788843577.568754:0:11996:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031400/0xa762dfcbd58d13b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.568770:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d13a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.568777:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d13a8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.568784:0:11996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d13a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.568790:0:11996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3c800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843577.568795:0:11996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d13a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.568938:0:11996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d13a8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.569081:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd13dfda000) 00010000:00010000:2.0:1788843577.569085:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843577.569091:0:11996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d13a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.569098:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d13a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.569116:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d13af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.569133:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d13af lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.569232:0:11996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d13af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.569240:0:11996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3dc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843577.569244:0:11996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d13af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.569250:0:11996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d13af lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.569259:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9bd007730e00) 00010000:00010000:2.0:1788843577.569262:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843577.569265:0:11996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d13af lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.569271:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d13af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.569308:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d13a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908d3 expref: 13 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.569324:0:11996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031400/0xa762dfcbd58d13b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908d3 expref: 12 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.569333:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bd007730100) 00010000:00010000:2.0:1788843577.569348:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788843577.569357:0:11996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd100031400, rc 0) 00000100:00100000:2.0:1788843577.569468:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+12:11120:x1875738116523648:12345-192.168.203.33@tcp:101:bash.0 Request processed in 2156us (2691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843577.569478:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 48 00000100:00100000:1.0:1788843577.574754:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843577.575412:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116523904 00000100:00100000:3.0:1788843577.575428:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116523904 00000100:00100000:3.0:1788843577.575537:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 49 00000100:00100000:3.0:1788843577.575552:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+12:11120:x1875738116523904:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:3.0:1788843577.575582:0:9517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843577.575612:0:9517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af400/0xa762dfcbd58d13bd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f224908da expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.575755:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae400/0xa762dfcbd58d13c4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.575776:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae400/0xa762dfcbd58d13c4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.575788:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae400/0xa762dfcbd58d13c4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.576059:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71400/0xa762dfcbd58d13cb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.576083:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71400/0xa762dfcbd58d13cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.576096:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71400/0xa762dfcbd58d13cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788843577.576629:0:9517:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788843577.576770:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d13d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.577590:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d13d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.577601:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d13d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.577647:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae400/0xa762dfcbd58d13c4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.577655:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae400/0xa762dfcbd58d13c4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.577663:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae400/0xa762dfcbd58d13c4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.577670:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7ae400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1788843577.577674:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae400/0xa762dfcbd58d13c4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.577696:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae400/0xa762dfcbd58d13c4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.577711:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bd007730100) 00010000:00010000:3.0:1788843577.577714:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843577.577718:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae400/0xa762dfcbd58d13c4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.577725:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae400/0xa762dfcbd58d13c4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788843577.577739:0:9517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f66a4934 reply state 0000000016ce7d0b transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71400/0xa762dfcbd58d13cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.577751:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71400/0xa762dfcbd58d13cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.577758:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bd007730200) 00010000:00010000:3.0:1788843577.577760:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788843577.577763:0:9517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788843577.578055:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af400/0xa762dfcbd58d13bd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908da expref: 15 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.578073:0:9517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d13d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908da expref: 14 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.578081:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd007730b00) 00010000:00010000:3.0:1788843577.578093:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788843577.578097:0:9517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd118f70200, rc 0) 00000100:00100000:3.0:1788843577.578212:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+15:11120:x1875738116523904:12345-192.168.203.33@tcp:101:bash.0 Request processed in 2662us (3472us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788843577.578228:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 49 00000100:00100000:3.0:1788843577.584538:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843577.584644:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116524032 00000100:00100000:1.0:1788843577.584660:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116524032 00000100:00100000:1.0:1788843577.584727:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 28 00000100:00100000:1.0:1788843577.584736:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2386:x1875738116524032:12345-192.168.203.33@tcp:8:bash.0 00010000:00080000:1.0:1788843577.584787:0:8423:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f25f61b6-5faf-4e05-81a4-dea3dba05dc5@192.168.203.33@tcp t0 exp 0000000000000000 cur 355 last 0 00000020:00000080:1.0:1788843577.584823:0:8423:0:(genops.c:1385:class_connect()) connect: client f25f61b6-5faf-4e05-81a4-dea3dba05dc5, cookie 0xa762dfcbd58d13e0 00002000:00100000:1.0:1788843577.584836:0:8423:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f25f61b6-5faf-4e05-81a4-dea3dba05dc5/ffff9bd141a7a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788843577.584855:0:8423:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788843577.584938:0:8423:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788843577.584970:0:8423:0:(import.c:65:import_set_state_nolock()) ffff9bd141a78000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843577.585052:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2386:x1875738116524032:12345-192.168.203.33@tcp:8:bash.0 Request processed in 315us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843577.585060:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 28 00000100:00100000:1.0:1788843577.587829:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843577.591356:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116524160 00000100:00100000:2.0:1788843577.591377:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116524160 00000100:00100000:2.0:1788843577.591556:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 29 00000100:00100000:2.0:1788843577.591571:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:0:x1875738116524160:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:2.0:1788843577.591596:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843577.591631:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011fca8f2/0xa762dfcbd58d13e7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f224908e1 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788843577.591665:0:8424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788843577.591692:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=355s v=(0 0) 00010000:00010000:2.0:1788843577.591697:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843577.591709:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011fca8f2/0xa762dfcbd58d13e7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908e1 expref: 7 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.591748:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000011fca8f2/0xa762dfcbd58d13e7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908e1 expref: 7 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.591765:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd100031200, rc 0) 00000100:00100000:2.0:1788843577.591876:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:0:x1875738116524160:12345-192.168.203.33@tcp:101:bash.0 Request processed in 301us (4061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843577.591885:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 29 00000100:00080000:0.0:1788843577.600079:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843577.605252:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843577.605469:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116524288 00000100:00100000:2.0:1788843577.605482:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116524288 00000100:00100000:2.0:1788843577.605636:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 30 00000100:00100000:2.0:1788843577.605649:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141aebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:11120:x1875738116524288:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:2.0:1788843577.605673:0:8421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843577.605698:0:8421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1313e95/0xa762dfcbd58d13ee lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f224908e8 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.605755:0:8421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000011fca8f2/0xa762dfcbd58d13e7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908e1 expref: 8 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.605766:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843577.605772:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843577.605779:0:8421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1313e95/0xa762dfcbd58d13ee lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908e8 expref: 8 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.605828:0:8421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000011fca8f2/0xa762dfcbd58d13e7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908e1 expref: 8 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.605846:0:8421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000011fca8f2/0xa762dfcbd58d13e7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908e1 expref: 8 pid: 8424 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843577.605863:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8421:1875738134446336:192.168.203.33@tcp:104: 00000100:00100000:2.0:1788843577.605989:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd104a356c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843577.611878:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843577.612290:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8421:1875738134446336:192.168.203.33@tcp:104: 00010000:00010000:2.0:1788843577.612325:0:8421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c1313e95/0xa762dfcbd58d13ee lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908e8 expref: 8 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.612380:0:8421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd100030200, rc 0) 00000100:00100000:2.0:1788843577.612522:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141aebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:11120:x1875738116524288:12345-192.168.203.33@tcp:101:bash.0 Request processed in 6874us (7285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843577.612531:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 30 00000100:00100000:1.0:1788843577.612646:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116524416 00000100:00100000:1.0:1788843577.612654:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116524416 00010000:00010000:1.0:1788843577.612691:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000011fca8f2/0xa762dfcbd58d13e7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908e1 expref: 8 pid: 8424 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843577.612727:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 52 00000100:00100000:1.0:1788843577.612738:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13332f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:2389:x1875738116524416:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843577.612753:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843577.612774:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000011fca8f2/0xa762dfcbd58d13e7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908e1 expref: 8 pid: 8424 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843577.612788:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000011fca8f2/0xa762dfcbd58d13e7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908e1 expref: 8 pid: 8424 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843577.612814:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011fca8f2/0xa762dfcbd58d13e7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908e1 expref: 8 pid: 8424 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843577.612836:0:7448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843577.612841:0:7448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843577.612849:0:7448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1313e95/0xa762dfcbd58d13ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908e8 expref: 7 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843577.612859:0:7448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1313e95/0xa762dfcbd58d13ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908e8 expref: 7 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843577.612901:0:7448:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c1313e95/0xa762dfcbd58d13ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908e8 expref: 7 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843577.612916:0:7448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fb8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7448:1875738134446464:192.168.203.33@tcp:105: 00000100:00100000:1.0:1788843577.612979:0:7448:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007722000 going to sleep for 11 seconds 00000100:00100000:1.0:1788843577.626207:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843577.626556:0:7448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fb8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7448:1875738134446464:192.168.203.33@tcp:105: 00010000:00010000:2.0:1788843577.626591:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843577.626663:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13332f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2389:x1875738116524416:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 13927us (14793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843577.626677:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 52 00000100:00100000:3.0:1788843577.629207:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116524672 00000100:00100000:3.0:1788843577.629227:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116524672 00000100:00100000:3.0:1788843577.629380:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 6 00000100:00100000:3.0:1788843577.629393:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+15:11120:x1875738116524672:12345-192.168.203.33@tcp:35:bash.0 00000100:00100000:3.0:1788843577.629789:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+16:11120:x1875738116524672:12345-192.168.203.33@tcp:35:bash.0 Request processed in 397us (3593us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788843577.629797:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 6 00000100:00100000:1.0:1788843577.737846:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843577.738029:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116524928 00000100:00100000:3.0:1788843577.738043:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116524928 00000100:00100000:3.0:1788843577.738135:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 50 00000100:00100000:3.0:1788843577.738323:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+16:11130:x1875738116524928:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1788843577.738374:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843577.738402:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d13f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f224908ef expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843577.738541:0:6507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788843577.738668:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d13f5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908ef expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.738686:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd13dfda000) 00010000:00010000:3.0:1788843577.738690:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788843577.738713:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d13f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908ef expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.738731:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd118f71e00, rc 0) 00000100:00100000:3.0:1788843577.739129:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+17:11130:x1875738116524928:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 618us (1107us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1788843577.747804:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 50 00000100:00100000:1.0:1788843577.748242:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843577.748542:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116525184 00000100:00100000:0.0:1788843577.748554:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116525184 00000100:00100000:0.0:1788843577.748615:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7 00000100:00100000:0.0:1788843577.748627:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+17:11130:x1875738116525184:12345-192.168.203.33@tcp:35:lfs.0 00000100:00100000:0.0:1788843577.748947:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+18:11130:x1875738116525184:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 319us (706us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788843577.748957:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7 00000100:00100000:1.0:1788843577.887875:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843577.888601:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116525312 00000100:00100000:2.0:1788843577.888617:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116525312 00000100:00100000:2.0:1788843577.888744:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 51 00000100:00100000:2.0:1788843577.888757:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+18:11136:x1875738116525312:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1788843577.888801:0:11996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843577.888830:0:11996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031200/0xa762dfcbd58d1403 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f224908f6 expref: -99 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.888917:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d140a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.888934:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d140a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.888947:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d140a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843577.889422:0:11996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788843577.889427:0:11996:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788843577.889462:0:11996:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d140a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.889502:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031200/0xa762dfcbd58d1403 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908f6 expref: 20 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.889527:0:11996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d140a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908f6 expref: 19 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.889536:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bd007730100) 00010000:00010000:2.0:1788843577.889539:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788843577.889543:0:11996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007946a00, rc 0) 00000100:00100000:2.0:1788843577.889700:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+19:11136:x1875738116525312:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 945us (1840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843577.889734:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 51 00000100:00100000:1.0:1788843577.898924:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843577.899121:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116525568 00000100:00100000:3.0:1788843577.899135:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116525568 00000100:00100000:3.0:1788843577.899270:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 52 00000100:00100000:3.0:1788843577.899282:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+19:11136:x1875738116525568:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1788843577.899308:0:9517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843577.899344:0:9517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d1411 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f224908fd expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.899523:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d1418 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.899542:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d1418 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.899555:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d1418 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843577.899568:0:9517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788843577.899710:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d1411 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908fd expref: 22 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.899733:0:9517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d1418 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908fd expref: 21 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843577.899751:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd007730b00) 00010000:00010000:3.0:1788843577.899755:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788843577.899759:0:9517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd118f70000, rc 0) 00000100:00100000:3.0:1788843577.899858:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+21:11136:x1875738116525568:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 577us (950us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788843577.899866:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 52 00000100:00100000:0.0:1788843577.907458:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843577.907521:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843577.907622:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116525952 00000100:00100000:1.0:1788843577.907635:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116525952 00000100:00100000:1.0:1788843577.907715:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 3 00000100:00100000:1.0:1788843577.907727:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+21:2388:x1875738116525952:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843577.907748:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843577.907779:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d1418 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908fd expref: 21 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843577.907834:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd007730b00) 00010000:00010000:1.0:1788843577.907841:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843577.907918:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+20:2388:x1875738116525952:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 193us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843577.907928:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 3 00000100:00100000:2.0:1788843577.908657:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116525824 00000100:00100000:2.0:1788843577.908667:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116525824 00000100:00100000:2.0:1788843577.908715:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 53 00000100:00100000:2.0:1788843577.908724:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+20:11136:x1875738116525824:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1788843577.908751:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843577.908772:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1426 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490904 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.908923:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947800/0xa762dfcbd58d142d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.908954:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947800/0xa762dfcbd58d142d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.908968:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947800/0xa762dfcbd58d142d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843577.908982:0:6507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788843577.909850:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1426 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490904 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.909876:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947800/0xa762dfcbd58d142d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490904 expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.909886:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd007730b00) 00010000:00010000:2.0:1788843577.909889:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788843577.909893:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007947800, rc 0) 00000100:00100000:2.0:1788843577.909979:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+22:11136:x1875738116525824:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1255us (2535us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788843577.909988:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 53 00000100:00100000:0.0:1788843577.925974:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843577.926100:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116526080 00000100:00100000:2.0:1788843577.926113:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116526080 00000100:00100000:2.0:1788843577.926249:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 31 00000100:00100000:2.0:1788843577.926262:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2390:x1875738116526080:12345-192.168.203.33@tcp:1:lfs.0 00010000:00010000:2.0:1788843577.926325:0:8424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4e75d57/0xa762dfcbd58d143b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.926657:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1313e95/0xa762dfcbd58d13ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908e8 expref: 7 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.926687:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843577.926693:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788843577.926700:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4e75d57/0xa762dfcbd58d143b lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.926747:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c1313e95/0xa762dfcbd58d13ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908e8 expref: 7 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.926763:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c1313e95/0xa762dfcbd58d13ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908e8 expref: 7 pid: 8421 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843577.926795:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8424:1875738134446592:192.168.203.33@tcp:104: 00000100:00100000:2.0:1788843577.926964:0:8424:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd104a35600 going to sleep for 11 seconds 00000100:00100000:1.0:1788843577.937063:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843577.937104:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8424:1875738134446592:192.168.203.33@tcp:104: 00010000:00010000:2.0:1788843577.938310:0:8424:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e4e75d57/0xa762dfcbd58d143b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843577.940222:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116526208 00000100:00100000:2.0:1788843577.940242:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116526208 00002000:00100000:2.0:1788843577.940323:0:8427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9bd102fba300 x1875738116526208/t0(0) o4->f25f61b6-5faf-4e05-81a4-dea3dba05dc5@192.168.203.33@tcp:193/0 lens 504/0 e 0 to 0 dl 1788843588 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788843577.940346:0:8427:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd102fba300 with x1875738116526208 ext(0->12) 00010000:00010000:2.0:1788843577.940358:0:8427:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c1313e95/0xa762dfcbd58d13ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908e8 expref: 8 pid: 8421 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.940406:0:8427:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c1313e95/0xa762dfcbd58d13ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908e8 expref: 8 pid: 8421 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788843577.940415:0:8427:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bd102fba300 00000100:00100000:2.0:1788843577.940472:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 0 00000100:00100000:2.0:1788843577.940483:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:2390:x1875738116526208:12345-192.168.203.33@tcp:4:lfs.0 00000001:00100000:1.0:1788843577.962356:0:8417:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f25f61b6-5faf-4e05-81a4-dea3dba05dc5 00000100:00100000:2.0:1788843577.963255:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+9:2390:x1875738116526208:12345-192.168.203.33@tcp:4:lfs.0 Request processed in 22757us (26186us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788843577.963268:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 0 00002000:00100000:2.0:1788843577.963281:0:8427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9bd102fba300 x1875738116526208/t4294967300(0) o4->f25f61b6-5faf-4e05-81a4-dea3dba05dc5@192.168.203.33@tcp:193/0 lens 504/448 e 0 to 0 dl 1788843588 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788843577.963292:0:8427:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd102fba300 with x1875738116526208 ext(0->12) 00010000:00010000:2.0:1788843577.963302:0:8427:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c1313e95/0xa762dfcbd58d13ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908e8 expref: 9 pid: 8421 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.963320:0:8427:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c1313e95/0xa762dfcbd58d13ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908e8 expref: 9 pid: 8421 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788843577.963327:0:8427:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bd102fba300 00000100:00100000:0.0:1788843577.973778:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843577.973888:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116526336 00000100:00100000:2.0:1788843577.973899:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116526336 00010000:00010000:2.0:1788843577.973942:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c1313e95/0xa762dfcbd58d13ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908e8 expref: 9 pid: 8421 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843577.974012:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 53 00000100:00100000:2.0:1788843577.974022:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+9:2387:x1875738116526336:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843577.974451:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788843577.974471:0:6492:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788843577.974474:0:6492:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788843576 00002000:00010000:2.0:1788843577.974477:0:6492:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788843577 00002000:00010000:2.0:1788843577.974479:0:6492:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788843576 00002000:00010000:2.0:1788843577.974481:0:6492:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788843577.974488:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c1313e95/0xa762dfcbd58d13ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908e8 expref: 9 pid: 8421 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.974503:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c1313e95/0xa762dfcbd58d13ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908e8 expref: 9 pid: 8421 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.974530:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1313e95/0xa762dfcbd58d13ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908e8 expref: 9 pid: 8421 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.974548:0:6492:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=1s v=(1 0) 00010000:00010000:2.0:1788843577.974552:0:6492:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 1) 00010000:00010000:2.0:1788843577.974558:0:6492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e4e75d57/0xa762dfcbd58d143b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.974568:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4e75d57/0xa762dfcbd58d143b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843577.974673:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843577.974738:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:2387:x1875738116526336:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 717us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843577.974746:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 53 00010000:00010000:1.0:1788843577.987635:0:8424:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e4e75d57/0xa762dfcbd58d143b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843577.987659:0:8424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4e75d57/0xa762dfcbd58d143b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843577.987694:0:8424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4e75d57/0xa762dfcbd58d143b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843577.987703:0:8424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4e75d57/0xa762dfcbd58d143b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843577.987712:0:8424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4e75d57/0xa762dfcbd58d143b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843577.987718:0:8424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947400 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843577.987734:0:8424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4e75d57/0xa762dfcbd58d143b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843577.987765:0:8424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4e75d57/0xa762dfcbd58d143b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843577.987786:0:8424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4e75d57/0xa762dfcbd58d143b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843577.987795:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4e75d57/0xa762dfcbd58d143b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843577.987895:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2390:x1875738116526080:12345-192.168.203.33@tcp:1:lfs.0 Request processed in 61630us (61932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843577.987904:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 31 00000100:00100000:0.0:1788843578.005362:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843578.005584:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116526592 00000100:00100000:2.0:1788843578.005594:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116526592 00000100:00100000:2.0:1788843578.005647:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 8 00000100:00100000:2.0:1788843578.005658:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd006754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+22:11136:x1875738116526592:12345-192.168.203.33@tcp:35:lfs.0 00000004:00010000:2.0:1788843578.005721:0:6510:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947800/0xa762dfcbd58d142d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490904 expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788843578.005951:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1788843578.006013:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788843578.006456:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1788843578.006492:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1442 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.006508:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d13d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908da expref: 26 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.006516:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1442 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.006551:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d13d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908da expref: 26 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.006565:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d13d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908da expref: 26 pid: 9517 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843578.006588:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6510:1875738134446720:192.168.203.33@tcp:104: 00000100:00100000:2.0:1788843578.006685:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd104a35000 going to sleep for 11 seconds 00000100:00100000:0.0:1788843578.021454:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843578.021575:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116526720 00000100:00100000:1.0:1788843578.021585:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116526720 00010000:00010000:1.0:1788843578.021626:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d13d2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908da expref: 27 pid: 9517 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843578.021671:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 54 00000100:00100000:1.0:1788843578.021685:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd006754380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+27:2389:x1875738116526720:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843578.021700:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843578.021707:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d13d2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908da expref: 27 pid: 9517 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843578.021730:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d13d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908da expref: 27 pid: 9517 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843578.021771:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd007730b00) 00010000:00010000:1.0:1788843578.021776:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1442 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843578.021786:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1442 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843578.021792:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1442 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843578.021813:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843578.021869:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd006754380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+27:2389:x1875738116526720:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 190us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843578.021877:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 54 00010000:00010000:2.0:1788843578.022484:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d13d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908da expref: 26 pid: 9517 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843578.022505:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6510:1875738134446720:192.168.203.33@tcp:104: 00010000:00010000:2.0:1788843578.022531:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1442 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.022541:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1442 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.022547:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1442 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788843578.022657:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:2.0:1788843578.022764:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1788843578.022848:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6510:1875738134446848:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788843578.022896:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843578.022929:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd104a35e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788843578.023059:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134446848 00000100:00100000:3.0:1788843578.023065:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134446848 00000100:00100000:3.0:1788843578.023131:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788843578.023164:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6510:x1875738134446848:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788843578.023249:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6510:x1875738134446848:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 110us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843578.023256:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788843578.023290:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6510:1875738134446848:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:2.0:1788843578.023439:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788843578.023710:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:3.0:1788843578.026192:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141aea680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6510:1875738134446976:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788843578.026282:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843578.026320:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1092b8840 going to sleep for 11 seconds 00000100:00100000:2.0:1788843578.026691:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134446976 00000100:00100000:2.0:1788843578.026698:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134446976 00000100:00100000:2.0:1788843578.026755:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788843578.026765:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1060d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6510:x1875738134446976:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788843578.026909:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1060d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6510:x1875738134446976:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 145us (626us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788843578.026923:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788843578.027182:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141aea680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6510:1875738134446976:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788843578.027375:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1788843578.027416:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1442 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843578.027427:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1442 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843578.027434:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1442 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843578.027440:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843578.027444:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1442 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843578.027451:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1442 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843578.027465:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd007730b00) 00010000:00010000:0.0:1788843578.027468:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788843578.027472:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1442 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843578.027478:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1442 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788843578.027584:0:6510:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788843578.027647:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1788843578.027658:0:6510:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 356080516654ns, next at 357080514868ns, rc = 0 00000001:00080000:0.0:1788843578.027665:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:0.0:1788843578.027698:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd007730b00) 00010000:00010000:0.0:1788843578.027701:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788843578.027708:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947800/0xa762dfcbd58d142d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490904 expref: 30 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843578.027809:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd006754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+29:11136:x1875738116526592:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 22153us (22457us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1788843578.027819:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 8 00000020:00080000:0.0:1788843578.027823:0:6510:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788843578.040713:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843578.040779:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116526848 00000100:00100000:2.0:1788843578.040790:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116526848 00000100:00100000:2.0:1788843578.040853:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 54 00000100:00100000:2.0:1788843578.040863:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd006754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+29:11136:x1875738116526848:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1788843578.040889:0:11996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843578.040913:0:11996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d1449 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f2249090b expref: -99 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.040987:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d1449 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249090b expref: 30 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.041002:0:11996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d1449 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249090b expref: 30 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.041020:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:2.0:1788843578.041023:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788843578.041027:0:11996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007947c00, rc 0) 00000100:00100000:2.0:1788843578.041087:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd006754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+30:11136:x1875738116526848:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 225us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843578.041093:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 54 00000100:00100000:1.0:1788843578.043935:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843578.046820:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116527104 00000100:00100000:3.0:1788843578.046837:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116527104 00000100:00100000:3.0:1788843578.046960:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 9 00000100:00100000:3.0:1788843578.046972:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd133000c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+30:11136:x1875738116527104:12345-192.168.203.33@tcp:35:lfs.0 00000100:00100000:3.0:1788843578.047233:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd133000c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+31:11136:x1875738116527104:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 263us (3309us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1788843578.047259:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 9 00000100:00100000:0.0:1788843578.183515:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843578.183755:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116527360 00000100:00100000:3.0:1788843578.183765:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116527360 00000100:00100000:3.0:1788843578.183827:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 55 00000100:00100000:3.0:1788843578.183837:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd006755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+31:11146:x1875738116527360:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1788843578.183860:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843578.183881:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d1450 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490912 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843578.183978:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788843578.184095:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d1450 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490912 expref: 33 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.184111:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd13dfda000) 00010000:00010000:3.0:1788843578.184123:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788843578.184129:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d1450 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490912 expref: 33 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.184176:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd118f71e00, rc 0) 00000100:00100000:3.0:1788843578.184562:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd006755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+32:11146:x1875738116527360:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 725us (1066us total) trans 4294967329 rc 301/301 00000100:00100000:3.0:1788843578.184571:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 55 00000100:00100000:1.0:1788843578.195138:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843578.195667:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116527488 00000100:00100000:2.0:1788843578.195677:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116527488 00000100:00100000:2.0:1788843578.195737:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 56 00000100:00100000:2.0:1788843578.195747:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+32:11146:x1875738116527488:12345-192.168.203.33@tcp:34:lfs.0 00010000:00010000:2.0:1788843578.195832:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d145e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.195866:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d145e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.195879:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d145e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.195892:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1465 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.195900:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1465 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.195906:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1465 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.195981:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d146c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.195990:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d146c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.195997:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d146c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788843578.196053:0:6507:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d146c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.196067:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d145e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.196074:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d145e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.196090:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d145e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.196096:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843578.196101:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d145e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.196110:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d145e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.196134:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bd007730100) 00010000:00010000:2.0:1788843578.196137:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843578.196169:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d145e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.196175:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d145e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.196190:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1465 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.196195:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1465 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.196200:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1465 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.196214:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843578.196217:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1465 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.196231:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1465 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.196239:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bd007730200) 00010000:00010000:2.0:1788843578.196241:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843578.200615:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1465 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.200628:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1465 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.200651:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d146c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.200657:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d146c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.200665:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d146c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.200670:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843578.200675:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d146c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.200682:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d146c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.200696:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:2.0:1788843578.200699:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843578.200702:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d146c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.200727:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d146c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843578.200807:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+32:11146:x1875738116527488:12345-192.168.203.33@tcp:34:lfs.0 Request processed in 5058us (5675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843578.200816:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 56 00000100:00100000:2.0:1788843578.213254:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843578.213360:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116527744 00000100:00100000:0.0:1788843578.213381:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116527744 00000100:00100000:0.0:1788843578.213447:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 10 00000100:00100000:0.0:1788843578.213458:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+32:11146:x1875738116527744:12345-192.168.203.33@tcp:35:lfs.0 00000100:00100000:0.0:1788843578.213688:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+33:11146:x1875738116527744:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 232us (442us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788843578.213696:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 10 00000100:00100000:0.0:1788843578.276811:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843578.276896:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116528000 00000100:00100000:3.0:1788843578.276906:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116528000 00000100:00100000:3.0:1788843578.276966:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 57 00000100:00100000:3.0:1788843578.276976:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd006754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+33:11149:x1875738116528000:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1788843578.277030:0:9517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843578.277061:0:9517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d1473 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490919 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.277167:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d147a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.277184:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d147a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.277195:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d147a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.277207:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d1481 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.277214:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d1481 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.277220:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d1481 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.277320:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1488 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.277340:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1488 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.277348:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1488 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843578.277358:0:9517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788843578.277449:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d147a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.277458:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d147a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.277464:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d147a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.277471:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd118f71c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1788843578.277475:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d147a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.277482:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d147a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.277495:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bd007730100) 00010000:00010000:3.0:1788843578.277498:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843578.277503:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d147a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.277509:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d147a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.277521:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d1481 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.277526:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d1481 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.277532:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d1481 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.277546:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd118f70600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1788843578.277550:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d1481 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.277556:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d1481 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.277565:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bd007730200) 00010000:00010000:3.0:1788843578.277567:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843578.277569:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d1481 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.277575:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d1481 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.277614:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d1473 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490919 expref: 36 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.277628:0:9517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1488 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490919 expref: 35 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.277634:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:3.0:1788843578.277637:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788843578.277640:0:9517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd118f70200, rc 0) 00000100:00100000:3.0:1788843578.277705:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd006754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+35:11149:x1875738116528000:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 730us (915us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1788843578.277712:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 57 00000100:00100000:1.0:1788843578.283811:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843578.284432:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116528128 00000100:00100000:3.0:1788843578.284460:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116528128 00000100:00100000:3.0:1788843578.284525:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 58 00000100:00100000:3.0:1788843578.284535:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+35:11149:x1875738116528128:12345-192.168.203.33@tcp:54:lfs.0 00010000:00010000:3.0:1788843578.284604:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d1496 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.284622:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d1496 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.284634:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d1496 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.284668:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d1496 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.284675:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d1496 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.284682:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d1496 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.284688:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd118f70000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1788843578.284692:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d1496 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.284699:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d1496 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.284711:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:3.0:1788843578.284714:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788843578.284719:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d1496 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.284736:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d1496 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843578.284822:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+35:11149:x1875738116528128:12345-192.168.203.33@tcp:54:lfs.0 Request processed in 288us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843578.284830:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 58 00000100:00100000:2.0:1788843578.288452:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843578.288594:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116528384 00000100:00100000:0.0:1788843578.288603:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116528384 00000100:00100000:0.0:1788843578.288662:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 11 00000100:00100000:0.0:1788843578.288673:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+35:11149:x1875738116528384:12345-192.168.203.33@tcp:35:lfs.0 00000100:00100000:0.0:1788843578.288923:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+36:11149:x1875738116528384:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 251us (479us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788843578.288930:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 11 00010000:00010000:0.0:1788843578.522462:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843578.550530:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843578.552240:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116528640 00000100:00100000:2.0:1788843578.552262:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116528640 00000100:00100000:2.0:1788843578.552385:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 59 00000100:00100000:2.0:1788843578.552399:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1060d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+36:11180:x1875738116528640:12345-192.168.203.33@tcp:101:cat.0 00010000:00010000:2.0:1788843578.552435:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843578.552465:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d149d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490920 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.552614:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d14a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.552633:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d14a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.552645:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d14a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843578.552658:0:6507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788843578.553798:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d149d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490920 expref: 39 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.553979:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d14a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490920 expref: 38 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.553990:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:2.0:1788843578.554304:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843578.554310:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007946800, rc 0) 00000100:00100000:2.0:1788843578.554433:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1060d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+38:11180:x1875738116528640:12345-192.168.203.33@tcp:101:cat.0 Request processed in 2034us (3919us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1788843578.554442:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 59 00000100:00100000:1.0:1788843578.566217:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843578.566283:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843578.566631:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116528768 00000100:00100000:2.0:1788843578.566645:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116528768 00000100:00100000:2.0:1788843578.566742:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 4 00000100:00100000:2.0:1788843578.566754:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+38:2388:x1875738116528768:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843578.566805:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843578.566841:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d14a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490920 expref: 38 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843578.566867:0:7448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:2.0:1788843578.566873:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843578.566950:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+37:2388:x1875738116528768:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 198us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843578.566959:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 4 00000100:00100000:0.0:1788843578.567044:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116529024 00000100:00100000:0.0:1788843578.567049:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116529024 00000100:00100000:0.0:1788843578.567095:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 12 00000100:00100000:0.0:1788843578.567103:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+37:11180:x1875738116529024:12345-192.168.203.33@tcp:35:cat.0 00000100:00100000:0.0:1788843578.567443:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+38:11180:x1875738116529024:12345-192.168.203.33@tcp:35:cat.0 Request processed in 340us (1241us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1788843578.567468:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 12 00000100:00100000:1.0:1788843578.652095:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843578.652259:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116529280 00000100:00100000:0.0:1788843578.652273:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116529280 00000100:00100000:0.0:1788843578.652365:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 60 00000100:00100000:0.0:1788843578.652377:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+38:11186:x1875738116529280:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1788843578.652409:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843578.652413:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788843578.652449:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d140a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908f6 expref: 38 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843578.652492:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bd007730100) 00010000:00010000:0.0:1788843578.652498:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788843578.652515:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d14b2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490927 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843578.652657:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d14b9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843578.652676:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1488 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490919 expref: 38 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843578.652685:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d14b9 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843578.652740:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1488 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490919 expref: 38 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843578.652756:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1488 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490919 expref: 38 pid: 9517 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843578.652771:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006757800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6506:1875738134447104:192.168.203.33@tcp:104: 00000100:00100000:0.0:1788843578.652908:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10529ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1788843578.661849:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843578.662052:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006757800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6506:1875738134447104:192.168.203.33@tcp:104: 00010000:00010000:0.0:1788843578.662092:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d14b9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843578.662222:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116529408 00000100:00100000:3.0:1788843578.662232:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116529408 00010000:00010000:3.0:1788843578.662279:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1488 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490919 expref: 39 pid: 9517 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843578.662323:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 55 00000100:00100000:3.0:1788843578.662345:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+39:2389:x1875738116529408:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843578.662373:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843578.662381:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1488 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490919 expref: 39 pid: 9517 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.662394:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1488 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490919 expref: 39 pid: 9517 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.662422:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1488 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490919 expref: 39 pid: 9517 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.662443:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:3.0:1788843578.662449:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d14b9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.662491:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d14b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.662502:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d14b9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.662538:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843578.662812:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+38:2389:x1875738116529408:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 459us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843578.662820:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 55 00010000:00010000:1.0:1788843578.663344:0:6506:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d14b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843578.663363:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d14b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843578.663389:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788843578.663785:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d14b2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490927 expref: 39 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843578.664136:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d14b9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490927 expref: 38 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843578.664203:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:1.0:1788843578.664206:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788843578.664210:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3d000, rc 0) 00000100:00100000:1.0:1788843578.664809:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+38:11186:x1875738116529280:12345-192.168.203.33@tcp:101:dd.0 Request processed in 12418us (12714us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1788843578.664820:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 60 00000100:00100000:1.0:1788843578.682634:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843578.682731:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116529536 00000100:00100000:0.0:1788843578.682746:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116529536 00000100:00100000:0.0:1788843578.682934:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 61 00000100:00100000:0.0:1788843578.682957:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+38:11186:x1875738116529536:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1788843578.682991:0:11996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843578.683029:0:11996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d14c7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f2249092e expref: -99 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843578.683077:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d14ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843578.683096:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d14ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843578.683109:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d14ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843578.683293:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d14c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249092e expref: 40 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843578.683315:0:11996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d14ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249092e expref: 39 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843578.683324:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:0.0:1788843578.683340:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788843578.683344:0:11996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3c800, rc 0) 00000100:00100000:0.0:1788843578.683426:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+39:11186:x1875738116529536:12345-192.168.203.33@tcp:101:dd.0 Request processed in 473us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843578.683434:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 61 00000100:00100000:2.0:1788843578.695179:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843578.695318:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116529792 00000100:00100000:3.0:1788843578.695339:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116529792 00000100:00100000:3.0:1788843578.695406:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 62 00000100:00100000:3.0:1788843578.695418:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+39:11186:x1875738116529792:12345-192.168.203.33@tcp:36:dd.0 00010000:00010000:3.0:1788843578.696597:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af400/0xa762dfcbd58d14d5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.696627:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af400/0xa762dfcbd58d14d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.696643:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af400/0xa762dfcbd58d14d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788843578.696718:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1788843578.696759:0:6507:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000090404dd7 reply state 000000000ab3467e transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af400/0xa762dfcbd58d14d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.696774:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af400/0xa762dfcbd58d14d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843578.697656:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:3.0:1788843578.697661:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788843578.697667:0:6507:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788843578.699679:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+42:11186:x1875738116529792:12345-192.168.203.33@tcp:36:dd.0 Request processed in 4244us (4526us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1788843578.699721:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 62 00000020:00080000:2.0:1788843578.699733:0:6507:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788843579.071559:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843579.074845:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116529920 00000100:00100000:1.0:1788843579.074866:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116529920 00000100:00100000:1.0:1788843579.075073:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 63 00000100:00100000:1.0:1788843579.075098:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+42:11200:x1875738116529920:12345-192.168.203.33@tcp:101:stat.0 00010000:00010000:1.0:1788843579.075134:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843579.075188:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d14dc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490935 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843579.075278:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d14e3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843579.075297:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d14e3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843579.075313:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d14e3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843579.075371:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d14ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843579.075381:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d14ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843579.075388:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d14ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843579.075500:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d14f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843579.075512:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d14b9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490927 expref: 43 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843579.075522:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d14f1 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843579.075566:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d14b9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490927 expref: 43 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843579.077225:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d14b9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490927 expref: 43 pid: 6506 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843579.077259:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fb8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6506:1875738134447232:192.168.203.33@tcp:104: 00000100:00100000:1.0:1788843579.077717:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1106d0600 going to sleep for 11 seconds 00000100:00080000:2.0:1788843579.079647:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843579.086454:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843579.088958:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116530176 00000100:00100000:3.0:1788843579.088980:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116530176 00000100:00100000:3.0:1788843579.089102:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 13 00000100:00100000:3.0:1788843579.089117:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+44:6162:x1875738116530176:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788843579.090341:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+45:6162:x1875738116530176:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 1207us (3882us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1788843579.090355:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 13 00000100:00100000:3.0:1788843579.092981:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843579.093257:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116530304 00000100:00100000:2.0:1788843579.093270:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116530304 00010000:00010000:2.0:1788843579.093337:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d14b9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490927 expref: 45 pid: 6506 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843579.093387:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 56 00000100:00100000:2.0:1788843579.093399:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1060d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+45:2389:x1875738116530304:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843579.093420:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843579.093428:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d14b9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490927 expref: 45 pid: 6506 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.093443:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d14b9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490927 expref: 45 pid: 6506 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.093472:0:7448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:2.0:1788843579.093488:0:7448:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d14f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.093500:0:7448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d14f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.093509:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d14f1 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.093534:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843579.093629:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1060d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+45:2389:x1875738116530304:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 231us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843579.093638:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 56 00010000:00010000:0.0:1788843579.095644:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d14b9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490927 expref: 44 pid: 6506 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843579.095674:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fb8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6506:1875738134447232:192.168.203.33@tcp:104: 00010000:00010000:0.0:1788843579.095702:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d14f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.095714:0:6506:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d14f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.095721:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d14f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843579.096081:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788843579.096615:0:6506:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788843579.096700:0:6506:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d14f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.096721:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d14f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.096734:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d14e3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.096742:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d14e3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.096750:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d14e3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.096757:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb34200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843579.096761:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d14e3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.096779:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d14e3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.097261:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bd007730100) 00010000:00010000:0.0:1788843579.097268:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843579.097275:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d14e3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.097283:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d14e3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.097302:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d14ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.097308:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d14ea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.097332:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d14ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.097339:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb35800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843579.097342:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d14ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.097349:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d14ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.097360:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bd007730200) 00010000:00010000:0.0:1788843579.097363:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843579.097366:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d14ea lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.097372:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d14ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.097419:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d14dc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490935 expref: 44 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.097433:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d14f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490935 expref: 43 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.097440:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:0.0:1788843579.097442:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788843579.097445:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fb35a00, rc 0) 00000100:00100000:0.0:1788843579.098078:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+43:11200:x1875738116529920:12345-192.168.203.33@tcp:101:stat.0 Request processed in 22987us (26602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843579.098106:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 63 00000100:00100000:3.0:1788843579.181791:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843579.182072:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116530560 00000100:00100000:0.0:1788843579.182099:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116530560 00000100:00100000:0.0:1788843579.182231:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 64 00000100:00100000:0.0:1788843579.182244:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1060d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+43:11206:x1875738116530560:12345-192.168.203.33@tcp:36:truncate.0 00010000:00010000:0.0:1788843579.182337:0:11996:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843579.182376:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d14f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490935 expref: 43 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.182402:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:0.0:1788843579.182408:0:11996:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788843579.182950:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d14f8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.182971:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d14f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.182983:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d14f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788843579.183034:0:11996:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:0.0:1788843579.183058:0:11996:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d7fbc6c reply state 00000000ff780a90 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d14f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.183071:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d14f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.183077:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:0.0:1788843579.183091:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788843579.183100:0:11996:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788843579.183310:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1060d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+45:11206:x1875738116530560:12345-192.168.203.33@tcp:36:truncate.0 Request processed in 1066us (1532us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788843579.183320:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 64 00000020:00080000:0.0:1788843579.183336:0:11996:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788843579.345391:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843579.345513:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116530688 00000100:00100000:2.0:1788843579.345527:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116530688 00000100:00100000:2.0:1788843579.345603:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 65 00000100:00100000:2.0:1788843579.345615:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+45:11220:x1875738116530688:12345-192.168.203.33@tcp:101:stat.0 00010000:00010000:2.0:1788843579.345645:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843579.345672:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946200/0xa762dfcbd58d14ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f2249093c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.345757:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1506 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.345775:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1506 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.345788:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1506 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.345965:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d150d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.345975:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d150d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.345981:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d150d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.346137:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1514 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.346274:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1514 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.346282:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1514 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843579.346346:0:6507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1788843579.346351:0:6507:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788843579.346381:0:6507:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1514 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.346394:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1514 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.346403:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1506 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.346409:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1506 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.346416:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1506 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.346423:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843579.346428:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1506 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.346437:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1506 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.346451:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bd007730100) 00010000:00010000:2.0:1788843579.346595:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843579.346602:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1506 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.346609:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1506 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.346626:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d150d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.346633:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d150d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.346639:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d150d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.346644:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843579.346646:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d150d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.346652:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d150d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.346660:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bd007730200) 00010000:00010000:2.0:1788843579.346662:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843579.346665:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d150d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.346670:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d150d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.346708:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946200/0xa762dfcbd58d14ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249093c expref: 47 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.346734:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1514 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249093c expref: 46 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.346742:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:2.0:1788843579.346744:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843579.346747:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007946a00, rc 0) 00000100:00100000:2.0:1788843579.347092:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+46:11220:x1875738116530688:12345-192.168.203.33@tcp:101:stat.0 Request processed in 1477us (1714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843579.347101:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 65 00000100:00100000:1.0:1788843579.436054:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843579.436206:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116530944 00000100:00100000:0.0:1788843579.436219:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116530944 00000100:00100000:0.0:1788843579.436301:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 66 00000100:00100000:0.0:1788843579.436316:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+46:11230:x1875738116530944:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1788843579.436356:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843579.436385:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d151b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490943 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843579.436529:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788843579.436670:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d151b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490943 expref: 48 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.436688:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd13dfda000) 00010000:00010000:0.0:1788843579.436692:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788843579.436699:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d151b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490943 expref: 48 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.436717:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3dc00, rc 0) 00000100:00100000:0.0:1788843579.436795:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+47:11230:x1875738116530944:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 484us (755us total) trans 4294967341 rc 301/301 00000100:00100000:0.0:1788843579.436803:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 66 00000100:00100000:3.0:1788843579.443128:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843579.443246:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116531200 00000100:00100000:0.0:1788843579.443260:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116531200 00000100:00100000:0.0:1788843579.443369:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 14 00000100:00100000:0.0:1788843579.443381:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1060d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+47:11230:x1875738116531200:12345-192.168.203.33@tcp:35:lfs.0 00000100:00100000:0.0:1788843579.444032:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1060d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+48:11230:x1875738116531200:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 651us (919us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1788843579.444043:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 14 00000100:00100000:1.0:1788843579.528839:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843579.529114:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116531456 00000100:00100000:0.0:1788843579.529128:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116531456 00000100:00100000:0.0:1788843579.529263:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 67 00000100:00100000:0.0:1788843579.529277:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+48:11236:x1875738116531456:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:0.0:1788843579.529310:0:11996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843579.529348:0:11996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1529 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f2249094a expref: -99 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.529493:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1530 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.529667:0:11996:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1514 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249093c expref: 49 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.529679:0:11996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1530 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.529723:0:11996:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1514 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249093c expref: 49 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.529741:0:11996:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1514 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249093c expref: 49 pid: 6507 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843579.529782:0:11996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006757800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11996:1875738134447360:192.168.203.33@tcp:104: 00000100:00100000:0.0:1788843579.529975:0:11996:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10529e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788843579.534947:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843579.535196:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116531584 00000100:00100000:3.0:1788843579.535209:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116531584 00010000:00010000:3.0:1788843579.535268:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1514 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249093c expref: 50 pid: 6507 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843579.535340:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 57 00000100:00100000:3.0:1788843579.535352:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13332fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+50:2389:x1875738116531584:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843579.535371:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843579.535378:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1514 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249093c expref: 50 pid: 6507 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843579.535393:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1514 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249093c expref: 50 pid: 6507 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843579.535449:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:0.0:1788843579.536056:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1514 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249093c expref: 50 pid: 6507 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843579.536081:0:11996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006757800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11996:1875738134447360:192.168.203.33@tcp:104: 00010000:00010000:3.0:1788843579.536128:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1530 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843579.536178:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1530 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843579.536188:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1530 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.536525:0:11996:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1530 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843579.536949:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843579.537184:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13332fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+49:2389:x1875738116531584:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 1830us (2247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843579.537196:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 57 00010000:00010000:0.0:1788843579.538875:0:11996:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1530 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.538895:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1530 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843579.538924:0:11996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1788843579.539243:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1529 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249094a expref: 50 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.539267:0:11996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1530 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249094a expref: 49 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.539277:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:0.0:1788843579.539280:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788843579.539284:0:11996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3d800, rc 0) 00000100:00100000:0.0:1788843579.539441:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+49:11236:x1875738116531456:12345-192.168.203.33@tcp:101:bash.0 Request processed in 10166us (10616us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788843579.539481:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 67 00000100:00100000:3.0:1788843579.544928:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843579.545488:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116531840 00000100:00100000:0.0:1788843579.545501:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116531840 00000100:00100000:0.0:1788843579.545583:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 68 00000100:00100000:0.0:1788843579.545595:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1060d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+49:11236:x1875738116531840:12345-192.168.203.33@tcp:36:bash.0 00010000:00010000:0.0:1788843579.546290:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d153e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.546316:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d153e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.546359:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d153e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788843579.546417:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:0.0:1788843579.546442:0:6507:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e67a4592 reply state 0000000086dcc221 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d153e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.546575:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d153e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.546586:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:0.0:1788843579.546590:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788843579.546595:0:6507:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788843579.547084:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843579.547209:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1060d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+52:11236:x1875738116531840:12345-192.168.203.33@tcp:36:bash.0 Request processed in 1610us (2290us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1788843579.547218:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 68 00000020:00080000:0.0:1788843579.547225:0:6507:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788843579.565498:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843579.565671:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116531968 00000100:00100000:3.0:1788843579.565687:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116531968 00000100:00100000:3.0:1788843579.565774:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 69 00000100:00100000:3.0:1788843579.565787:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+52:11236:x1875738116531968:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:3.0:1788843579.565822:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843579.565851:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae400/0xa762dfcbd58d1545 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490951 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843579.565982:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d154c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843579.566267:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1530 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249094a expref: 53 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843579.566296:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d154c lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843579.566350:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1530 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249094a expref: 53 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843579.566367:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1530 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249094a expref: 53 pid: 11996 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843579.566386:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1060d2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6508:1875738134447488:192.168.203.33@tcp:104: 00000100:00100000:3.0:1788843579.567317:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893600 going to sleep for 11 seconds 00000100:00100000:0.0:1788843579.572636:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1060d2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6508:1875738134447488:192.168.203.33@tcp:104: 00010000:00010000:0.0:1788843579.572697:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d154c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843579.575728:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843579.576214:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116532096 00000100:00100000:2.0:1788843579.576228:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116532096 00010000:00010000:2.0:1788843579.576282:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1530 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249094a expref: 54 pid: 11996 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843579.576343:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 58 00000100:00100000:2.0:1788843579.576355:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fb8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+54:2390:x1875738116532096:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843579.576374:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843579.576381:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1530 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249094a expref: 54 pid: 11996 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.576395:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1530 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249094a expref: 54 pid: 11996 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.576423:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1530 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249094a expref: 54 pid: 11996 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.576475:0:7448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:2.0:1788843579.576482:0:7448:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d154c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.576494:0:7448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d154c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.576503:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d154c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843579.576554:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843579.576639:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fb8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+53:2390:x1875738116532096:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 284us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843579.576814:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 58 00010000:00010000:0.0:1788843579.577073:0:6508:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d154c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.577082:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d154c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843579.577199:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788843579.577205:0:6508:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788843579.577233:0:6508:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d154c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.577272:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae400/0xa762dfcbd58d1545 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490951 expref: 53 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.577304:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d154c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490951 expref: 52 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.577313:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:0.0:1788843579.577316:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788843579.577319:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd118f70200, rc 0) 00000100:00100000:0.0:1788843579.577370:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+52:11236:x1875738116531968:12345-192.168.203.33@tcp:101:bash.0 Request processed in 11586us (11890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843579.577377:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 69 00000100:00100000:1.0:1788843579.583936:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843579.584100:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116532352 00000100:00100000:2.0:1788843579.584554:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116532352 00000100:00100000:2.0:1788843579.584718:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 15 00000100:00100000:2.0:1788843579.584730:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd133001450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+52:11236:x1875738116532352:12345-192.168.203.33@tcp:35:bash.0 00000100:00100000:2.0:1788843579.585234:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd133001450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+53:11236:x1875738116532352:12345-192.168.203.33@tcp:35:bash.0 Request processed in 505us (1310us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1788843579.585243:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 15 00000100:00100000:1.0:1788843579.707975:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843579.713773:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116532608 00000100:00100000:0.0:1788843579.713796:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116532608 00000100:00100000:1.0:1788843579.716091:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 70 00000100:00100000:1.0:1788843579.716127:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+53:11246:x1875738116532608:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1788843579.716177:0:11996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843579.716208:0:11996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d1553 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490958 expref: -99 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843579.716359:0:11996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788843579.716527:0:11996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d1553 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490958 expref: 55 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843579.716545:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd13dfda000) 00010000:00010000:1.0:1788843579.716548:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788843579.716553:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d1553 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490958 expref: 55 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843579.716570:0:11996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fb35800, rc 0) 00000100:00100000:1.0:1788843579.719427:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+54:11246:x1875738116532608:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3298us (11460us total) trans 4294967347 rc 301/301 00000100:00100000:1.0:1788843579.719444:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 70 00000100:00100000:1.0:1788843579.730534:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843579.730669:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116532736 00000100:00100000:0.0:1788843579.730682:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116532736 00000100:00100000:0.0:1788843579.730781:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 71 00000100:00100000:0.0:1788843579.730794:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+54:11246:x1875738116532736:12345-192.168.203.33@tcp:34:lfs.0 00010000:00010000:0.0:1788843579.730906:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1561 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.730928:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1561 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.730941:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1561 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.730955:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1568 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.730963:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1568 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.730970:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1568 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.731071:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d156f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.731082:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d156f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.731089:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d156f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788843579.731216:0:6507:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d156f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.731231:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1561 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.731246:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1561 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.731265:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1561 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.731272:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3dc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843579.731278:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1561 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.731287:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1561 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.731300:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bd007730100) 00010000:00010000:0.0:1788843579.731303:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843579.731309:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1561 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.731314:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1561 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.731338:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1568 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.731344:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1568 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.731351:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1568 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.731356:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3ce00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843579.731366:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1568 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.731373:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1568 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.731381:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bd007730200) 00010000:00010000:0.0:1788843579.731384:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843579.731387:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1568 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.731392:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1568 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.731402:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d156f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.731408:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d156f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.731414:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d156f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.731419:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3cc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843579.731422:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d156f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.731427:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d156f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.731434:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:0.0:1788843579.731435:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843579.731446:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d156f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.731453:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d156f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843579.731550:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+54:11246:x1875738116532736:12345-192.168.203.33@tcp:34:lfs.0 Request processed in 758us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843579.731559:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 71 00000100:00100000:3.0:1788843579.738011:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843579.738087:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116532992 00000100:00100000:0.0:1788843579.738104:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116532992 00000100:00100000:0.0:1788843579.738232:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 16 00000100:00100000:0.0:1788843579.738248:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1060d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+54:11246:x1875738116532992:12345-192.168.203.33@tcp:35:lfs.0 00000100:00100000:0.0:1788843579.738583:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1060d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+55:11246:x1875738116532992:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 339us (590us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1788843579.738593:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 16 00000040:00080000:3.0:1788843579.740119:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788843579.740952:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788843579.799092:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843579.799201:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116533248 00000100:00100000:0.0:1788843579.799218:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116533248 00000100:00100000:0.0:1788843579.799385:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 72 00000100:00100000:0.0:1788843579.799398:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+55:11249:x1875738116533248:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1788843579.799431:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843579.799458:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1576 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f2249095f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.799592:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d157d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.799612:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d157d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.799639:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d157d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.799665:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1584 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.799675:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1584 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.799682:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1584 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.799827:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d158b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.799838:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d158b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.799845:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d158b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843579.799856:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788843579.799956:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d157d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.799964:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d157d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.799970:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d157d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.799976:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3ce00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843579.799988:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d157d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.799997:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d157d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.800013:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bd007730100) 00010000:00010000:0.0:1788843579.800017:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843579.800022:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d157d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.800029:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d157d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.800045:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1584 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.800053:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1584 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.800058:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1584 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.800064:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3dc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843579.800066:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1584 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.800072:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1584 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.800079:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bd007730200) 00010000:00010000:0.0:1788843579.800081:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843579.800094:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1584 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.800099:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1584 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.800219:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1576 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249095f expref: 58 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.800234:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d158b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249095f expref: 57 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.800242:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:0.0:1788843579.800244:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788843579.800246:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3ca00, rc 0) 00000100:00100000:0.0:1788843579.800341:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+57:11249:x1875738116533248:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 946us (1257us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788843579.800350:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 72 00000100:00100000:3.0:1788843579.803979:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843579.804345:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1875738134448000:0@lo:400:kworker.0 00000100:00100000:1.0:1788843579.804401:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843579.804473:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134448512:0@lo:400:kworker.0 00000100:00100000:1.0:1788843579.804500:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843579.804519:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134449024:0@lo:400:kworker.0 00000100:00100000:1.0:1788843579.804540:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843579.804567:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788843579.804572:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134447872:0@lo:400:kworker.0 00000100:00100000:1.0:1788843579.804597:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843579.804614:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1875738134448384:0@lo:400:kworker.0 00000100:00100000:1.0:1788843579.804635:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843579.804648:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1875738134448896:0@lo:400:kworker.0 00000100:00100000:1.0:1788843579.804666:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843579.804695:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134448512 00000100:00100000:1.0:1788843579.804701:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134448512 00000100:00100000:1.0:1788843579.804750:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134449024 00000100:00100000:1.0:1788843579.804753:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134449024 00000100:00100000:1.0:1788843579.804776:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788843579.804784:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134448512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843579.804985:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134447744:0@lo:400:kworker.0 00000100:00100000:2.0:1788843579.805064:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843579.805102:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1875738134448256:0@lo:400:kworker.0 00000100:00100000:2.0:1788843579.805128:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843579.805493:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1875738134448768:0@lo:400:kworker.0 00000100:00100000:2.0:1788843579.805547:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843579.805581:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1788843579.805591:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134447616:0@lo:400:kworker.0 00000100:00100000:1.0:1788843579.805601:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134448512:12345-0@lo:400:kworker.0 Request processed in 813us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843579.805613:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788843579.805637:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788843579.805648:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134449024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843579.805655:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843579.805715:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134448128:0@lo:400:kworker.0 00000100:00100000:1.0:1788843579.805722:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134449024:12345-0@lo:400:kworker.0 Request processed in 72us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843579.805745:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788843579.805764:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843579.805791:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134448640:0@lo:400:kworker.0 00000100:00100000:0.0:1788843579.805885:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116533376 00000100:00100000:0.0:1788843579.805890:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116533376 00000100:00100000:0.0:1788843579.805914:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134448000 00000100:00100000:0.0:1788843579.805917:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134448000 00000100:00100000:0.0:1788843579.805933:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134448384 00000100:00100000:0.0:1788843579.805936:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134448384 00000100:00100000:2.0:1788843579.805943:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843579.805958:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134448896 00000100:00100000:0.0:1788843579.805963:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134448896 00000100:00100000:2.0:1788843579.805978:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134449152:0@lo:400:kworker.0 00000100:00100000:0.0:1788843579.805979:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134447744 00000100:00100000:0.0:1788843579.805998:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134447744 00000100:00100000:2.0:1788843579.806010:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843579.806021:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134448256 00000100:00100000:0.0:1788843579.806026:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134448256 00000100:00100000:2.0:1788843579.806036:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006757800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134449280:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788843579.806048:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134448768 00000100:00100000:0.0:1788843579.806062:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134448768 00000100:00100000:2.0:1788843579.806076:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843579.806107:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788843579.806118:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1875738134448000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843579.806173:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134448640 00000100:00100000:2.0:1788843579.806182:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134448640 00000100:00100000:0.0:1788843579.806198:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1875738134448000:12345-0@lo:400:kworker.0 Request processed in 82us (1796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843579.806208:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788843579.806225:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134449152 00000100:00100000:2.0:1788843579.806230:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134449152 00000100:00100000:0.0:1788843579.806234:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788843579.806246:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1875738134448384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843579.806263:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788843579.806275:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3633:x1875738134448640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843579.806294:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1875738134448384:12345-0@lo:400:kworker.0 Request processed in 49us (1655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843579.806308:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788843579.806344:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788843579.806360:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3633:x1875738134448640:12345-0@lo:400:kworker.0 Request processed in 86us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843579.806364:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1875738134448896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843579.806376:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788843579.806402:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788843579.806412:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134449152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843579.806447:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1875738134448896:12345-0@lo:400:kworker.0 Request processed in 92us (1776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843579.806465:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134449152:12345-0@lo:400:kworker.0 Request processed in 54us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843579.806473:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788843579.806485:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788843579.806504:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1788843579.806516:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134447744:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788843579.806526:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788843579.806533:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788843579.806539:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788843579.806542:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788843579.806562:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134447616 00000100:00100000:2.0:1788843579.806568:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134447616 00000100:00100000:0.0:1788843579.806575:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134447744:12345-0@lo:400:kworker.0 Request processed in 57us (1506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843579.806584:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1788843579.806604:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788843579.806611:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875738134448256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843579.806638:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875738134448256:12345-0@lo:400:kworker.0 Request processed in 28us (1509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843579.806654:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788843579.806666:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788843579.806672:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875738134448768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843579.806701:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875738134448768:12345-0@lo:400:kworker.0 Request processed in 30us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843579.806707:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788843579.806721:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 73 00000100:00100000:0.0:1788843579.806729:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1060d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+57:11249:x1875738116533376:12345-192.168.203.33@tcp:54:lfs.0 00010000:00010000:0.0:1788843579.806788:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1599 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.806805:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1599 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.806816:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1599 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.806854:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1599 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.806861:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1599 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.806868:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1599 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.806874:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843579.806879:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1599 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.806897:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1599 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.806911:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:0.0:1788843579.806914:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788843579.806919:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1599 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843579.806926:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1599 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843579.806990:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1060d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+57:11249:x1875738116533376:12345-192.168.203.33@tcp:54:lfs.0 Request processed in 262us (3022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843579.806997:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 73 00010000:00080000:0.0:1788843579.807207:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141b9f480 x1875738134448384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843579.807220:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1875738134448384:0@lo:400:kworker.0 00010000:00080000:0.0:1788843579.807232:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141b9dc00 x1875738134448896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843579.807240:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1875738134448896:0@lo:400:kworker.0 00000100:00100000:0.0:1788843579.807252:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1875738134448000:0@lo:400:kworker.0 00000100:00100000:0.0:1788843579.807261:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134448512:0@lo:400:kworker.0 00000100:00100000:0.0:1788843579.807271:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134449024:0@lo:400:kworker.0 00000100:00100000:3.0:1788843579.808646:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843579.808681:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116533504 00000100:00100000:3.0:1788843579.808690:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116533504 00000100:00100000:3.0:1788843579.808735:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 5 00000100:00100000:3.0:1788843579.808743:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1060d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+57:2390:x1875738116533504:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843579.808757:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843579.808779:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d158b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249095f expref: 57 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843579.808862:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:3.0:1788843579.808867:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843579.808908:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1060d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+56:2390:x1875738116533504:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 165us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843579.808926:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 5 00000100:00100000:2.0:1788843579.809078:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1788843579.809101:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1032f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3633:x1875738134447616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843579.809204:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1032f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3633:x1875738134447616:12345-0@lo:400:kworker.0 Request processed in 115us (3554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843579.809211:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1788843579.809263:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134449280 00000100:00100000:2.0:1788843579.809271:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134449280 00000100:00100000:2.0:1788843579.809308:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788843579.809315:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134449280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788843579.809354:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788843579.809393:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134449280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (3319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843579.809399:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788843579.809472:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006757800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134449280:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788843579.809487:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134447616:0@lo:400:kworker.0 00000100:00100000:2.0:1788843579.809503:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134448640:0@lo:400:kworker.0 00000100:00100000:2.0:1788843579.809514:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134449152:0@lo:400:kworker.0 00000100:00100000:2.0:1788843579.809527:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134447744:0@lo:400:kworker.0 00000100:00100000:2.0:1788843579.809539:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1875738134448256:0@lo:400:kworker.0 00000100:00100000:2.0:1788843579.809566:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1875738134448768:0@lo:400:kworker.0 00000100:00100000:1.0:1788843579.809732:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134447872 00000100:00100000:1.0:1788843579.809742:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134447872 00000100:00100000:1.0:1788843579.809788:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134448128 00000100:00100000:2.0:1788843579.809827:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788843579.809838:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134447872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843579.809888:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134447872:12345-0@lo:400:kworker.0 Request processed in 54us (5290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843579.809894:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788843579.809928:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134447872:0@lo:400:kworker.0 00000100:00100000:1.0:1788843579.811129:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134448128 00000100:00100000:1.0:1788843579.811203:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788843579.811213:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134448128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843579.811308:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134448128:12345-0@lo:400:kworker.0 Request processed in 97us (5545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843579.811316:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788843579.811382:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134448128:0@lo:400:kworker.0 00000100:00100000:0.0:1788843579.813739:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843579.813891:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116533760 00000100:00100000:3.0:1788843579.813900:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116533760 00000100:00100000:3.0:1788843579.814109:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 17 00000100:00100000:3.0:1788843579.814122:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd006756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+56:11249:x1875738116533760:12345-192.168.203.33@tcp:35:lfs.0 00000100:00100000:2.0:1788843579.819413:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd006756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+57:11249:x1875738116533760:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 5277us (5666us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788843579.819430:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 17 00000100:00100000:2.0:1788843580.051560:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843580.051656:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116534016 00000100:00100000:0.0:1788843580.051667:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116534016 00000100:00100000:0.0:1788843580.051750:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 74 00000100:00100000:0.0:1788843580.051762:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+57:11267:x1875738116534016:12345-192.168.203.33@tcp:101:cat.0 00010000:00010000:0.0:1788843580.051798:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843580.051820:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d15a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490966 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.051944:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d15a7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.051961:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d15a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.051974:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d15a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843580.051986:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788843580.052128:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d15a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490966 expref: 60 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.052191:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d15a7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490966 expref: 59 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.052201:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:0.0:1788843580.052204:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788843580.052208:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3cc00, rc 0) 00000100:00100000:0.0:1788843580.052265:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+59:11267:x1875738116534016:12345-192.168.203.33@tcp:101:cat.0 Request processed in 506us (714us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1788843580.052282:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 74 00000001:00080000:1.0:1788843580.054655:0:6485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000004:00080000:1.0:1788843580.054774:0:6485:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1788843580.054808:0:6485:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bd102d36300 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788843580.054815:0:6485:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd13fb8f000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bd102d36600 00000020:00080000:1.0:1788843580.054819:0:6485:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd13fb8f400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bd13df5d200 00000020:00080000:3.0:1788843580.054891:0:6538:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:1.0:1788843580.054948:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134449408:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788843580.055072:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1788843580.055106:0:6538:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788843580.055400:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134449408 00000100:00100000:0.0:1788843580.055409:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134449408 00000100:00100000:0.0:1788843580.055488:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788843580.055499:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3630:x1875738134449408:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788843580.055528:0:8421:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:0.0:1788843580.055561:0:8421:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9f9638, atime: 0x6a9f9639, ctime: 0x6a9f9638, blocks: 0x8 00010000:00010000:0.0:1788843580.055573:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078838d6f/0xa762dfcbd58d15b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.055591:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=358s v=(0 0) 00010000:00010000:0.0:1788843580.055597:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843580.055622:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae000/0xa762dfcbd58d1385 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.055636:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae000/0xa762dfcbd58d1385 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.055644:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae000/0xa762dfcbd58d1385 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.055651:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7ae000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843580.055658:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae000/0xa762dfcbd58d1385 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.055667:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae000/0xa762dfcbd58d1385 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.055686:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9bd007730e00) 00010000:00010000:2.0:1788843580.055721:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843580.055727:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae000/0xa762dfcbd58d1385 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.055734:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae000/0xa762dfcbd58d1385 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.055759:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af200/0xa762dfcbd58d138c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.055766:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af200/0xa762dfcbd58d138c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.055772:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af200/0xa762dfcbd58d138c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.055777:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7af200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843580.055780:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af200/0xa762dfcbd58d138c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.055785:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af200/0xa762dfcbd58d138c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.055793:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bd007730100) 00010000:00010000:2.0:1788843580.055796:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843580.055798:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af200/0xa762dfcbd58d138c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.055814:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af200/0xa762dfcbd58d138c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.055828:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71400/0xa762dfcbd58d13cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.055845:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71400/0xa762dfcbd58d13cb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.055851:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71400/0xa762dfcbd58d13cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.055857:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd118f71400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843580.055860:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71400/0xa762dfcbd58d13cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.055865:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71400/0xa762dfcbd58d13cb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.055874:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bd007730200) 00010000:00010000:2.0:1788843580.055876:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843580.055879:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71400/0xa762dfcbd58d13cb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.055884:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71400/0xa762dfcbd58d13cb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.055900:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af400/0xa762dfcbd58d14d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.055905:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af400/0xa762dfcbd58d14d5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.055910:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af400/0xa762dfcbd58d14d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.055914:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7af400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843580.055921:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af400/0xa762dfcbd58d14d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.055927:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af400/0xa762dfcbd58d14d5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.055933:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:2.0:1788843580.055936:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843580.055938:0:8421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078838d6f/0xa762dfcbd58d15b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.055940:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af400/0xa762dfcbd58d14d5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.055972:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af400/0xa762dfcbd58d14d5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.055990:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d14f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.055992:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078838d6f/0xa762dfcbd58d15b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.056006:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d14f8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.056022:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078838d6f/0xa762dfcbd58d15b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.056044:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078838d6f/0xa762dfcbd58d15b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.056068:0:8421:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788843580.056275:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3630:x1875738134449408:12345-0@lo:6:osp-syn-0-0.0 Request processed in 777us (1202us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788843580.056293:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1788843580.056333:0:10329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843580.056340:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078838d6f/0xa762dfcbd58d15b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.056349:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3dc00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843580.056355:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078838d6f/0xa762dfcbd58d15b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.056366:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078838d6f/0xa762dfcbd58d15b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.056384:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078838d6f/0xa762dfcbd58d15b5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.056385:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d14f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.056416:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843580.056418:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078838d6f/0xa762dfcbd58d15b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.056424:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d14f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.056454:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d14f8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.056467:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843580.056470:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843580.056472:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788843580.056515:0:3630:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd006756300/2, rc 0, transno 4294967302 00000100:00100000:0.0:1788843580.056531:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134449408:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788843580.056538:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:2.0:1788843580.056544:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843580.056561:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d14f8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.056569:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d14f8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.056589:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d153e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.056596:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d153e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.056602:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d153e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.056608:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3da00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843580.056610:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d153e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.056616:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d153e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.056624:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:2.0:1788843580.056627:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843580.056630:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d153e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.056635:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d153e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788843580.056785:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843580.116492:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843580.116584:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116534144 00000100:00100000:3.0:1788843580.116597:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116534144 00000100:00100000:3.0:1788843580.116671:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 75 00000100:00100000:3.0:1788843580.116684:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd006755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+13:11268:x1875738116534144:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1788843580.116727:0:9517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843580.116756:0:9517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d15bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f2249096d expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.116974:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d15c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.117002:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d15c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.117015:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d15c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843580.117071:0:9517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788843580.117075:0:9517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788843580.117099:0:9517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d15c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.117206:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d15bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249096d expref: 15 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.117229:0:9517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d15c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249096d expref: 14 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.117239:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bd007730100) 00010000:00010000:3.0:1788843580.117242:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788843580.117247:0:9517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd118f71e00, rc 0) 00000100:00100000:3.0:1788843580.117337:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd006755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+14:11268:x1875738116534144:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 654us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843580.117344:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 75 00000100:00100000:1.0:1788843580.121843:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843580.122646:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116534528 00000100:00100000:0.0:1788843580.122661:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116534528 00000100:00100000:0.0:1788843580.122753:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 18 00000100:00100000:0.0:1788843580.122764:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+14:11268:x1875738116534528:12345-192.168.203.33@tcp:35:lfs.0 00000100:00100000:0.0:1788843580.123060:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+15:11268:x1875738116534528:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 298us (1226us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1788843580.123069:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 18 00000100:00100000:2.0:1788843580.128311:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843580.128451:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116534656 00000100:00100000:1.0:1788843580.128463:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116534656 00000100:00100000:1.0:1788843580.128544:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 6 00000100:00100000:1.0:1788843580.128555:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+15:11268:x1875738116534656:12345-192.168.203.33@tcp:103:lfs.0 00010000:00010000:1.0:1788843580.128571:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788843580.128596:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d154c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490951 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843580.128633:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d15a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490966 expref: 14 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843580.128646:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d1449 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249090b expref: 13 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843580.128658:0:7448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:1.0:1788843580.128664:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843580.128722:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+12:11268:x1875738116534656:12345-192.168.203.33@tcp:103:lfs.0 Request processed in 169us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843580.128730:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 6 00000100:00100000:1.0:1788843580.136076:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843580.136180:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116534784 00000100:00100000:2.0:1788843580.136193:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116534784 00000100:00100000:2.0:1788843580.136275:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 76 00000100:00100000:2.0:1788843580.136286:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+12:11268:x1875738116534784:12345-192.168.203.33@tcp:58:lfs.0 00010000:00010000:2.0:1788843580.136424:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d15ca lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.136444:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d15ca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.136455:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d15ca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788843580.136682:0:11996:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788843580.136809:0:11996:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788843580.136890:0:11996:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788843580.136982:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+12:11268:x1875738116534784:12345-192.168.203.33@tcp:58:lfs.0 Request processed in 696us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843580.136989:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 76 00000100:00100000:2.0:1788843580.191952:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843580.192101:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116534912 00000100:00100000:0.0:1788843580.192115:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116534912 00000100:00100000:0.0:1788843580.192200:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 77 00000100:00100000:0.0:1788843580.192210:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+12:11270:x1875738116534912:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1788843580.192229:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843580.192248:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d15d1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490974 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.192311:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d15d8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.192335:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d15d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.192346:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d15d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.192362:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d15df lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.192369:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d15df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.192375:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d15df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.192460:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d15e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.192469:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d15e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.192477:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d15e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843580.192514:0:6507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788843580.192519:0:6507:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788843580.192537:0:6507:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d15e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.192547:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d15e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.192556:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d15d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.192562:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d15d8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.192568:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d15d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.192574:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843580.192578:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d15d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.192585:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d15d8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.192604:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bd007730100) 00010000:00010000:0.0:1788843580.192607:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843580.192611:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d15d8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.192617:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d15d8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.192629:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d15df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.192635:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d15df lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.192640:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d15df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.192645:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3ce00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843580.192647:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d15df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.192653:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d15df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.192658:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bd00658b500) 00010000:00010000:0.0:1788843580.192660:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843580.192663:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d15df lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.192667:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d15df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.192709:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d15d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490974 expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.192722:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d15e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490974 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843580.192729:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:0.0:1788843580.192732:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788843580.192734:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3cc00, rc 0) 00000100:00100000:0.0:1788843580.192802:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+13:11270:x1875738116534912:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 594us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843580.192809:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 77 00000100:00100000:2.0:1788843580.317611:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788843580.317639:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134449536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788843580.317712:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843580.317802:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134449536 00000100:00100000:2.0:1788843580.317810:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134449536 00000100:00100000:2.0:1788843580.317855:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788843580.317864:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134449536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788843580.317893:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788843580.317937:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134449536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843580.317944:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788843580.318281:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134449536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788843580.318510:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788843580.318521:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134449664:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788843580.318557:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843580.318929:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1060d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134449792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843580.318958:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843580.319080:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134449664 00000100:00100000:2.0:1788843580.319086:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134449664 00000100:00100000:2.0:1788843580.319120:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134449792 00000100:00100000:2.0:1788843580.319123:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134449792 00000100:00100000:2.0:1788843580.319137:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788843580.319181:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134449664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788843580.319195:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788843580.319230:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134449664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843580.319236:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788843580.319250:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788843580.319256:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3633:x1875738134449792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788843580.319266:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788843580.319293:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3633:x1875738134449792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843580.319299:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788843580.319407:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1060d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134449792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843580.319420:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134449664:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788843580.334555:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843580.334595:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843580.334631:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843580.334664:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843580.334689:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843580.334771:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116535168 00000100:00100000:2.0:1788843580.334780:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116535168 00000100:00100000:2.0:1788843580.334844:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116535424 00000100:00100000:2.0:1788843580.334847:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116535424 00000100:00100000:2.0:1788843580.334865:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116535552 00000100:00100000:2.0:1788843580.334867:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116535552 00000100:00100000:2.0:1788843580.334885:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 291 00000100:00100000:2.0:1788843580.334894:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1060d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116535168:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843580.334960:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1060d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116535168:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 67us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843580.334983:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 291 00000100:00100000:2.0:1788843580.335093:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 292 00000100:00100000:2.0:1788843580.335101:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1060d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2387:x1875738116535424:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843580.335131:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1060d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2387:x1875738116535424:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 31us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843580.335136:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 292 00000100:00100000:2.0:1788843580.335179:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 293 00000100:00100000:2.0:1788843580.335185:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1060d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2387:x1875738116535552:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843580.335207:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1060d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2387:x1875738116535552:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 23us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843580.335213:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 293 00000100:00100000:1.0:1788843580.335520:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116535040 00000100:00100000:1.0:1788843580.335525:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116535040 00000100:00100000:1.0:1788843580.335562:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 383 00000100:00100000:1.0:1788843580.335574:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1032f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+13:2387:x1875738116535040:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843580.335600:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1032f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+13:2387:x1875738116535040:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 32us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843580.335614:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 383 00000100:00100000:0.0:1788843580.335914:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116535296 00000100:00100000:0.0:1788843580.335920:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116535296 00000100:00100000:0.0:1788843580.335965:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 121 00000100:00100000:0.0:1788843580.335973:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1060d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2387:x1875738116535296:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1788843580.336022:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1060d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2387:x1875738116535296:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 50us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843580.336028:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 121 00000100:00080000:3.0:1788843580.336231:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788843580.336237:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788843580.336240:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788843580.570629:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788843580.764619:0:13785:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788843580.764626:0:13785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788843580.764666:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788843580.764674:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788843580.764818:0:13785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe22d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13785:1875738134449920:192.168.203.33@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788843580.764924:0:13785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd104a359c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843580.776939:0:13785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe22d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13785:1875738134449920:192.168.203.33@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788843580.785507:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843580.786267:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116535680 00000100:00100000:2.0:1788843580.786278:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116535680 00000100:00100000:2.0:1788843580.786353:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 78 00000100:00100000:2.0:1788843580.786363:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd006757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+13:11282:x1875738116535680:12345-192.168.203.33@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788843580.786394:0:11996:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788843580.786562:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd006757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+13:11282:x1875738116535680:12345-192.168.203.33@tcp:53:lhsmtool_posix.0 Request processed in 199us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843580.786569:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 78 00000100:00100000:0.0:1788843580.795913:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843580.799008:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116535808 00000100:00100000:3.0:1788843580.799024:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116535808 00000100:00100000:3.0:1788843580.799095:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 79 00000100:00100000:3.0:1788843580.799108:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd006755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+13:11282:x1875738116535808:12345-192.168.203.33@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788843580.799202:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d15ed lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.799239:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d15ed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.799251:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d15ed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.799267:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d15f4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.799275:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d15f4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.799281:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d15f4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.799327:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d15fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.799337:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d15fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.799344:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d15fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843580.799390:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788843580.799394:0:6508:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788843580.799410:0:6508:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d15fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.799421:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d15ed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.799438:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d15ed lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.799444:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d15ed lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.799450:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd118f70000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1788843580.799454:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d15ed lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.799462:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d15ed lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.799485:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd00746cd00) 00010000:00010000:3.0:1788843580.799489:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843580.799494:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d15ed lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.799500:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d15ed lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.799584:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d15f4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.799590:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d15f4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.799594:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d15f4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.799599:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd118f70600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1788843580.799608:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d15f4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.799613:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d15f4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.799620:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9bd007450b00) 00010000:00010000:3.0:1788843580.799623:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843580.799626:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d15f4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.799631:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d15f4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.799645:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d15fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.799651:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d15fb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.799657:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d15fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.799662:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd118f71c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1788843580.799665:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d15fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.799671:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d15fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.799678:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:3.0:1788843580.799680:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843580.799690:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d15fb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.799696:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d15fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843580.799781:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd006755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+13:11282:x1875738116535808:12345-192.168.203.33@tcp:34:lhsmtool_posix.0 Request processed in 675us (3880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843580.799790:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 79 00000100:00100000:3.0:1788843580.806596:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843580.806742:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116536064 00000100:00100000:2.0:1788843580.806751:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116536064 00000100:00100000:2.0:1788843580.806808:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 80 00000100:00100000:2.0:1788843580.806819:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1060d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+13:11282:x1875738116536064:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788843580.806847:0:9517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843580.806868:0:9517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1602 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f2249097b expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.806980:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1609 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.806993:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1609 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.807004:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1609 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843580.807015:0:9517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788843580.807093:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1609 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.807100:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1609 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.807107:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1609 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.807112:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843580.807126:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1609 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.807134:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1609 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.807173:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:2.0:1788843580.807177:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788843580.807181:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1609 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.807187:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1609 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.807228:0:9517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1602 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249097b expref: 15 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.807238:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd00746cd00) 00010000:00010000:2.0:1788843580.807240:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788843580.807244:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1602 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249097b expref: 15 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.807252:0:9517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007946e00, rc 0) 00000100:00100000:2.0:1788843580.807329:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1060d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+14:11282:x1875738116536064:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 512us (742us total) trans 4294967353 rc 301/301 00000100:00100000:2.0:1788843580.807337:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 80 00000100:00100000:3.0:1788843580.811868:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843580.813430:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116536192 00000100:00100000:0.0:1788843580.813442:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116536192 00000100:00100000:0.0:1788843580.813520:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 81 00000100:00100000:0.0:1788843580.813531:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1060d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+14:11282:x1875738116536192:12345-192.168.203.33@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788843580.813581:0:6506:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788843580.813703:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1060d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+14:11282:x1875738116536192:12345-192.168.203.33@tcp:53:lhsmtool_posix.0 Request processed in 172us (1843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843580.813711:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 81 00000100:00100000:0.0:1788843580.821949:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843580.822224:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116536448 00000100:00100000:3.0:1788843580.822234:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116536448 00000100:00100000:3.0:1788843580.822301:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 82 00000100:00100000:3.0:1788843580.822321:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd006756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+14:11282:x1875738116536448:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788843580.822341:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843580.822344:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788843580.822373:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d15c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249096d expref: 14 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.822392:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bd007730100) 00010000:00010000:3.0:1788843580.822397:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788843580.822409:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d1617 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490982 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788843580.822853:0:6507:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788843580.822998:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d161e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.823022:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d161e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.823033:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d161e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.823084:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d1617 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490982 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.823100:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d161e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490982 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.823108:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9bd007450b00) 00010000:00010000:3.0:1788843580.823110:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788843580.823113:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd118f70600, rc 0) 00000100:00100000:3.0:1788843580.823214:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd006756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+15:11282:x1875738116536448:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 903us (1278us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1788843580.823222:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 82 00000100:00100000:3.0:1788843580.828781:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843580.830220:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116536704 00000100:00100000:1.0:1788843580.830234:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116536704 00000100:00100000:1.0:1788843580.830299:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 83 00000100:00100000:1.0:1788843580.830309:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1060d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+15:11282:x1875738116536704:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788843580.830381:0:11996:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843580.830409:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d161e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490982 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843580.830936:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9bd007450b00) 00010000:00010000:1.0:1788843580.830946:0:11996:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788843580.830971:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d162c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843580.830984:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d162c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843580.830993:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d162c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843580.831051:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d1633 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x823fc6f4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843580.831058:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d1633 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x823fc6f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843580.831064:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d1633 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x823fc6f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843580.831120:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d162c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843580.831126:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d162c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843580.831133:0:11996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d162c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843580.831942:0:11996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb35800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843580.831951:0:11996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d162c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843580.831962:0:11996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d162c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843580.831974:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bd007730100) 00010000:00010000:1.0:1788843580.831977:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843580.831980:0:11996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d162c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843580.831986:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d162c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843580.831997:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d1633 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x823fc6f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843580.832002:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d1633 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x823fc6f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843580.832007:0:11996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d1633 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x823fc6f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843580.832022:0:11996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb34200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843580.832025:0:11996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d1633 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x823fc6f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843580.832032:0:11996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d1633 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x823fc6f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843580.832039:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x823fc6f4 (ffff9bd007403600) 00010000:00010000:1.0:1788843580.832042:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843580.832045:0:11996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d1633 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x823fc6f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843580.832051:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d1633 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x823fc6f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843580.832900:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1060d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+14:11282:x1875738116536704:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 Request processed in 2586us (4122us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788843580.832910:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 83 00000100:00100000:0.0:1788843580.840129:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843580.840243:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116536832 00000100:00100000:3.0:1788843580.840254:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116536832 00000100:00100000:3.0:1788843580.840346:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 84 00000100:00100000:3.0:1788843580.840357:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd006755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+14:11282:x1875738116536832:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788843580.840377:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843580.840401:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d163a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490989 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.840472:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d1641 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.840486:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d1641 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.840498:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d1641 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.840793:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d163a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490989 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.840810:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d1641 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490989 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.840819:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9bd007450d00) 00010000:00010000:3.0:1788843580.840822:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788843580.840826:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd118f71e00, rc 0) 00000100:00100000:3.0:1788843580.840887:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd006755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+15:11282:x1875738116536832:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 532us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843580.840895:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 84 00000100:00100000:0.0:1788843580.843336:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843580.844007:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116537088 00000100:00100000:2.0:1788843580.844018:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116537088 00000100:00100000:2.0:1788843580.844087:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 85 00000100:00100000:2.0:1788843580.844099:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd006757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+15:11282:x1875738116537088:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788843580.844200:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1648 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.844216:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1648 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.844226:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1648 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788843580.844389:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1788843580.844398:0:9517:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 358897256340ns, next at 359897254330ns, rc = 0 00000004:00010000:2.0:1788843580.844449:0:9517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000591f5760 reply state 0000000002a05454 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1648 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.844462:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1648 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.844470:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9bd007450d00) 00010000:00010000:2.0:1788843580.844473:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788843580.844476:0:9517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788843580.844578:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd006757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+17:11282:x1875738116537088:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 Request processed in 480us (1249us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1788843580.844585:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 85 00000100:00100000:2.0:1788843580.847697:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843580.847837:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116537216 00000100:00100000:3.0:1788843580.847847:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116537216 00000100:00100000:3.0:1788843580.847911:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 86 00000100:00100000:3.0:1788843580.847923:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+17:11282:x1875738116537216:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788843580.847945:0:11996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843580.847967:0:11996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d164f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490990 expref: -99 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.848034:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d164f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490990 expref: 18 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.848049:0:11996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d164f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490990 expref: 18 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.848066:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9bd007450d00) 00010000:00010000:3.0:1788843580.848069:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788843580.848072:0:11996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd118f70000, rc 0) 00000100:00100000:3.0:1788843580.848133:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+18:11282:x1875738116537216:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 213us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843580.848159:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 86 00000100:00100000:3.0:1788843580.853981:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843580.854110:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116537344 00000100:00100000:2.0:1788843580.854120:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116537344 00000100:00100000:2.0:1788843580.854204:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 33 00000100:00100000:2.0:1788843580.854212:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1060d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2386:x1875738116537344:12345-192.168.203.33@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1788843580.854244:0:8421:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f25f61b6-5faf-4e05-81a4-dea3dba05dc5@192.168.203.33@tcp t0 exp 0000000000000000 cur 358 last 0 00000020:00000080:2.0:1788843580.854275:0:8421:0:(genops.c:1385:class_connect()) connect: client f25f61b6-5faf-4e05-81a4-dea3dba05dc5, cookie 0xa762dfcbd58d1656 00002000:00100000:2.0:1788843580.854288:0:8421:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f25f61b6-5faf-4e05-81a4-dea3dba05dc5/ffff9bd141bd3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788843580.854309:0:8421:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788843580.854392:0:8421:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788843580.854420:0:8421:0:(import.c:65:import_set_state_nolock()) ffff9bd141bd1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788843580.854486:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1060d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2386:x1875738116537344:12345-192.168.203.33@tcp:8:lhsmtool_posix.0 Request processed in 273us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843580.854493:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 33 00000100:00100000:2.0:1788843580.862758:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843580.863160:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116537472 00000100:00100000:1.0:1788843580.863171:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116537472 00000100:00100000:1.0:1788843580.863233:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 34 00000100:00100000:1.0:1788843580.863243:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:0:x1875738116537472:12345-192.168.203.33@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788843580.867116:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1788843580.870834:0:9500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:2.0:1788843580.870852:0:9500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f25f61b6-5faf-4e05-81a4-dea3dba05dc5 00000100:00100000:1.0:1788843580.871004:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:0:x1875738116537472:12345-192.168.203.33@tcp:2:lhsmtool_posix.0 Request processed in 7758us (8250us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788843580.871016:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 34 00000100:00100000:0.0:1788843580.889685:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843580.889842:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116537728 00000100:00100000:3.0:1788843580.889852:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116537728 00000100:00100000:3.0:1788843580.889909:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 19 00000100:00100000:3.0:1788843580.889919:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd006754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+18:11282:x1875738116537728:12345-192.168.203.33@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788843580.890132:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd006754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+19:11282:x1875738116537728:12345-192.168.203.33@tcp:35:lhsmtool_posix.0 Request processed in 214us (848us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1788843580.890168:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 19 00000100:00100000:3.0:1788843580.892647:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843580.892786:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116537984 00000100:00100000:0.0:1788843580.892795:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116537984 00000100:00100000:0.0:1788843580.892854:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 87 00000100:00100000:0.0:1788843580.892866:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1060d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+19:11282:x1875738116537984:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788843580.897691:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1060d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+19:11282:x1875738116537984:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 Request processed in 4818us (5043us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843580.897707:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 87 00000100:00100000:3.0:1788843580.903260:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843580.903298:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116538112 00000100:00100000:3.0:1788843580.903307:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116538112 00000100:00100000:3.0:1788843580.903369:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 88 00000100:00100000:3.0:1788843580.903393:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1060d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+19:11282:x1875738116538112:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788843580.903414:0:9517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843580.903435:0:9517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d165d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490997 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.903508:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1664 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.903525:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1664 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.903537:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1664 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843580.903582:0:9517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788843580.903601:0:9517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1664 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.903628:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d165d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490997 expref: 21 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.903648:0:9517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1664 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490997 expref: 20 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.903656:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9bd007450d00) 00010000:00010000:3.0:1788843580.903659:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788843580.903663:0:9517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd118f70200, rc 0) 00000100:00100000:3.0:1788843580.904061:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1060d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+20:11282:x1875738116538112:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 668us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843580.904078:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 88 00000100:00100000:3.0:1788843580.912955:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843580.913219:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116538240 00000100:00100000:2.0:1788843580.913228:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116538240 00000100:00100000:2.0:1788843580.913284:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 35 00000100:00100000:2.0:1788843580.913294:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1060d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2390:x1875738116538240:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788843580.913320:0:8421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843580.913343:0:8421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084109c26/0xa762dfcbd58d166b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f2249099e expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788843580.913366:0:8421:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f963b, blocks: 0x0 00010000:00010000:2.0:1788843580.913384:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=358s v=(0 0) 00010000:00010000:2.0:1788843580.913389:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843580.913406:0:8421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084109c26/0xa762dfcbd58d166b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249099e expref: 6 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.913429:0:8421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000084109c26/0xa762dfcbd58d166b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249099e expref: 6 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843580.913445:0:8421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007947c00, rc 0) 00000100:00100000:2.0:1788843580.913706:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1060d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2390:x1875738116538240:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 412us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843580.913713:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 35 00000100:00100000:3.0:1788843580.922049:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843580.922185:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116538496 00000100:00100000:1.0:1788843580.922195:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116538496 00000100:00100000:1.0:1788843580.922251:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 89 00000100:00100000:1.0:1788843580.922261:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+20:11282:x1875738116538496:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788843580.922366:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+20:11282:x1875738116538496:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 Request processed in 106us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843580.922380:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 89 00000100:00100000:1.0:1788843580.925517:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843580.925658:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116538624 00000100:00100000:3.0:1788843580.925668:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116538624 00000100:00100000:3.0:1788843580.925776:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 36 00000100:00100000:3.0:1788843580.925787:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:11282:x1875738116538624:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788843580.925805:0:8423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843580.925826:0:8423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000685f98e5/0xa762dfcbd58d1672 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f224909a5 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.925856:0:8423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000084109c26/0xa762dfcbd58d166b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249099e expref: 7 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.925866:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843580.925871:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843580.925876:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000685f98e5/0xa762dfcbd58d1672 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909a5 expref: 7 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.925908:0:8423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000084109c26/0xa762dfcbd58d166b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249099e expref: 7 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.925922:0:8423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000084109c26/0xa762dfcbd58d166b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249099e expref: 7 pid: 8421 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843580.925936:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8423:1875738134450048:192.168.203.33@tcp:104: 00000100:00100000:3.0:1788843580.926068:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1102c26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843580.931777:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843580.931921:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116538752 00000100:00100000:1.0:1788843580.931931:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116538752 00010000:00010000:1.0:1788843580.931973:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000084109c26/0xa762dfcbd58d166b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249099e expref: 8 pid: 8421 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843580.932020:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 59 00000100:00100000:1.0:1788843580.932031:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd006754a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:2389:x1875738116538752:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843580.932068:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843580.932092:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000084109c26/0xa762dfcbd58d166b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249099e expref: 8 pid: 8421 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843580.932107:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000084109c26/0xa762dfcbd58d166b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249099e expref: 8 pid: 8421 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843580.932133:0:6493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843580.932161:0:6493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843580.932172:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000685f98e5/0xa762dfcbd58d1672 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909a5 expref: 8 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843580.932185:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000685f98e5/0xa762dfcbd58d1672 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909a5 expref: 8 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843580.932229:0:6493:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000685f98e5/0xa762dfcbd58d1672 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909a5 expref: 8 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843580.932255:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6493:1875738134450176:192.168.203.33@tcp:105: 00000100:00100000:1.0:1788843580.932351:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00747ce40 going to sleep for 11 seconds 00010000:00010000:3.0:1788843580.932533:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084109c26/0xa762dfcbd58d166b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249099e expref: 8 pid: 8421 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843580.932548:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8423:1875738134450048:192.168.203.33@tcp:104: 00010000:00010000:3.0:1788843580.932570:0:8423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000685f98e5/0xa762dfcbd58d1672 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909a5 expref: 7 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.932579:0:8423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd118f71c00, rc 0) 00000100:00100000:3.0:1788843580.932621:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:11282:x1875738116538624:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 6835us (7112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843580.932629:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 36 00000100:00100000:3.0:1788843580.947221:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843580.947296:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116538880 00000100:00100000:2.0:1788843580.947306:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116538880 00002000:00100000:2.0:1788843580.947364:0:8429:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9bd1054e7100 x1875738116538880/t0(0) o4->f25f61b6-5faf-4e05-81a4-dea3dba05dc5@192.168.203.33@tcp:196/0 lens 504/0 e 0 to 0 dl 1788843591 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788843580.947376:0:8429:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd1054e7100 with x1875738116538880 ext(0->8) 00002000:00010000:2.0:1788843580.947382:0:8429:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bd1054e7100 00000100:00100000:2.0:1788843580.947415:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 0 00000100:00100000:2.0:1788843580.947425:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2390:x1875738116538880:12345-192.168.203.33@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788843580.948365:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6493:1875738134450176:192.168.203.33@tcp:105: 00010000:00010000:1.0:1788843580.948401:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843580.948463:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd006754a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+9:2389:x1875738116538752:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 16432us (16697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843580.948473:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 59 00000100:00100000:3.0:1788843580.949265:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:2390:x1875738116538880:12345-192.168.203.33@tcp:4:lhsmtool_posix.0 Request processed in 1837us (2050us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788843580.949275:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 0 00002000:00100000:3.0:1788843580.949285:0:8429:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9bd1054e7100 x1875738116538880/t4294967303(0) o4->f25f61b6-5faf-4e05-81a4-dea3dba05dc5@192.168.203.33@tcp:196/0 lens 504/448 e 0 to 0 dl 1788843591 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788843580.949295:0:8429:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd1054e7100 with x1875738116538880 ext(0->8) 00002000:00010000:3.0:1788843580.949301:0:8429:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bd1054e7100 00000100:00100000:1.0:1788843580.957660:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843580.961562:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116539008 00000100:00100000:0.0:1788843580.961580:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116539008 00000100:00100000:0.0:1788843580.961648:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 90 00000100:00100000:0.0:1788843580.961658:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+20:11282:x1875738116539008:12345-192.168.203.33@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788843580.964254:0:6485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:0.0:1788843580.964292:0:6485:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788843580.964331:0:6485:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1788843580.964357:0:6538:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1788843580.964372:0:6538:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788843580.964494:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134450304:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788843580.964562:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+15:11282:x1875738116539008:12345-192.168.203.33@tcp:44:lhsmtool_posix.0 Request processed in 2896us (6902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843580.964588:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 90 00000100:00100000:3.0:1788843580.964598:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843580.964658:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134450304 00000100:00100000:3.0:1788843580.964665:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134450304 00000100:00100000:3.0:1788843580.964707:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788843580.964729:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00849b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134450304:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1788843580.964837:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1648 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843580.964851:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1648 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788843580.964862:0:8421:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00010000:00010000:1.0:1788843580.964862:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1648 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788843580.964874:0:8421:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788843580 00010000:00010000:1.0:1788843580.964883:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947400 already unused, calling callback (ffffffffc18b74f0) 00002000:00010000:3.0:1788843580.964884:0:8421:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788843580.964892:0:8421:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788843579 -> 1788843580 00010000:00010000:1.0:1788843580.964894:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1648 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788843580.964895:0:8421:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788843580.964912:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1648 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843580.964941:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9bd007450d00) 00010000:00010000:1.0:1788843580.964946:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788843580.964950:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00849b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3630:x1875738134450304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 220us (356us total) trans 4294967304 rc 0/0 00010000:00010000:1.0:1788843580.964955:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1648 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843580.964960:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:1.0:1788843580.964975:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1648 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788843580.965002:0:3630:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd141ae1c00/2, rc 0, transno 4294967304 00000100:00100000:3.0:1788843580.965010:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134450304:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788843580.969370:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843580.969440:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116539136 00000100:00100000:3.0:1788843580.969450:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116539136 00000100:00100000:3.0:1788843580.969505:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 38 00000100:00100000:3.0:1788843580.969515:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:2389:x1875738116539136:12345-192.168.203.33@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788843580.976265:0:9500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1788843580.976300:0:9500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1788843580.976579:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2389:x1875738116539136:12345-192.168.203.33@tcp:16:lhsmtool_posix.0 Request processed in 7053us (7207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843580.976596:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 38 00000100:00100000:0.0:1788843580.981419:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843580.981571:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116539392 00000100:00100000:3.0:1788843580.981580:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116539392 00000100:00100000:3.0:1788843580.981678:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 91 00000100:00100000:3.0:1788843580.981689:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+14:11282:x1875738116539392:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788843580.981755:0:11996:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843580.981800:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1664 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490997 expref: 14 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.981821:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9bd007450d00) 00010000:00010000:3.0:1788843580.981826:0:11996:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788843580.981854:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71400/0xa762dfcbd58d1679 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.981874:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71400/0xa762dfcbd58d1679 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.981883:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71400/0xa762dfcbd58d1679 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788843580.982249:0:11996:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a59d7204 reply state 000000009596abf8 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71400/0xa762dfcbd58d1679 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.982263:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71400/0xa762dfcbd58d1679 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.982269:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9bd007450d00) 00010000:00010000:3.0:1788843580.982272:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788843580.982275:0:11996:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788843580.982385:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+15:11282:x1875738116539392:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 Request processed in 696us (974us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1788843580.982394:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 91 00000100:00100000:2.0:1788843580.987849:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843580.988104:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116539520 00000100:00100000:3.0:1788843580.988119:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116539520 00000100:00100000:3.0:1788843580.988234:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 39 00000100:00100000:3.0:1788843580.988246:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2389:x1875738116539520:12345-192.168.203.33@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788843580.988481:0:8421:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788843580.988485:0:8421:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788843580 -> 1788843578 00002000:00010000:3.0:1788843580.988488:0:8421:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788843577 00002000:00010000:3.0:1788843580.988490:0:8421:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788843580 -> 1788843578 00002000:00010000:3.0:1788843580.988492:0:8421:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788843580.988571:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2389:x1875738116539520:12345-192.168.203.33@tcp:2:lhsmtool_posix.0 Request processed in 326us (736us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788843580.989404:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 39 00000100:00100000:1.0:1788843580.991705:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843580.992398:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116539776 00000100:00100000:3.0:1788843580.992414:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116539776 00000100:00100000:3.0:1788843580.992890:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 92 00000100:00100000:3.0:1788843580.992907:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+15:11282:x1875738116539776:12345-192.168.203.33@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788843580.993245:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1680 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.993265:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d1641 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490989 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.993274:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1680 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.993561:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d1641 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490989 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843580.993578:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d1641 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490989 expref: 15 pid: 6508 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843580.993593:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008499880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6506:1875738134450432:192.168.203.33@tcp:104: 00000100:00100000:3.0:1788843580.993685:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1102c2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788843581.001738:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843581.002053:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116539904 00000100:00100000:1.0:1788843581.002071:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116539904 00010000:00010000:1.0:1788843581.002307:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d1641 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490989 expref: 16 pid: 6508 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843581.002318:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008499880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6506:1875738134450432:192.168.203.33@tcp:104: 00010000:00010000:3.0:1788843581.002361:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1680 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843581.002381:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 60 00000100:00100000:1.0:1788843581.002398:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+16:2390:x1875738116539904:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843581.002419:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843581.002427:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d1641 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490989 expref: 16 pid: 6508 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.002444:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d1641 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490989 expref: 16 pid: 6508 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.002472:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d1641 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490989 expref: 16 pid: 6508 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.002495:0:7448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9bd007450d00) 00010000:00010000:1.0:1788843581.002517:0:7448:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1680 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.002528:0:7448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1680 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.002537:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1680 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.002570:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843581.002655:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+15:2390:x1875738116539904:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 263us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843581.002664:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 60 00010000:00010000:3.0:1788843581.003784:0:6506:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1680 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.003814:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1680 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.003854:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1680 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.003860:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1680 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.003867:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1680 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.003873:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd118f70200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1788843581.003878:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1680 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.003885:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1680 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.003902:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9bd007450d00) 00010000:00010000:3.0:1788843581.003905:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788843581.003910:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1680 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.003917:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1680 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843581.005156:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+14:11282:x1875738116539776:12345-192.168.203.33@tcp:55:lhsmtool_posix.0 Request processed in 12227us (13439us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788843581.005170:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 92 00000100:00100000:3.0:1788843581.010128:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843581.010438:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116540032 00000100:00100000:1.0:1788843581.010457:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116540032 00000100:00100000:1.0:1788843581.010550:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 40 00000100:00100000:1.0:1788843581.010563:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008499880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2389:x1875738116540032:12345-192.168.203.33@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788843581.010642:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b3d2a7e0/0xa762dfcbd58d1687 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.010668:0:8423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000685f98e5/0xa762dfcbd58d1672 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909a5 expref: 7 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.010679:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788843581.010685:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788843581.010691:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3d2a7e0/0xa762dfcbd58d1687 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.010740:0:8423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000685f98e5/0xa762dfcbd58d1672 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909a5 expref: 7 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.010776:0:8423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000685f98e5/0xa762dfcbd58d1672 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909a5 expref: 7 pid: 8423 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843581.010807:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8423:1875738134450560:192.168.203.33@tcp:104: 00000100:00100000:1.0:1788843581.010931:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00747ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788843581.013348:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8423:1875738134450560:192.168.203.33@tcp:104: 00010000:00010000:3.0:1788843581.013381:0:8423:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b3d2a7e0/0xa762dfcbd58d1687 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843581.015901:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00080000:2.0:1788843581.016014:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843581.021135:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116540160 00000100:00100000:0.0:1788843581.021205:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116540160 00010000:00010000:1.0:1788843581.021344:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000685f98e5/0xa762dfcbd58d1672 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909a5 expref: 8 pid: 8423 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843581.021476:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 61 00000100:00100000:1.0:1788843581.021491:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008498000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:2389:x1875738116540160:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843581.021513:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843581.021543:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000685f98e5/0xa762dfcbd58d1672 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909a5 expref: 8 pid: 8423 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.021559:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000685f98e5/0xa762dfcbd58d1672 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909a5 expref: 8 pid: 8423 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.021614:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000685f98e5/0xa762dfcbd58d1672 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909a5 expref: 8 pid: 8423 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.021635:0:6491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788843581.021640:0:6491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788843581.021646:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3d2a7e0/0xa762dfcbd58d1687 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.021683:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3d2a7e0/0xa762dfcbd58d1687 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.021733:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843581.021822:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008498000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2389:x1875738116540160:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 334us (5934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843581.021830:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 61 00010000:00010000:2.0:1788843581.021918:0:8423:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b3d2a7e0/0xa762dfcbd58d1687 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843581.021934:0:8423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3d2a7e0/0xa762dfcbd58d1687 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843581.023639:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b3d2a7e0/0xa762dfcbd58d1687 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843581.023657:0:8423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3d2a7e0/0xa762dfcbd58d1687 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843581.023666:0:8423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3d2a7e0/0xa762dfcbd58d1687 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843581.023674:0:8423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb35800 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843581.023678:0:8423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3d2a7e0/0xa762dfcbd58d1687 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843581.023687:0:8423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3d2a7e0/0xa762dfcbd58d1687 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843581.023706:0:8423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3d2a7e0/0xa762dfcbd58d1687 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843581.023722:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3d2a7e0/0xa762dfcbd58d1687 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843581.023837:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008499880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2389:x1875738116540032:12345-192.168.203.33@tcp:1:lhsmtool_posix.0 Request processed in 13271us (13713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843581.023846:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 40 00000100:00100000:3.0:1788843581.029636:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843581.035459:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116540416 00000100:00100000:0.0:1788843581.035481:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116540416 00000100:00100000:1.0:1788843581.036063:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 93 00000100:00100000:1.0:1788843581.036080:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00849bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+14:11282:x1875738116540416:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788843581.036278:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d168e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.036301:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d14ce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249092e expref: 14 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.036321:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d168e lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.036368:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d14ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249092e expref: 14 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.036386:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d14ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249092e expref: 14 pid: 11996 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843581.036405:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6508:1875738134450688:192.168.203.33@tcp:104: 00000100:00100000:1.0:1788843581.036590:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00747ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788843581.046448:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843581.046501:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6508:1875738134450688:192.168.203.33@tcp:104: 00010000:00010000:1.0:1788843581.046562:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d168e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843581.046697:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116540544 00000100:00100000:2.0:1788843581.046707:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116540544 00010000:00010000:2.0:1788843581.046763:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d14ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249092e expref: 15 pid: 11996 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843581.046828:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 62 00000100:00100000:2.0:1788843581.046840:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd133328450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+15:2389:x1875738116540544:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843581.046866:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843581.046876:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d14ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249092e expref: 15 pid: 11996 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843581.046890:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d14ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249092e expref: 15 pid: 11996 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843581.046919:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d14ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f2249092e expref: 15 pid: 11996 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843581.046936:0:7448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:2.0:1788843581.046943:0:7448:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d168e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843581.046956:0:7448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d168e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843581.046964:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d168e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843581.047058:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788843581.047071:0:6508:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d168e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.047082:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d168e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843581.047173:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd133328450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+14:2389:x1875738116540544:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 333us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843581.047200:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 62 00010000:00010000:1.0:1788843581.047388:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d1695 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.047401:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d164f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490990 expref: 14 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.047412:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d1695 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.047449:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d164f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490990 expref: 14 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.047464:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d164f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490990 expref: 14 pid: 11996 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843581.047480:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6508:1875738134450816:192.168.203.33@tcp:104: 00000100:00100000:1.0:1788843581.049108:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd11ae64600 going to sleep for 11 seconds 00000100:00100000:3.0:1788843581.055117:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6508:1875738134450816:192.168.203.33@tcp:104: 00010000:00010000:3.0:1788843581.055209:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d1695 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843581.055791:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843581.056055:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116540672 00000100:00100000:0.0:1788843581.056067:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116540672 00010000:00010000:0.0:1788843581.056111:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d164f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490990 expref: 15 pid: 11996 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843581.056176:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 63 00000100:00100000:0.0:1788843581.056188:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008499c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+15:2390:x1875738116540672:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843581.056205:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843581.056213:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d164f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490990 expref: 15 pid: 11996 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.056227:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d164f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490990 expref: 15 pid: 11996 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.056250:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d164f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490990 expref: 15 pid: 11996 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.056268:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9bd007450d00) 00010000:00010000:0.0:1788843581.056305:0:6493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d1695 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.056323:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d1695 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.056331:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d1695 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.056360:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843581.056425:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008499c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+14:2390:x1875738116540672:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 239us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843581.056435:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 63 00010000:00010000:0.0:1788843581.057018:0:6508:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d1695 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.057028:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d1695 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788843581.057190:0:6508:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:0.0:1788843581.057743:0:6508:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:0.0:1788843581.057786:0:6508:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:0.0:1788843581.057889:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6508:1875738134450944:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788843581.057950:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843581.058282:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10529e600 going to sleep for 11 seconds 00000100:00100000:3.0:1788843581.058959:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134450944 00000100:00100000:3.0:1788843581.058975:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134450944 00000100:00100000:3.0:1788843581.059091:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788843581.059104:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6508:x1875738134450944:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788843581.059296:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6508:x1875738134450944:12345-0@lo:1000:mdt00_002.0 Request processed in 195us (1345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843581.059306:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788843581.059677:0:6508:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788843581.059685:0:6508:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd141ae1c00, transno 4294967304 00000100:00100000:0.0:1788843581.059710:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6508:1875738134450944:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788843581.059936:0:6508:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:0.0:1788843581.060033:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6508:1875738134451072:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788843581.060098:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843581.060171:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134451072 00000100:00100000:0.0:1788843581.060178:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134451072 00000100:00100000:0.0:1788843581.060224:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788843581.060234:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6508:x1875738134451072:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788843581.061324:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10529e240 going to sleep for 11 seconds 00000100:00080000:1.0:1788843581.061357:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788843581.063692:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6508:x1875738134451072:12345-0@lo:1000:mdt00_002.0 Request processed in 3448us (3583us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788843581.063710:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788843581.063809:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6508:1875738134451072:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788843581.063900:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d1695 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.063914:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d1695 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.063922:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d1695 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.063930:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb34800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843581.063936:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d1695 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.063946:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d1695 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.063968:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9bd007450d00) 00010000:00010000:1.0:1788843581.063972:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788843581.063979:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d1695 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.063985:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d1695 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.064164:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d15ca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.064172:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d15ca lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.064179:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d15ca lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.064195:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843581.064199:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d15ca lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.064206:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d15ca lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.064216:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:1.0:1788843581.064218:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788843581.064222:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d15ca lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.064228:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d15ca lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.064285:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d169c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.064303:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d15e6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490974 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.064324:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d169c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.064371:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d15e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490974 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.064392:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d15e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490974 expref: 17 pid: 6507 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843581.064424:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6508:1875738134451200:192.168.203.33@tcp:104: 00000100:00100000:1.0:1788843581.064533:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd11ae64600 going to sleep for 11 seconds 00000100:00100000:3.0:1788843581.069964:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843581.070047:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116540800 00000100:00100000:2.0:1788843581.070060:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116540800 00010000:00010000:2.0:1788843581.070115:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d15e6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490974 expref: 18 pid: 6507 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843581.070186:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 64 00000100:00100000:2.0:1788843581.070199:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00849ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+18:2390:x1875738116540800:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843581.070219:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843581.070227:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d15e6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490974 expref: 18 pid: 6507 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843581.070243:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d15e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490974 expref: 18 pid: 6507 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843581.070275:0:7448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:2.0:1788843581.070283:0:7448:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d169c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843581.070295:0:7448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d169c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843581.070305:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d169c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843581.070340:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843581.070409:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00849ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+18:2390:x1875738116540800:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 212us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843581.070431:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 64 00010000:00010000:0.0:1788843581.074561:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d15e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490974 expref: 17 pid: 6507 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843581.074592:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6508:1875738134451200:192.168.203.33@tcp:104: 00010000:00010000:0.0:1788843581.074646:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d169c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.075119:0:6508:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d169c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.075129:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d169c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.079393:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d169c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.079419:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d169c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.079428:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d169c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.079450:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb35a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843581.079456:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d169c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.079467:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d169c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.079492:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:0.0:1788843581.079496:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843581.079502:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d169c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.079510:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d169c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.079526:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d168e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.079533:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d168e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.079540:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d168e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.079545:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb34200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843581.079549:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d168e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.079555:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d168e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.079578:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:0.0:1788843581.079580:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788843581.079584:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d168e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.079590:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d168e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788843581.079913:0:13785:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788843581.079918:0:13785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788843581.079936:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788843581.079943:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788843581.080068:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00849bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+16:11282:x1875738116540416:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 Request processed in 43984us (50435us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1788843581.080080:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 93 00000020:00080000:0.0:1788843581.080088:0:6508:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788843581.086753:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843581.086868:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116541056 00000100:00100000:3.0:1788843581.086881:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116541056 00000100:00100000:3.0:1788843581.086951:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 20 00000100:00100000:3.0:1788843581.086964:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+16:11282:x1875738116541056:12345-192.168.203.33@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788843581.087368:0:6510:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788843581.087411:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1788843581.087472:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d16a3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.087493:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d16a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.087506:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d16a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.087516:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d16a3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.087523:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d16a3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.087528:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d16a3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.087548:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788843581.087664:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+18:11282:x1875738116541056:12345-192.168.203.33@tcp:35:lhsmtool_posix.0 Request processed in 701us (924us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788843581.087674:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 20 00000020:00080000:3.0:1788843581.087680:0:6510:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788843581.088525:0:6495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843581.088539:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d16a3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843581.088550:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd118f70600 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843581.088555:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d16a3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843581.088566:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d16a3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843581.088584:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9bd007450d00) 00010000:00010000:2.0:1788843581.088588:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788843581.088593:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d16a3 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843581.088600:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d16a3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843581.088616:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843581.088618:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843581.088620:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788843581.267134:0:14201:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788843581.267358:0:14201:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788843581.267395:0:14201:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788843581.267403:0:14201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788843581.341705:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134451328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788843581.341806:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843581.341928:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134451328 00000100:00100000:1.0:1788843581.341938:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134451328 00000100:00100000:1.0:1788843581.342135:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788843581.342174:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134451328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788843581.342298:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788843581.342371:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134451328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 200us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843581.342379:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788843581.342441:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134451328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788843581.360238:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134451456:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788843581.360364:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843581.361012:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134451456 00000100:00100000:0.0:1788843581.361024:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134451456 00000100:00100000:0.0:1788843581.361770:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788843581.361866:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134451456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788843581.361918:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788843581.362022:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134451456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 240us (1658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843581.362030:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788843581.368678:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134451456:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788843581.390571:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843581.390656:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116541312 00000100:00100000:3.0:1788843581.390670:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116541312 00000100:00100000:3.0:1788843581.390750:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 94 00000100:00100000:3.0:1788843581.390763:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+18:11292:x1875738116541312:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1788843581.390794:0:11996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843581.390821:0:11996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d16aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f224909ac expref: -99 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.391411:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d16b1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.391433:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d16b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.391448:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d16b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843581.391461:0:11996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788843581.391603:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d16aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909ac expref: 21 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.391625:0:11996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d16b1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909ac expref: 20 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.391636:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bd007730100) 00010000:00010000:3.0:1788843581.391640:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788843581.391644:0:11996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd118f70600, rc 0) 00000100:00100000:3.0:1788843581.391735:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+20:11292:x1875738116541312:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 972us (1178us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788843581.391744:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 94 00000100:00100000:3.0:1788843581.397134:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843581.397529:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116541440 00000100:00100000:1.0:1788843581.397543:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116541440 00000100:00100000:1.0:1788843581.397627:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 95 00000100:00100000:1.0:1788843581.397641:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008498700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+20:11292:x1875738116541440:12345-192.168.203.33@tcp:34:lfs.0 00010000:00010000:1.0:1788843581.397753:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d16bf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.397777:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d16bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.397968:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d16bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.397991:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d16c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.397999:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d16c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.398006:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d16c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.398428:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d16cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.398441:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d16cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.398449:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d16cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788843581.398522:0:6506:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d16cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.398539:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d16bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.398547:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d16bf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.398554:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d16bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.398572:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb34800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843581.398578:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d16bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.398587:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d16bf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.398605:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bd007730100) 00010000:00010000:1.0:1788843581.398609:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843581.398615:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d16bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.398622:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d16bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.398638:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d16c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.398644:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d16c6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.398651:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d16c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.398656:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb34200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843581.398658:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d16c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.398665:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d16c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.398681:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bd007403100) 00010000:00010000:1.0:1788843581.398684:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843581.398687:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d16c6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.398693:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d16c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.398710:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d16cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.398716:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d16cd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.398722:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d16cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.398727:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb35a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843581.398730:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d16cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.398736:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d16cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.398742:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd007403000) 00010000:00010000:1.0:1788843581.398745:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843581.398747:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d16cd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.398753:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d16cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843581.399336:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008498700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+20:11292:x1875738116541440:12345-192.168.203.33@tcp:34:lfs.0 Request processed in 1687us (2269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843581.399349:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 95 00000100:00100000:2.0:1788843581.450620:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843581.450733:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116541696 00000100:00100000:0.0:1788843581.450747:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116541696 00000100:00100000:0.0:1788843581.450831:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 96 00000100:00100000:0.0:1788843581.450861:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1060d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+20:11295:x1875738116541696:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1788843581.450888:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843581.450915:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d16d4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f224909b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.451015:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d16db lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.451034:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d16db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.451049:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d16db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.451357:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d16e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.451368:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d16e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.451376:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d16e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.451539:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d16e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.451548:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d16e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.451555:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d16e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843581.451580:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788843581.451691:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d16db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.451699:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d16db lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.451706:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d16db lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.451712:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3ca00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843581.451718:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d16db lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.451726:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d16db lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.451741:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bd007730100) 00010000:00010000:0.0:1788843581.451745:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843581.451751:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d16db lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.451757:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d16db lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.451774:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d16e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.451780:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d16e2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.451796:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d16e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.451801:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3da00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843581.451804:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d16e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.451810:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d16e2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.451817:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bd0071de900) 00010000:00010000:0.0:1788843581.451820:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843581.451822:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d16e2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.451828:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d16e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.451880:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d16d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909b3 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.451895:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d16e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909b3 expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.451902:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd0071def00) 00010000:00010000:0.0:1788843581.451905:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788843581.451907:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3d200, rc 0) 00000100:00100000:0.0:1788843581.451994:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1060d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+22:11295:x1875738116541696:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1137us (1388us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788843581.452012:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 96 00000100:00100000:2.0:1788843581.456181:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843581.456943:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116541824 00000100:00100000:3.0:1788843581.456958:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116541824 00000100:00100000:3.0:1788843581.457183:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 97 00000100:00100000:3.0:1788843581.457197:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+22:11295:x1875738116541824:12345-192.168.203.33@tcp:54:lfs.0 00010000:00010000:3.0:1788843581.457533:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d16f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.457558:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d16f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.457574:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d16f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.457629:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d16f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.457637:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d16f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.457645:0:11996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d16f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.457652:0:11996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd118f70200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1788843581.457658:0:11996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d16f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.457668:0:11996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d16f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.457684:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd0071def00) 00010000:00010000:3.0:1788843581.457688:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788843581.457695:0:11996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d16f7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.457702:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d16f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843581.460777:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+22:11295:x1875738116541824:12345-192.168.203.33@tcp:54:lfs.0 Request processed in 949us (2015us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843581.460805:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 97 00000100:00100000:2.0:1788843581.463346:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843581.463415:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116542080 00000100:00100000:0.0:1788843581.463433:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116542080 00000100:00100000:0.0:1788843581.463511:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 21 00000100:00100000:0.0:1788843581.463525:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd133003850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+22:11295:x1875738116542080:12345-192.168.203.33@tcp:35:lfs.0 00000100:00100000:0.0:1788843581.463847:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd133003850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+23:11295:x1875738116542080:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 324us (515us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1788843581.463857:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 21 00000100:00100000:0.0:1788843581.504726:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843581.504776:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116542336 00000100:00100000:0.0:1788843581.505415:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116542336 00000100:00100000:0.0:1788843581.505824:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 98 00000100:00100000:0.0:1788843581.505839:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+23:10820:x1875738116542336:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:0.0:1788843581.506128:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843581.506180:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d16fe lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f224909ba expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.506432:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1705 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.506452:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d16e9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909b3 expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.506604:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1705 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.506654:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d16e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909b3 expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.506681:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d16e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909b3 expref: 24 pid: 6508 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843581.506714:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6506:1875738134451584:192.168.203.33@tcp:104: 00000100:00100000:0.0:1788843581.507428:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00747ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788843581.512698:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843581.512740:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116542464 00000100:00100000:3.0:1788843581.512754:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116542464 00010000:00010000:3.0:1788843581.512807:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d16e9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909b3 expref: 25 pid: 6508 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843581.512850:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 65 00000100:00100000:3.0:1788843581.512862:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00849b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+25:2390:x1875738116542464:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843581.512880:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843581.512888:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d16e9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909b3 expref: 25 pid: 6508 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.512903:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d16e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909b3 expref: 25 pid: 6508 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.512934:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd0071def00) 00010000:00010000:3.0:1788843581.512941:0:6493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1705 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.512953:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1705 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.512961:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1705 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.513006:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843581.515615:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00849b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+25:2390:x1875738116542464:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 2737us (2915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843581.515635:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 65 00010000:00010000:3.0:1788843581.515914:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d16e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909b3 expref: 24 pid: 6508 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843581.515937:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6506:1875738134451584:192.168.203.33@tcp:104: 00010000:00010000:3.0:1788843581.515979:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1705 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.515993:0:6506:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1705 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.515999:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1705 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843581.516025:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788843581.518755:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d16fe lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909ba expref: 25 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.518790:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1705 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909ba expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843581.518802:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd0071def00) 00010000:00010000:3.0:1788843581.518806:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788843581.518811:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3da00, rc 0) 00000100:00100000:3.0:1788843581.519032:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+24:10820:x1875738116542336:12345-192.168.203.33@tcp:101:bash.0 Request processed in 13194us (14319us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1788843581.519053:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 98 00000100:00100000:0.0:1788843581.523297:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843581.523362:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116542592 00000100:00100000:1.0:1788843581.523376:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116542592 00000100:00100000:1.0:1788843581.523467:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 99 00000100:00100000:1.0:1788843581.523480:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+24:10820:x1875738116542592:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:1.0:1788843581.523516:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843581.523548:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d1713 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f224909c1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.523597:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d171a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.523614:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d171a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.523626:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d171a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.523771:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d1713 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909c1 expref: 26 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.524244:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d171a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909c1 expref: 25 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.524256:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd0071def00) 00010000:00010000:1.0:1788843581.524269:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788843581.524274:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fb34800, rc 0) 00000100:00100000:1.0:1788843581.524368:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+25:10820:x1875738116542592:12345-192.168.203.33@tcp:101:bash.0 Request processed in 889us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843581.524376:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 99 00000100:00100000:1.0:1788843581.535489:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843581.535550:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116542848 00000100:00100000:1.0:1788843581.535564:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116542848 00000100:00100000:1.0:1788843581.535650:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 100 00000100:00100000:1.0:1788843581.535662:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+25:10820:x1875738116542848:12345-192.168.203.33@tcp:36:bash.0 00010000:00010000:1.0:1788843581.536334:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d1721 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.536364:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d1721 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.536379:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d1721 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788843581.536438:0:11996:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:1.0:1788843581.536466:0:11996:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd4b9a69 reply state 000000004bf95d50 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d1721 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.536481:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d1721 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.536490:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd0071def00) 00010000:00010000:1.0:1788843581.536494:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788843581.536498:0:11996:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788843581.536599:0:11996:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:1.0:1788843581.536737:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+29:10820:x1875738116542848:12345-192.168.203.33@tcp:36:bash.0 Request processed in 1074us (1257us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1788843581.536753:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 100 00000020:00080000:1.0:1788843581.536761:0:11996:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788843581.542391:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843581.543036:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116542976 00000100:00100000:1.0:1788843581.543063:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116542976 00000100:00100000:1.0:1788843581.543274:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 101 00000100:00100000:1.0:1788843581.543292:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd006756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+29:10820:x1875738116542976:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:1.0:1788843581.543333:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843581.543362:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34e00/0xa762dfcbd58d1728 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f224909c8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.543443:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34e00/0xa762dfcbd58d1728 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909c8 expref: 30 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.543461:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34e00/0xa762dfcbd58d1728 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909c8 expref: 30 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.543486:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd0071def00) 00010000:00010000:1.0:1788843581.543490:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788843581.543495:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fb34e00, rc 0) 00000100:00100000:1.0:1788843581.543580:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd006756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+30:10820:x1875738116542976:12345-192.168.203.33@tcp:101:bash.0 Request processed in 293us (1202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843581.543589:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 101 00000100:00100000:1.0:1788843581.549781:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843581.549877:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116543104 00000100:00100000:2.0:1788843581.549890:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116543104 00000100:00100000:2.0:1788843581.549965:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 41 00000100:00100000:2.0:1788843581.549978:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:10820:x1875738116543104:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:2.0:1788843581.550004:0:8901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843581.550032:0:8901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d6e2f2d/0xa762dfcbd58d172f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f224909cf expref: -99 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788843581.550073:0:8901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f963a, atime: 0x6a9f9639, ctime: 0x6a9f963a, blocks: 0x8 00010000:00010000:2.0:1788843581.550105:0:8901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=359s v=(0 0) 00010000:00010000:2.0:1788843581.550110:0:8901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843581.550120:0:8901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d6e2f2d/0xa762dfcbd58d172f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909cf expref: 7 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843581.550273:0:8901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008d6e2f2d/0xa762dfcbd58d172f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909cf expref: 7 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843581.550295:0:8901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007946e00, rc 0) 00000100:00100000:2.0:1788843581.550444:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:10820:x1875738116543104:12345-192.168.203.33@tcp:101:bash.0 Request processed in 467us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843581.550452:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 41 00000100:00100000:3.0:1788843581.553120:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843581.554642:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116543232 00000100:00100000:2.0:1788843581.554660:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116543232 00002000:00010000:2.0:1788843581.554720:0:8427:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:2.0:1788843581.554726:0:8427:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd00849a300 with x1875738116543232 ext(0->18446744073709551615) 00002000:00010000:2.0:1788843581.554759:0:8427:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bd00849a300. 00000100:00100000:2.0:1788843581.554840:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1 00000100:00100000:2.0:1788843581.554853:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00849a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2390:x1875738116543232:12345-192.168.203.33@tcp:10:bash.0 00002000:00010000:2.0:1788843581.555228:0:8427:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788843581.555232:0:8427:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788843578 -> 1788843580 00002000:00010000:2.0:1788843581.555235:0:8427:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1788843577 -> 1788843577 00002000:00010000:2.0:1788843581.555239:0:8427:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788843578 -> 1788843580 00002000:00010000:2.0:1788843581.555241:0:8427:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1788843581.555330:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00849a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:2390:x1875738116543232:12345-192.168.203.33@tcp:10:bash.0 Request processed in 478us (2224us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788843581.555338:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1 00002000:00010000:2.0:1788843581.555342:0:8427:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:2.0:1788843581.555345:0:8427:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd00849a300 with x1875738116543232 ext(0->18446744073709551615) 00002000:00010000:2.0:1788843581.555350:0:8427:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bd00849a300. 00010000:00010000:3.0:1788843581.594332:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843581.623717:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843581.624110:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116543360 00000100:00100000:1.0:1788843581.624125:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116543360 00000100:00100000:1.0:1788843581.624452:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 102 00000100:00100000:1.0:1788843581.624467:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+30:11309:x1875738116543360:12345-192.168.203.33@tcp:34:lfs.0 00010000:00010000:1.0:1788843581.624596:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d1736 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.624937:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d1736 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.624953:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d1736 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.625386:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d173d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.625398:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d173d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.625405:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d173d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.625505:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d1744 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.625517:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d1744 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.625525:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d1744 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788843581.625586:0:6508:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d1744 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.626733:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d1736 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.626777:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d1736 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.626786:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d1736 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.626794:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb34c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843581.626800:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d1736 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.626811:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d1736 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.626833:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bd007730100) 00010000:00010000:1.0:1788843581.626837:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843581.627203:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d1736 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.627214:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d1736 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.627238:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d173d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.627244:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d173d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.627251:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d173d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.627256:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb35800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843581.627267:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d173d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.627274:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d173d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.627284:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bd007403000) 00010000:00010000:1.0:1788843581.627287:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843581.627290:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d173d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.627296:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d173d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.627328:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d1744 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.627334:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d1744 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.627340:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d1744 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.627345:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb35a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843581.627348:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d1744 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.627354:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d1744 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.627361:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd0071def00) 00010000:00010000:1.0:1788843581.627364:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843581.627376:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d1744 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.627381:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d1744 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843581.627524:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+30:11309:x1875738116543360:12345-192.168.203.33@tcp:34:lfs.0 Request processed in 3054us (3815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843581.627534:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 102 00000100:00100000:1.0:1788843581.686913:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843581.692259:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116543616 00000100:00100000:0.0:1788843581.692288:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116543616 00000100:00100000:0.0:1788843581.692863:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 103 00000100:00100000:0.0:1788843581.692882:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+30:11312:x1875738116543616:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1788843581.692912:0:11996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843581.692944:0:11996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d174b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f224909d6 expref: -99 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.693067:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1752 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.693086:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1752 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.693102:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1752 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.693121:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1759 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.693129:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1759 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.693191:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1759 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.693352:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1760 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.693363:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1760 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.693843:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1760 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843581.693859:0:11996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788843581.694234:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1752 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.694244:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1752 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.694251:0:11996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1752 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.694258:0:11996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3c800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843581.694262:0:11996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1752 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.694270:0:11996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1752 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.694285:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bd007730100) 00010000:00010000:0.0:1788843581.694289:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843581.694317:0:11996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1752 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.694325:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1752 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.694342:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1759 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.694350:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1759 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.694356:0:11996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1759 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.694361:0:11996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843581.694364:0:11996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1759 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.694566:0:11996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1759 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.694579:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bd0071de900) 00010000:00010000:0.0:1788843581.694581:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843581.694585:0:11996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1759 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.694591:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1759 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.694652:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d174b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909d6 expref: 33 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.694688:0:11996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1760 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909d6 expref: 32 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.694696:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd0071def00) 00010000:00010000:0.0:1788843581.694699:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788843581.694702:0:11996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3dc00, rc 0) 00000100:00100000:0.0:1788843581.694812:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+32:11312:x1875738116543616:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1934us (7913us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1788843581.694821:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 103 00000100:00100000:3.0:1788843581.710759:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843581.711384:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116543744 00000100:00100000:2.0:1788843581.711399:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116543744 00000100:00100000:2.0:1788843581.711489:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 104 00000100:00100000:2.0:1788843581.711501:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+32:11312:x1875738116543744:12345-192.168.203.33@tcp:54:lfs.0 00010000:00010000:2.0:1788843581.711596:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d176e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843581.711617:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1705 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909ba expref: 32 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843581.711629:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d176e lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843581.711697:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1705 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909ba expref: 32 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843581.711714:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1705 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909ba expref: 32 pid: 6506 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843581.711731:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006754380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6507:1875738134451712:192.168.203.33@tcp:104: 00000100:00100000:2.0:1788843581.711854:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1331cc240 going to sleep for 11 seconds 00000100:00100000:0.0:1788843581.717497:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006754380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6507:1875738134451712:192.168.203.33@tcp:104: 00010000:00010000:0.0:1788843581.717546:0:6507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d176e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843581.722102:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843581.722340:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116544000 00000100:00100000:0.0:1788843581.722353:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116544000 00000100:00100000:0.0:1788843581.722427:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 22 00000100:00100000:0.0:1788843581.722438:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00849aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+33:6162:x1875738116544000:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788843581.722838:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00849aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+34:6162:x1875738116544000:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 401us (753us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1788843581.722847:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 22 00000100:00100000:2.0:1788843581.727891:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843581.728018:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116544128 00000100:00100000:1.0:1788843581.728032:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116544128 00010000:00010000:1.0:1788843581.728089:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1705 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909ba expref: 34 pid: 6506 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843581.728199:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 66 00000100:00100000:1.0:1788843581.728212:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd006754a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+34:2390:x1875738116544128:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843581.728234:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843581.728243:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1705 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909ba expref: 34 pid: 6506 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.728259:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1705 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909ba expref: 34 pid: 6506 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.728288:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1705 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909ba expref: 34 pid: 6506 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.728324:0:7448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd0071def00) 00010000:00010000:1.0:1788843581.728335:0:7448:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d176e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.728365:0:7448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d176e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.728385:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d176e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.728416:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843581.728490:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd006754a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+33:2390:x1875738116544128:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 280us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843581.728498:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 66 00010000:00010000:0.0:1788843581.729121:0:6507:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d176e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.729135:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d176e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.729237:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d176e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.729244:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d176e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.729251:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d176e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.729258:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843581.729263:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d176e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.729272:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d176e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.729287:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd0071def00) 00010000:00010000:0.0:1788843581.729291:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788843581.729295:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d176e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.729301:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d176e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843581.729464:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+32:11312:x1875738116543744:12345-192.168.203.33@tcp:54:lfs.0 Request processed in 17962us (18719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843581.729473:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 104 00000100:00100000:3.0:1788843581.732041:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843581.732179:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116544384 00000100:00100000:0.0:1788843581.732192:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116544384 00000100:00100000:0.0:1788843581.732260:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 23 00000100:00100000:0.0:1788843581.732296:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+32:11312:x1875738116544384:12345-192.168.203.33@tcp:35:lfs.0 00000100:00100000:0.0:1788843581.732616:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+33:11312:x1875738116544384:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 310us (573us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788843581.732625:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 23 00000100:00100000:1.0:1788843581.842110:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843581.842289:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116544640 00000100:00100000:0.0:1788843581.842302:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116544640 00000100:00100000:0.0:1788843581.842391:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 105 00000100:00100000:0.0:1788843581.842402:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+33:11323:x1875738116544640:12345-192.168.203.33@tcp:101:cat.0 00010000:00010000:0.0:1788843581.842437:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843581.842465:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1775 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f224909dd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.842558:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d177c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.842575:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d177c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.842588:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d177c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.842613:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1783 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.842622:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1783 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.842629:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1783 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.842789:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d178a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.842799:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d178a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.842805:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d178a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843581.842815:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788843581.842903:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d177c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.842911:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d177c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.842918:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d177c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.842924:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843581.842930:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d177c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.842938:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d177c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.842952:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bd007730100) 00010000:00010000:0.0:1788843581.842955:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843581.842960:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d177c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.842976:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d177c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.842991:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1783 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.842996:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1783 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.843003:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1783 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.843008:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3c800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843581.843011:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1783 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.843016:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1783 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.843022:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bd0071de900) 00010000:00010000:0.0:1788843581.843025:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843581.843027:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1783 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.843033:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1783 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.843072:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1775 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909dd expref: 36 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.843085:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d178a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909dd expref: 35 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.843098:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd0071def00) 00010000:00010000:0.0:1788843581.843100:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788843581.843103:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3da00, rc 0) 00000100:00100000:0.0:1788843581.843870:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+35:11323:x1875738116544640:12345-192.168.203.33@tcp:101:cat.0 Request processed in 1460us (1764us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1788843581.843885:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 105 00000100:00100000:1.0:1788843581.850904:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843581.851001:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116544896 00000100:00100000:0.0:1788843581.851014:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116544896 00000100:00100000:0.0:1788843581.851091:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 24 00000100:00100000:0.0:1788843581.851102:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+35:11323:x1875738116544896:12345-192.168.203.33@tcp:35:cat.0 00000100:00100000:0.0:1788843581.851749:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+36:11323:x1875738116544896:12345-192.168.203.33@tcp:35:cat.0 Request processed in 644us (855us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788843581.851759:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 24 00000100:00100000:3.0:1788843581.876636:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843581.876754:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116545152 00000100:00100000:0.0:1788843581.876768:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116545152 00000100:00100000:0.0:1788843581.876872:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 106 00000100:00100000:0.0:1788843581.876884:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+36:11324:x1875738116545152:12345-192.168.203.33@tcp:36:rm.0 00010000:00010000:0.0:1788843581.876964:0:11996:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1788843581.877014:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34e00/0xa762dfcbd58d1728 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909c8 expref: 36 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.877326:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d178a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909dd expref: 35 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.877347:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1760 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909d6 expref: 34 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.877379:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d171a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909c1 expref: 33 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.877390:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd0071def00) 00010000:00010000:0.0:1788843581.877396:0:11996:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788843581.877426:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1798 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.877444:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1798 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.877454:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1798 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.877471:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d179f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.877479:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d179f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.877485:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d179f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.877596:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d17a6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.877605:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d17a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.877612:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d17a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788843581.878334:0:11996:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1788843581.878351:0:11996:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 359931209421ns, next at 360931205413ns, rc = 0 00010000:00010000:0.0:1788843581.878417:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d17ad lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.878430:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d17ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.878441:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d17ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.878449:0:11996:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d17ad lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.878457:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d17ad lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.878465:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d17ad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.878492:0:11996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843581.878520:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d17a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.878527:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d17a6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.878534:0:11996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d17a6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.878542:0:11996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843581.878557:0:11996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d17a6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.878567:0:11996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d17a6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.878580:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd0071def00) 00010000:00010000:0.0:1788843581.878583:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788843581.878588:0:11996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d17a6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.878594:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d17a6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.878617:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1798 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.878624:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1798 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.878630:0:11996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1798 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.878635:0:11996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3ce00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843581.878638:0:11996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1798 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.878644:0:11996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1798 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.878651:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bd007730100) 00010000:00010000:0.0:1788843581.878654:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843581.878664:0:11996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1798 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.878670:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1798 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788843581.878682:0:11996:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fb4660f7 reply state 00000000056c554c transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d179f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.878695:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d179f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.878702:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bd0071de900) 00010000:00010000:0.0:1788843581.878704:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788843581.878708:0:11996:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788843581.878971:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+34:11324:x1875738116545152:12345-192.168.203.33@tcp:36:rm.0 Request processed in 2084us (2346us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1788843581.879242:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 106 00010000:00010000:1.0:1788843581.880455:0:10329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843581.880472:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d17ad lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.880486:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3cc00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843581.880491:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d17ad lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.880503:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d17ad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.880527:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd0071def00) 00010000:00010000:1.0:1788843581.880531:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788843581.880536:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d17ad lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.880542:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d17ad lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.880592:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843581.880594:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843581.880596:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843581.944055:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843581.944212:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116545408 00000100:00100000:0.0:1788843581.944235:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116545408 00000100:00100000:0.0:1788843581.944323:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 107 00000100:00100000:0.0:1788843581.944336:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+34:11330:x1875738116545408:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:0.0:1788843581.944371:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843581.944400:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d17b4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f224909e4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.944543:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d17bb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.944562:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d17bb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.944612:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d17bb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.944627:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d17c2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.944636:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d17c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.944643:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d17c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788843581.945078:0:6507:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788843581.945320:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d17c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.945332:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d17c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.945340:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d17c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.945381:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d17bb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.945388:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d17bb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.945394:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d17bb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.945401:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843581.945417:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d17bb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.945426:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d17bb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.945440:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bd007730100) 00010000:00010000:0.0:1788843581.945444:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843581.945448:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d17bb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.945455:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d17bb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788843581.945470:0:6507:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000116403b9 reply state 000000006d1edaee transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d17c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.945482:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d17c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.945489:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bd0071de900) 00010000:00010000:0.0:1788843581.945491:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788843581.945495:0:6507:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788843581.945532:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d17b4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909e4 expref: 37 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.945548:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d17c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909e4 expref: 36 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843581.945556:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd0071de000) 00010000:00010000:0.0:1788843581.945558:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788843581.945567:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3da00, rc 0) 00000100:00100000:0.0:1788843581.945660:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+37:11330:x1875738116545408:12345-192.168.203.33@tcp:101:bash.0 Request processed in 1325us (1620us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1788843581.945668:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 107 00000100:00100000:3.0:1788843581.953731:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843581.953829:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116545536 00000100:00100000:1.0:1788843581.953852:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116545536 00000100:00100000:1.0:1788843581.953932:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 42 00000100:00100000:1.0:1788843581.953945:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008499f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2390:x1875738116545536:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:1.0:1788843581.953970:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843581.953998:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000656f33f0/0xa762dfcbd58d17d7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f224909eb expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788843581.954031:0:8424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843581.954058:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=360s v=(0 0) 00010000:00010000:1.0:1788843581.954063:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843581.954075:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000656f33f0/0xa762dfcbd58d17d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909eb expref: 8 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.954098:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000656f33f0/0xa762dfcbd58d17d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909eb expref: 8 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.954115:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fb35a00, rc 0) 00000100:00100000:1.0:1788843581.954215:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008499f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:2390:x1875738116545536:12345-192.168.203.33@tcp:101:bash.0 Request processed in 273us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843581.954224:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 42 00000100:00100000:2.0:1788843581.964398:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843581.964484:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116545664 00000100:00100000:1.0:1788843581.964510:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116545664 00000100:00100000:1.0:1788843581.964586:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 43 00000100:00100000:1.0:1788843581.964598:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd006754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:11330:x1875738116545664:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:1.0:1788843581.964626:0:8901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843581.964652:0:8901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000125cbe84/0xa762dfcbd58d17de lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f224909f2 expref: -99 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.964711:0:8901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000656f33f0/0xa762dfcbd58d17d7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909eb expref: 9 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.964722:0:8901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843581.964727:0:8901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843581.964733:0:8901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000125cbe84/0xa762dfcbd58d17de lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909f2 expref: 9 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.964783:0:8901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000656f33f0/0xa762dfcbd58d17d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909eb expref: 9 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.964805:0:8901:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000656f33f0/0xa762dfcbd58d17d7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909eb expref: 9 pid: 8424 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843581.964825:0:8901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141bf2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8901:1875738134451840:192.168.203.33@tcp:104: 00000100:00100000:1.0:1788843581.964970:0:8901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10529e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788843581.973457:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843581.973565:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116545792 00000100:00100000:3.0:1788843581.973578:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116545792 00010000:00010000:3.0:1788843581.973630:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000656f33f0/0xa762dfcbd58d17d7 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909eb expref: 10 pid: 8424 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843581.973855:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 67 00000100:00100000:2.0:1788843581.973871:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+10:2389:x1875738116545792:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843581.973890:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843581.973919:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000656f33f0/0xa762dfcbd58d17d7 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909eb expref: 10 pid: 8424 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843581.973932:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000656f33f0/0xa762dfcbd58d17d7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909eb expref: 10 pid: 8424 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843581.973960:0:6493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843581.973964:0:6493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843581.973971:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000125cbe84/0xa762dfcbd58d17de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909f2 expref: 10 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843581.973980:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000125cbe84/0xa762dfcbd58d17de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909f2 expref: 10 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843581.974053:0:6493:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000125cbe84/0xa762dfcbd58d17de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909f2 expref: 10 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843581.974067:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141bfa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6493:1875738134451968:192.168.203.33@tcp:105: 00000100:00100000:2.0:1788843581.974195:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1331cc3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788843581.976673:0:8901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000656f33f0/0xa762dfcbd58d17d7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909eb expref: 10 pid: 8424 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843581.976732:0:8901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141bf2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8901:1875738134451840:192.168.203.33@tcp:104: 00010000:00010000:1.0:1788843581.976770:0:8901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000125cbe84/0xa762dfcbd58d17de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909f2 expref: 9 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843581.976789:0:8901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fb34800, rc 0) 00000100:00100000:1.0:1788843581.976883:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd006754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+9:11330:x1875738116545664:12345-192.168.203.33@tcp:101:bash.0 Request processed in 12286us (12503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843581.976892:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 43 00000100:00100000:2.0:1788843581.986025:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141bfa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6493:1875738134451968:192.168.203.33@tcp:105: 00010000:00010000:2.0:1788843581.986069:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843581.986280:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:2389:x1875738116545792:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 12412us (12834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843581.986294:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 67 00000100:00100000:0.0:1788843581.986590:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843581.987122:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116546048 00000100:00100000:2.0:1788843581.987134:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116546048 00000100:00100000:2.0:1788843581.987219:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 25 00000100:00100000:2.0:1788843581.987231:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+37:11330:x1875738116546048:12345-192.168.203.33@tcp:35:bash.0 00000100:00100000:2.0:1788843581.987817:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+38:11330:x1875738116546048:12345-192.168.203.33@tcp:35:bash.0 Request processed in 585us (1224us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788843581.987827:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 25 00000100:00100000:0.0:1788843582.189555:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843582.189682:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116546176 00000100:00100000:1.0:1788843582.189696:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116546176 00000100:00100000:1.0:1788843582.189786:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 108 00000100:00100000:1.0:1788843582.189800:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+38:11346:x1875738116546176:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1788843582.189836:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843582.189875:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d17e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f224909f9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.189965:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34e00/0xa762dfcbd58d17ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.189985:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34e00/0xa762dfcbd58d17ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.190002:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34e00/0xa762dfcbd58d17ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843582.190061:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788843582.190081:0:6508:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788843582.190109:0:6508:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34e00/0xa762dfcbd58d17ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.190203:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d17e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909f9 expref: 40 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.190508:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34e00/0xa762dfcbd58d17ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909f9 expref: 39 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.190520:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bd007730100) 00010000:00010000:1.0:1788843582.190523:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788843582.190528:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fb34e00, rc 0) 00000100:00100000:1.0:1788843582.190617:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+39:11346:x1875738116546176:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 819us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843582.190625:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 108 00000100:00100000:2.0:1788843582.198760:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843582.198880:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116546432 00000100:00100000:0.0:1788843582.198893:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116546432 00000100:00100000:0.0:1788843582.198979:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 109 00000100:00100000:0.0:1788843582.198992:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+39:11346:x1875738116546432:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1788843582.199022:0:11996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843582.199050:0:11996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d17f3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490a00 expref: -99 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843582.199372:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d17fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843582.199390:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d17fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843582.199404:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d17fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843582.199417:0:11996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788843582.199559:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d17f3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a00 expref: 42 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843582.199579:0:11996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d17fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a00 expref: 41 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843582.199608:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd0071de000) 00010000:00010000:0.0:1788843582.199611:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788843582.199614:0:11996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3d200, rc 0) 00000100:00100000:0.0:1788843582.199712:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+41:11346:x1875738116546432:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 722us (965us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1788843582.199720:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 109 00000100:00100000:3.0:1788843582.203582:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843582.203643:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843582.203761:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116546816 00000100:00100000:2.0:1788843582.203775:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116546816 00000100:00100000:2.0:1788843582.203858:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7 00000100:00100000:2.0:1788843582.203871:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00849a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+41:2389:x1875738116546816:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843582.203903:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843582.203959:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d17fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a00 expref: 41 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.203992:0:7448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd0071de000) 00010000:00010000:2.0:1788843582.204000:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843582.204079:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00849a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+40:2389:x1875738116546816:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 210us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843582.204087:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7 00000100:00100000:1.0:1788843582.206186:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116546688 00000100:00100000:1.0:1788843582.206208:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116546688 00000100:00100000:1.0:1788843582.206385:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 110 00000100:00100000:1.0:1788843582.206397:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008498a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+40:11346:x1875738116546688:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1788843582.206430:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843582.206458:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d1808 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490a07 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.206605:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d180f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.206625:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d180f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.206665:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d180f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843582.206681:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788843582.216718:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d1808 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a07 expref: 43 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.216765:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d180f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a07 expref: 42 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.217330:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd0071de000) 00010000:00010000:1.0:1788843582.217337:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788843582.217344:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fb34c00, rc 0) 00000100:00100000:1.0:1788843582.217635:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008498a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+42:11346:x1875738116546688:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 11237us (14067us total) trans 4294967381 rc 0/0 00000100:00100000:1.0:1788843582.217647:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 110 00000100:00100000:3.0:1788843582.234592:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843582.235063:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116546944 00000100:00100000:1.0:1788843582.235076:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116546944 00000100:00100000:1.0:1788843582.235256:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 44 00000100:00100000:1.0:1788843582.235270:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008498380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:2389:x1875738116546944:12345-192.168.203.33@tcp:1:lfs.0 00010000:00010000:1.0:1788843582.235345:0:8424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000656f33f0/0xa762dfcbd58d181d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.235373:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000125cbe84/0xa762dfcbd58d17de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909f2 expref: 8 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.235383:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843582.235406:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788843582.235411:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000656f33f0/0xa762dfcbd58d181d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.235458:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000125cbe84/0xa762dfcbd58d17de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909f2 expref: 8 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.235474:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000125cbe84/0xa762dfcbd58d17de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909f2 expref: 8 pid: 8901 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843582.235503:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141bf2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8424:1875738134452096:192.168.203.33@tcp:104: 00000100:00100000:1.0:1788843582.235638:0:8424:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10529e840 going to sleep for 11 seconds 00000100:00100000:0.0:1788843582.239089:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843582.239938:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141bf2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8424:1875738134452096:192.168.203.33@tcp:104: 00010000:00010000:3.0:1788843582.240028:0:8424:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000656f33f0/0xa762dfcbd58d181d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843582.240075:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116547072 00000100:00100000:3.0:1788843582.240083:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116547072 00002000:00100000:3.0:1788843582.240156:0:8429:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9bd0084e2d80 x1875738116547072/t0(0) o4->f25f61b6-5faf-4e05-81a4-dea3dba05dc5@192.168.203.33@tcp:198/0 lens 504/0 e 0 to 0 dl 1788843593 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788843582.240261:0:8429:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd0084e2d80 with x1875738116547072 ext(0->8) 00010000:00010000:3.0:1788843582.240271:0:8429:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000125cbe84/0xa762dfcbd58d17de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909f2 expref: 9 pid: 8901 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788843582.240298:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788843582.240319:0:8429:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000125cbe84/0xa762dfcbd58d17de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909f2 expref: 9 pid: 8901 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788843582.240327:0:8429:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bd0084e2d80 00000100:00100000:0.0:1788843582.240480:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1 00000100:00100000:0.0:1788843582.240495:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+9:2390:x1875738116547072:12345-192.168.203.33@tcp:4:lfs.0 00000100:00100000:0.0:1788843582.243619:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+11:2390:x1875738116547072:12345-192.168.203.33@tcp:4:lfs.0 Request processed in 3110us (4525us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788843582.243636:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1 00002000:00100000:0.0:1788843582.243654:0:8428:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9bd0084e2d80 x1875738116547072/t4294967303(0) o4->f25f61b6-5faf-4e05-81a4-dea3dba05dc5@192.168.203.33@tcp:198/0 lens 504/448 e 0 to 0 dl 1788843593 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788843582.243665:0:8428:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd0084e2d80 with x1875738116547072 ext(0->8) 00010000:00010000:0.0:1788843582.243682:0:8428:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000125cbe84/0xa762dfcbd58d17de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909f2 expref: 11 pid: 8901 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843582.243708:0:8428:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000125cbe84/0xa762dfcbd58d17de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909f2 expref: 11 pid: 8901 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788843582.243717:0:8428:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bd0084e2d80 00000100:00100000:0.0:1788843582.253435:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843582.253601:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116547200 00000100:00100000:3.0:1788843582.253616:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116547200 00010000:00010000:3.0:1788843582.253671:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000125cbe84/0xa762dfcbd58d17de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909f2 expref: 11 pid: 8901 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843582.253724:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 68 00000100:00100000:3.0:1788843582.253736:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13332a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+11:2389:x1875738116547200:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843582.253766:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788843582.253792:0:6491:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788843582.253795:0:6491:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788843581 00002000:00010000:3.0:1788843582.253798:0:6491:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788843581 00002000:00010000:3.0:1788843582.253800:0:6491:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788843581 00002000:00010000:3.0:1788843582.253803:0:6491:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788843582.253811:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000125cbe84/0xa762dfcbd58d17de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909f2 expref: 11 pid: 8901 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.253827:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000125cbe84/0xa762dfcbd58d17de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909f2 expref: 11 pid: 8901 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.253861:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000125cbe84/0xa762dfcbd58d17de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909f2 expref: 11 pid: 8901 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.253910:0:6491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788843582.253914:0:6491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788843582.253921:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000656f33f0/0xa762dfcbd58d181d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.253933:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000656f33f0/0xa762dfcbd58d181d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.253976:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843582.254053:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13332a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+10:2389:x1875738116547200:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 319us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843582.254061:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 68 00010000:00010000:1.0:1788843582.254499:0:8424:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000656f33f0/0xa762dfcbd58d181d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.254513:0:8424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000656f33f0/0xa762dfcbd58d181d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.254540:0:8424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000656f33f0/0xa762dfcbd58d181d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.254550:0:8424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000656f33f0/0xa762dfcbd58d181d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.254559:0:8424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000656f33f0/0xa762dfcbd58d181d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.254582:0:8424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb35a00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843582.254588:0:8424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000656f33f0/0xa762dfcbd58d181d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.254599:0:8424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000656f33f0/0xa762dfcbd58d181d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.254612:0:8424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000656f33f0/0xa762dfcbd58d181d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.254620:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000656f33f0/0xa762dfcbd58d181d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843582.254689:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008498380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+9:2389:x1875738116546944:12345-192.168.203.33@tcp:1:lfs.0 Request processed in 19423us (20113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843582.254698:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 44 00000100:00100000:0.0:1788843582.277379:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843582.278004:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116547456 00000100:00100000:3.0:1788843582.278018:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116547456 00000100:00100000:3.0:1788843582.278745:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 26 00000100:00100000:3.0:1788843582.278765:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd133003c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+42:11346:x1875738116547456:12345-192.168.203.33@tcp:35:lfs.0 00000004:00010000:3.0:1788843582.278987:0:6510:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d180f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a07 expref: 42 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788843582.279714:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1788843582.279758:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1788843582.281407:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:3.0:1788843582.281496:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1824 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.281521:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d17c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909e4 expref: 46 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.281684:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1824 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.281738:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d17c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909e4 expref: 46 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.281760:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d17c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909e4 expref: 46 pid: 6507 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843582.281782:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008499c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6510:1875738134452224:192.168.203.33@tcp:104: 00000100:00100000:3.0:1788843582.282074:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00749b000 going to sleep for 11 seconds 00000100:00100000:3.0:1788843582.290424:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008499c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6510:1875738134452224:192.168.203.33@tcp:104: 00010000:00010000:3.0:1788843582.290478:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1824 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843582.299697:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843582.300481:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116547584 00000100:00100000:2.0:1788843582.300498:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116547584 00010000:00010000:2.0:1788843582.300558:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d17c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909e4 expref: 47 pid: 6507 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843582.300660:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 69 00000100:00100000:2.0:1788843582.300673:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+47:2389:x1875738116547584:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843582.300694:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843582.300702:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d17c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909e4 expref: 47 pid: 6507 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.300717:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d17c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909e4 expref: 47 pid: 6507 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.300745:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d17c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909e4 expref: 47 pid: 6507 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.300770:0:7448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd0071de000) 00010000:00010000:2.0:1788843582.300788:0:7448:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1824 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.300819:0:7448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1824 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.300829:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1824 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.300888:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843582.301039:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+46:2389:x1875738116547584:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 368us (1357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843582.301048:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 69 00010000:00010000:0.0:1788843582.301119:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1824 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843582.301128:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1824 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788843582.301343:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:0.0:1788843582.301487:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:0.0:1788843582.301625:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6510:1875738134452352:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788843582.301700:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843582.301744:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd102d360c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843582.304700:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134452352 00000100:00100000:0.0:1788843582.304724:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134452352 00000100:00100000:0.0:1788843582.304847:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788843582.304861:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6510:x1875738134452352:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:3.0:1788843582.305240:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843582.305328:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6510:x1875738134452352:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 469us (3626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843582.305339:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788843582.305379:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6510:1875738134452352:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788843582.305625:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:3.0:1788843582.305732:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008499c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6510:1875738134452480:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788843582.305788:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843582.305828:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd11220a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843582.306394:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134452480 00000100:00100000:0.0:1788843582.306404:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134452480 00000100:00100000:0.0:1788843582.306458:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788843582.306468:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00849ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6510:x1875738134452480:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788843582.307212:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00849ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6510:x1875738134452480:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 742us (1421us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788843582.307223:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788843582.308520:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008499c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6510:1875738134452480:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788843582.308633:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:3.0:1788843582.308723:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1824 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.308757:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1824 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.308765:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1824 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.308772:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd118f70200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1788843582.309276:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1824 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.309288:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1824 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.309320:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd0071de000) 00010000:00010000:3.0:1788843582.309323:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788843582.309329:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1824 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.309335:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1824 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788843582.309498:0:6510:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788843582.309586:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1788843582.309602:0:6510:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 360362460370ns, next at 361362456313ns, rc = 0 00000001:00080000:3.0:1788843582.309611:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:3.0:1788843582.309649:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd0071de000) 00010000:00010000:3.0:1788843582.309652:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788843582.309662:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d180f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a07 expref: 50 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843582.310733:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd133003c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+49:11346:x1875738116547456:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 31963us (33357us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788843582.310749:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 26 00000020:00080000:2.0:1788843582.310757:0:6510:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788843582.314031:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843582.314405:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116547712 00000100:00100000:1.0:1788843582.314418:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116547712 00000100:00100000:1.0:1788843582.314498:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 111 00000100:00100000:1.0:1788843582.314510:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+49:11346:x1875738116547712:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1788843582.314541:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843582.314571:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d182b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490a0e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.314650:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d182b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a0e expref: 50 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.314685:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d182b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a0e expref: 50 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.314708:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd007403000) 00010000:00010000:1.0:1788843582.314711:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788843582.314715:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fb35800, rc 0) 00000100:00100000:1.0:1788843582.314801:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+50:11346:x1875738116547712:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 293us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843582.314809:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 111 00000100:00100000:1.0:1788843582.322275:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843582.323087:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116547968 00000100:00100000:2.0:1788843582.323102:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116547968 00000100:00100000:2.0:1788843582.323462:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 27 00000100:00100000:2.0:1788843582.323476:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+50:11346:x1875738116547968:12345-192.168.203.33@tcp:35:lfs.0 00000100:00100000:2.0:1788843582.324000:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+51:11346:x1875738116547968:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 525us (1862us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788843582.324010:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 27 00000100:00100000:0.0:1788843582.442552:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843582.442727:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116548096 00000100:00100000:1.0:1788843582.442741:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116548096 00000100:00100000:1.0:1788843582.442821:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 112 00000100:00100000:1.0:1788843582.442835:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+51:11356:x1875738116548096:12345-192.168.203.33@tcp:34:lfs.0 00010000:00010000:1.0:1788843582.442956:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d1832 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.442979:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d1832 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.442993:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d1832 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.443007:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d1839 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.443016:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d1839 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.443031:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d1839 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.443122:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d1840 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.443128:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d1840 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.443132:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d1840 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788843582.443250:0:11996:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d1840 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.443265:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d1832 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.443271:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d1832 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.443279:0:11996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d1832 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.443285:0:11996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb35a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843582.443289:0:11996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d1832 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.443297:0:11996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d1832 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.443322:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bd007730100) 00010000:00010000:1.0:1788843582.443331:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843582.443337:0:11996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d1832 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.443343:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d1832 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.443357:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d1839 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.443362:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d1839 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.443367:0:11996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d1839 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.443372:0:11996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb34800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843582.443374:0:11996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d1839 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.443380:0:11996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d1839 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.443386:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bd0071de900) 00010000:00010000:1.0:1788843582.443388:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843582.443391:0:11996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d1839 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.443395:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d1839 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.443404:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d1840 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.443418:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d1840 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.443423:0:11996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d1840 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.443427:0:11996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb34c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843582.443429:0:11996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d1840 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.443435:0:11996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d1840 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.443442:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd007403000) 00010000:00010000:1.0:1788843582.443444:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843582.443446:0:11996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d1840 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.443451:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d1840 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843582.444004:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+51:11356:x1875738116548096:12345-192.168.203.33@tcp:34:lfs.0 Request processed in 1166us (1461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843582.444016:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 112 00000100:00100000:3.0:1788843582.479322:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843582.479475:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116548352 00000100:00100000:1.0:1788843582.479488:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116548352 00000100:00100000:1.0:1788843582.479568:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 113 00000100:00100000:1.0:1788843582.479581:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00849b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+51:11359:x1875738116548352:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1788843582.479613:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843582.479661:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d1847 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490a15 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.480863:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d184e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.480888:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d184e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.480902:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d184e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.480915:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d1855 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.480923:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d1855 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.480930:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d1855 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.481103:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea200/0xa762dfcbd58d185c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.481112:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea200/0xa762dfcbd58d185c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.481119:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea200/0xa762dfcbd58d185c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843582.481132:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788843582.481253:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d184e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.481272:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d184e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.481279:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d184e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.481286:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb34800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843582.481292:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d184e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.481313:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d184e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.481329:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bd007730100) 00010000:00010000:1.0:1788843582.481332:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843582.481338:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d184e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.481344:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34800/0xa762dfcbd58d184e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.481361:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d1855 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.481367:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d1855 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.481373:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d1855 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.481379:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb35a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843582.481388:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d1855 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.481396:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d1855 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.481404:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bd0071de900) 00010000:00010000:1.0:1788843582.481408:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843582.481411:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d1855 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.481416:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35a00/0xa762dfcbd58d1855 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.482293:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34c00/0xa762dfcbd58d1847 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a15 expref: 54 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.482332:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea200/0xa762dfcbd58d185c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a15 expref: 53 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.482341:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd007403000) 00010000:00010000:1.0:1788843582.482344:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788843582.482346:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fbea200, rc 0) 00000100:00100000:1.0:1788843582.482473:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00849b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+53:11359:x1875738116548352:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2892us (3172us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1788843582.482483:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 113 00000100:00100000:3.0:1788843582.485072:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843582.485585:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116548480 00000100:00100000:2.0:1788843582.485600:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116548480 00000100:00100000:2.0:1788843582.485716:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 114 00000100:00100000:2.0:1788843582.485729:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00849a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+53:11359:x1875738116548480:12345-192.168.203.33@tcp:54:lfs.0 00010000:00010000:2.0:1788843582.485948:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d186a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.486060:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d186a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.486075:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d186a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.486124:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d186a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.486133:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d186a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.486172:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d186a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.486179:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843582.486185:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d186a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.486194:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d186a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.486209:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd007403000) 00010000:00010000:2.0:1788843582.486213:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788843582.486219:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d186a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.486227:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d186a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843582.486342:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00849a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+53:11359:x1875738116548480:12345-192.168.203.33@tcp:54:lfs.0 Request processed in 615us (1285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843582.486358:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 114 00000100:00100000:2.0:1788843582.489332:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843582.489435:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116548736 00000100:00100000:0.0:1788843582.489449:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116548736 00000100:00100000:0.0:1788843582.489558:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 28 00000100:00100000:0.0:1788843582.489571:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+53:11359:x1875738116548736:12345-192.168.203.33@tcp:35:lfs.0 00000100:00100000:0.0:1788843582.489902:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+54:11359:x1875738116548736:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 332us (585us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1788843582.489911:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 28 00000100:00100000:3.0:1788843582.609909:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843582.610266:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116548992 00000100:00100000:2.0:1788843582.610281:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116548992 00000100:00100000:2.0:1788843582.610370:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 115 00000100:00100000:2.0:1788843582.610384:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00849b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+54:11369:x1875738116548992:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:2.0:1788843582.610417:0:9517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843582.610422:0:9517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788843582.610459:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34e00/0xa762dfcbd58d17ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909f9 expref: 54 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.610484:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bd007730100) 00010000:00010000:2.0:1788843582.610490:0:9517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788843582.610508:0:9517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1871 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490a1c expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.610649:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d1878 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.610666:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d1878 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.610676:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d1878 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843582.610688:0:9517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788843582.610818:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1871 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a1c expref: 56 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.611425:0:9517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d1878 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a1c expref: 55 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.611434:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd007403000) 00010000:00010000:2.0:1788843582.611437:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843582.611441:0:9517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007947c00, rc 0) 00000100:00100000:2.0:1788843582.611539:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00849b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+55:11369:x1875738116548992:12345-192.168.203.33@tcp:101:bash.0 Request processed in 1152us (1639us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788843582.611552:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 115 00000100:00100000:1.0:1788843582.619483:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843582.619625:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843582.619834:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116549120 00000100:00100000:0.0:1788843582.619848:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116549120 00000100:00100000:0.0:1788843582.619934:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 8 00000100:00100000:0.0:1788843582.619947:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+55:2387:x1875738116549120:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843582.619969:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843582.620003:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d1878 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a1c expref: 55 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843582.620029:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd007403000) 00010000:00010000:0.0:1788843582.620035:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843582.620103:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+54:2387:x1875738116549120:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 158us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843582.620111:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 8 00010000:00010000:2.0:1788843582.620451:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843582.620739:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116549248 00000100:00100000:3.0:1788843582.620746:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116549248 00000100:00100000:3.0:1788843582.620805:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 116 00000100:00100000:3.0:1788843582.620815:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+54:11369:x1875738116549248:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:3.0:1788843582.620842:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843582.620863:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1886 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490a23 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.620906:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d188d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.620923:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d188d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.620937:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d188d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.621108:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1886 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a23 expref: 56 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.621125:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d188d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a23 expref: 55 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.621133:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd007403000) 00010000:00010000:3.0:1788843582.621161:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788843582.621166:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd118f70000, rc 0) 00000100:00100000:3.0:1788843582.621225:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+55:11369:x1875738116549248:12345-192.168.203.33@tcp:101:bash.0 Request processed in 412us (1599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843582.621232:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 116 00000100:00100000:1.0:1788843582.639759:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843582.639902:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116549504 00000100:00100000:2.0:1788843582.640581:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116549504 00000100:00100000:2.0:1788843582.640720:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 117 00000100:00100000:2.0:1788843582.640735:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+55:11369:x1875738116549504:12345-192.168.203.33@tcp:36:bash.0 00010000:00010000:2.0:1788843582.640808:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843582.640846:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea200/0xa762dfcbd58d185c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a15 expref: 55 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.640871:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd007403000) 00010000:00010000:2.0:1788843582.640878:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788843582.641130:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1894 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.641204:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1894 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.641219:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1894 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788843582.641434:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:2.0:1788843582.641466:0:6507:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe1790ce reply state 000000003b18f676 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1894 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.641481:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1894 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.641488:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd007403000) 00010000:00010000:2.0:1788843582.641491:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788843582.641494:0:6507:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788843582.641636:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+57:11369:x1875738116549504:12345-192.168.203.33@tcp:36:bash.0 Request processed in 902us (1889us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788843582.641644:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 117 00000020:00080000:2.0:1788843582.641650:0:6507:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788843582.645016:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843582.645403:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116549632 00000100:00100000:2.0:1788843582.645419:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116549632 00000100:00100000:2.0:1788843582.645496:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 118 00000100:00100000:2.0:1788843582.645506:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+57:11369:x1875738116549632:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:2.0:1788843582.645536:0:9517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843582.645561:0:9517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d189b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490a2a expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.645673:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d18a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.645688:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d18a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.645698:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d18a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843582.645735:0:9517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788843582.645739:0:9517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788843582.645763:0:9517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d18a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.645796:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d189b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a2a expref: 59 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.645817:0:9517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d18a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a2a expref: 58 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.645827:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd007403000) 00010000:00010000:2.0:1788843582.645830:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843582.645835:0:9517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007947400, rc 0) 00000100:00100000:2.0:1788843582.645985:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+58:11369:x1875738116549632:12345-192.168.203.33@tcp:101:bash.0 Request processed in 478us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843582.645993:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 118 00000100:00100000:1.0:1788843582.652628:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843582.652743:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116549888 00000100:00100000:2.0:1788843582.652827:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116549888 00000100:00100000:2.0:1788843582.653023:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 29 00000100:00100000:2.0:1788843582.653037:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+58:11369:x1875738116549888:12345-192.168.203.33@tcp:35:bash.0 00000100:00100000:2.0:1788843582.653869:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+59:11369:x1875738116549888:12345-192.168.203.33@tcp:35:bash.0 Request processed in 826us (1249us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1788843582.653880:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 29 00000100:00100000:1.0:1788843582.728311:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843582.728585:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116550016 00000100:00100000:2.0:1788843582.728598:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116550016 00000100:00100000:2.0:1788843582.728698:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 119 00000100:00100000:2.0:1788843582.728710:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+59:11375:x1875738116550016:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1788843582.728742:0:11996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843582.728768:0:11996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d18a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490a31 expref: -99 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.728864:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946200/0xa762dfcbd58d18b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.728882:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946200/0xa762dfcbd58d18b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.728896:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946200/0xa762dfcbd58d18b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843582.728958:0:11996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788843582.728963:0:11996:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788843582.729172:0:11996:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946200/0xa762dfcbd58d18b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.729203:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d18a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a31 expref: 61 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.729226:0:11996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946200/0xa762dfcbd58d18b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a31 expref: 60 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.729236:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bd007730100) 00010000:00010000:2.0:1788843582.729239:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788843582.729243:0:11996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007946200, rc 0) 00000100:00100000:2.0:1788843582.729328:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+60:11375:x1875738116550016:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 620us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843582.729345:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 119 00000100:00100000:1.0:1788843582.740287:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843582.740425:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116550144 00000100:00100000:2.0:1788843582.740443:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116550144 00000100:00100000:2.0:1788843582.740533:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 120 00000100:00100000:2.0:1788843582.740545:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+60:11375:x1875738116550144:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1788843582.740782:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843582.740810:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d18b7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490a38 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.740910:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d18be lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.740938:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d18be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.740956:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d18be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.741112:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d18c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.741126:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d18c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.741134:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d18c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.741368:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d18cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.741400:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d18cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.741408:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d18cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843582.741582:0:6507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788843582.741587:0:6507:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788843582.741609:0:6507:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d18cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.741624:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d18cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.741633:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d18be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.741639:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d18be lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.741645:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d18be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.741651:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843582.741656:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d18be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.741665:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d18be lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.741680:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bd007730100) 00010000:00010000:2.0:1788843582.741684:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843582.741696:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d18be lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.741703:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d18be lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.741721:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d18c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.741727:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d18c5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.741733:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d18c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.741738:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843582.741742:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d18c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.741748:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d18c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.741756:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bd0071de900) 00010000:00010000:2.0:1788843582.741758:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843582.741761:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d18c5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.741766:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d18c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.742676:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d18b7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a38 expref: 62 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.742716:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d18cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a38 expref: 61 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.742724:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd007403000) 00010000:00010000:2.0:1788843582.742727:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843582.742731:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007947000, rc 0) 00000100:00100000:2.0:1788843582.742851:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+61:11375:x1875738116550144:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2306us (2580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843582.742862:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 120 00000100:00100000:1.0:1788843582.747473:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843582.747636:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116550400 00000100:00100000:3.0:1788843582.747651:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116550400 00000100:00100000:3.0:1788843582.747728:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 121 00000100:00100000:3.0:1788843582.747741:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+61:11375:x1875738116550400:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1788843582.747767:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843582.747804:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d18d3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490a3f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.747949:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d18da lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.748084:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d18a2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a2a expref: 62 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.748096:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d18cc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a38 expref: 62 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.748106:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d18da lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.748190:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d18cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a38 expref: 62 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.748207:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d18cc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a38 expref: 62 pid: 6507 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843582.748243:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00849aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6506:1875738134452608:192.168.203.33@tcp:104: 00010000:00010000:3.0:1788843582.748387:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d18a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a2a expref: 62 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.748398:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d18a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a2a expref: 62 pid: 9517 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843582.748407:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008498e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6506:1875738134452736:192.168.203.33@tcp:104: 00000100:00100000:3.0:1788843582.748434:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00749b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788843582.751986:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843582.752795:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116550528 00000100:00100000:3.0:1788843582.752812:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116550528 00010000:00010000:3.0:1788843582.752875:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d18cc lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a38 expref: 63 pid: 6507 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843582.752992:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 70 00000100:00100000:3.0:1788843582.753005:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+63:2388:x1875738116550528:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843582.753023:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843582.753031:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d18cc lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a38 expref: 63 pid: 6507 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.753047:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d18cc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a38 expref: 63 pid: 6507 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.753077:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd007403000) 00010000:00010000:3.0:1788843582.753083:0:6492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d18da lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.753113:0:6492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d18da lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.753122:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843582.753251:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+63:2388:x1875738116550528:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 247us (1287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843582.753259:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 70 00000100:00100000:1.0:1788843582.760512:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843582.761208:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116550656 00000100:00100000:0.0:1788843582.761224:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116550656 00010000:00010000:0.0:1788843582.761283:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d18a2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a2a expref: 63 pid: 9517 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843582.761356:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 71 00000100:00100000:0.0:1788843582.761369:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+63:2390:x1875738116550656:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843582.761410:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843582.761420:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d18a2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a2a expref: 63 pid: 9517 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843582.761437:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d18a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a2a expref: 63 pid: 9517 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843582.761480:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd007403000) 00010000:00010000:0.0:1788843582.761487:0:6493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d18da lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843582.761499:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d18da lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843582.761508:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d18da lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843582.761533:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843582.761614:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+63:2390:x1875738116550656:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 247us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843582.761623:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 71 00010000:00010000:3.0:1788843582.762067:0:6506:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.33@tcp) returned -22 from blocking AST (req@00000000d0af988a x1875738134452608) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d18cc lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a38 expref: 62 pid: 6507 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.762087:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d18cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a38 expref: 62 pid: 6507 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843582.762109:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00849aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6506:1875738134452608:192.168.203.33@tcp:104: 00010000:00010000:3.0:1788843582.762127:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d18a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a2a expref: 61 pid: 9517 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843582.762137:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008498e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6506:1875738134452736:192.168.203.33@tcp:104: 00010000:00010000:3.0:1788843582.762229:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd007403000) 00010000:00010000:3.0:1788843582.762237:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d18da lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.762247:0:6506:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d18da lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.762253:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d18da lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843582.762292:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788843582.762507:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d18d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a3f expref: 62 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.762527:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d18da lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a3f expref: 61 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843582.762536:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd007403000) 00010000:00010000:3.0:1788843582.762539:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788843582.762542:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd118f71c00, rc 0) 00000100:00100000:3.0:1788843582.762597:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+61:11375:x1875738116550400:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 14858us (15156us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1788843582.762606:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 121 00000100:00100000:1.0:1788843582.766259:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843582.766379:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116550912 00000100:00100000:2.0:1788843582.766392:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116550912 00000100:00100000:2.0:1788843582.766476:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 9 00000100:00100000:2.0:1788843582.766488:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+61:11375:x1875738116550912:12345-192.168.203.33@tcp:103:lfs.0 00010000:00010000:2.0:1788843582.766509:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843582.766547:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35800/0xa762dfcbd58d182b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a0e expref: 61 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.766570:0:7448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd007403000) 00010000:00010000:2.0:1788843582.766577:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843582.766652:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+60:11375:x1875738116550912:12345-192.168.203.33@tcp:103:lfs.0 Request processed in 165us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843582.766660:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 9 00000100:00100000:2.0:1788843582.769007:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843582.769327:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116551040 00000100:00100000:1.0:1788843582.769340:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116551040 00000100:00100000:1.0:1788843582.769419:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 122 00000100:00100000:1.0:1788843582.769431:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+60:11375:x1875738116551040:12345-192.168.203.33@tcp:58:lfs.0 00010000:00010000:1.0:1788843582.769625:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea000/0xa762dfcbd58d18e8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.769650:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea000/0xa762dfcbd58d18e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843582.769664:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea000/0xa762dfcbd58d18e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788843582.770090:0:11996:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788843582.771020:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+60:11375:x1875738116551040:12345-192.168.203.33@tcp:58:lfs.0 Request processed in 1579us (2017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843582.771037:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 122 00000100:00100000:1.0:1788843582.781704:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843582.782739:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116551168 00000100:00100000:2.0:1788843582.782756:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116551168 00000100:00100000:2.0:1788843582.782859:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 123 00000100:00100000:2.0:1788843582.782871:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+60:11375:x1875738116551168:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1788843582.782897:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843582.782924:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d18ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490a46 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.783067:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea000/0xa762dfcbd58d18e8 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.783081:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d18ef lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a46 expref: 61 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.783106:0:6507:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea000/0xa762dfcbd58d18e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.783122:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d18ef lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a46 expref: 61 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.783139:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd007403000) 00010000:00010000:2.0:1788843582.783241:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788843582.783246:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d18ef lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a46 expref: 61 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843582.783254:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007947c00, rc 0) 00000100:00100000:2.0:1788843582.783679:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+61:11375:x1875738116551168:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 808us (1989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843582.783689:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 123 00000040:00080000:0.0:1788843583.131081:0:13785:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788843583.131098:0:13785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788843583.131191:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788843583.131204:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788843583.131409:0:13785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e0000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13785:1875738134452864:192.168.203.33@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788843583.131560:0:13785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd102d36300 going to sleep for 11 seconds 00000100:00100000:0.0:1788843583.136916:0:13785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e0000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13785:1875738134452864:192.168.203.33@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788843583.141651:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843583.141958:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116551296 00000100:00100000:3.0:1788843583.141980:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116551296 00000100:00100000:3.0:1788843583.142079:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 124 00000100:00100000:3.0:1788843583.142092:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+61:11376:x1875738116551296:12345-192.168.203.33@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788843583.142135:0:6506:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788843583.142331:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+61:11376:x1875738116551296:12345-192.168.203.33@tcp:53:lhsmtool_posix.0 Request processed in 242us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843583.142340:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 124 00000100:00080000:2.0:1788843583.142458:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843583.147043:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843583.147212:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116551424 00000100:00100000:2.0:1788843583.147225:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116551424 00000100:00100000:2.0:1788843583.147312:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 125 00000100:00100000:2.0:1788843583.147326:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+61:11376:x1875738116551424:12345-192.168.203.33@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788843583.147425:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d18f6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.147448:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d18f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.147463:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d18f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.147492:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d18fd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.147499:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d18fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.147506:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d18fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.147534:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1904 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.147543:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1904 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.147550:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1904 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843583.147611:0:11996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788843583.147758:0:11996:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788843583.147775:0:11996:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1904 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.147790:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d18f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.147797:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d18f6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.147804:0:11996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d18f6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.147810:0:11996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843583.147815:0:11996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d18f6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.147824:0:11996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d18f6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.147840:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd00746cd00) 00010000:00010000:2.0:1788843583.147844:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843583.147850:0:11996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d18f6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.147857:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d18f6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.147873:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d18fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.147881:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d18fd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.147898:0:11996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d18fd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.147903:0:11996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843583.147906:0:11996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d18fd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.147912:0:11996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d18fd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.147920:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9bd13dfdaf00) 00010000:00010000:2.0:1788843583.147922:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843583.147926:0:11996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d18fd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.147932:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d18fd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.147948:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1904 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.147954:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1904 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.147959:0:11996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1904 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.147973:0:11996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843583.147976:0:11996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1904 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.147992:0:11996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1904 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.148001:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd007403000) 00010000:00010000:2.0:1788843583.148003:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843583.148006:0:11996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1904 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.148011:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d1904 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843583.148114:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+61:11376:x1875738116551424:12345-192.168.203.33@tcp:34:lhsmtool_posix.0 Request processed in 789us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843583.148124:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 125 00000100:00100000:1.0:1788843583.159110:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843583.159278:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116551680 00000100:00100000:0.0:1788843583.159290:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116551680 00000100:00100000:0.0:1788843583.159373:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 126 00000100:00100000:0.0:1788843583.159385:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+61:11376:x1875738116551680:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788843583.159416:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843583.159446:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d190b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490a4d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.159598:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1912 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.159761:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1912 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.159779:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1912 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843583.159795:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788843583.159905:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1912 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.159913:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1912 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.159920:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1912 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.159926:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843583.159930:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1912 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.159955:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1912 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.159973:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd007403000) 00010000:00010000:0.0:1788843583.159977:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788843583.159983:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1912 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.159989:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1912 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.160042:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d190b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a4d expref: 63 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.160054:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd00746cd00) 00010000:00010000:0.0:1788843583.160056:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788843583.160061:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d190b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a4d expref: 63 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.160071:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3ca00, rc 0) 00000100:00100000:0.0:1788843583.160230:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+62:11376:x1875738116551680:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 847us (1137us total) trans 4294967399 rc 301/301 00000100:00100000:0.0:1788843583.160239:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 126 00000100:00100000:1.0:1788843583.176323:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843583.176600:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116551808 00000100:00100000:0.0:1788843583.176614:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116551808 00000100:00100000:0.0:1788843583.176774:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 127 00000100:00100000:0.0:1788843583.176788:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+62:11376:x1875738116551808:12345-192.168.203.33@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788843583.176849:0:9517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788843583.177025:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+62:11376:x1875738116551808:12345-192.168.203.33@tcp:53:lhsmtool_posix.0 Request processed in 240us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843583.177837:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 127 00000100:00100000:1.0:1788843583.200315:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843583.201197:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116552064 00000100:00100000:0.0:1788843583.201214:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116552064 00000100:00100000:0.0:1788843583.201322:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 128 00000100:00100000:0.0:1788843583.201338:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+62:11376:x1875738116552064:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788843583.201370:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843583.201374:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788843583.201415:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946200/0xa762dfcbd58d18b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a31 expref: 62 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.201443:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bd007730100) 00010000:00010000:0.0:1788843583.201450:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788843583.201488:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1920 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490a54 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788843583.202868:0:6507:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788843583.203131:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1927 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.203178:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1927 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.203190:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1927 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.203294:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1920 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a54 expref: 64 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.203331:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1927 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a54 expref: 63 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.203339:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9bd0071deb00) 00010000:00010000:0.0:1788843583.203343:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788843583.203345:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3d800, rc 0) 00000100:00100000:0.0:1788843583.203443:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+63:11376:x1875738116552064:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 2108us (3151us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788843583.203453:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 128 00000100:00100000:1.0:1788843583.208545:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843583.208655:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116552320 00000100:00100000:3.0:1788843583.208669:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116552320 00000100:00100000:3.0:1788843583.208746:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 129 00000100:00100000:3.0:1788843583.208759:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+63:11376:x1875738116552320:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788843583.208866:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843583.208906:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1927 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a54 expref: 63 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.208929:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9bd0071deb00) 00010000:00010000:3.0:1788843583.208942:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788843583.208984:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1935 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.209002:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1935 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.209012:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1935 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.209027:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d193c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x9f808cbb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.209044:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d193c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x9f808cbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.209052:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d193c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x9f808cbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.209116:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1935 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.209124:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1935 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.209131:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1935 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.209200:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd118f70200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1788843583.209206:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1935 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.209214:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1935 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.209224:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bd007730100) 00010000:00010000:3.0:1788843583.209227:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843583.209232:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1935 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.209238:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1935 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.209253:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d193c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x9f808cbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.209258:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d193c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x9f808cbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.209264:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d193c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x9f808cbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.209270:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd118f71e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1788843583.209273:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d193c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x9f808cbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.209279:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d193c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x9f808cbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.209313:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x9f808cbb (ffff9bd007450800) 00010000:00010000:3.0:1788843583.209316:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843583.209319:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d193c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x9f808cbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.209324:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d193c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x9f808cbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843583.209439:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+62:11376:x1875738116552320:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 Request processed in 683us (912us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788843583.209448:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 129 00000100:00100000:1.0:1788843583.213747:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843583.213901:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116552448 00000100:00100000:0.0:1788843583.213914:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116552448 00000100:00100000:0.0:1788843583.214007:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 130 00000100:00100000:0.0:1788843583.214022:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+62:11376:x1875738116552448:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788843583.214052:0:9517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843583.214084:0:9517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1943 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490a5b expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.214133:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d194a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.214192:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d194a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.214205:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d194a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.214386:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1943 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a5b expref: 64 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.214410:0:9517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d194a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a5b expref: 63 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.214420:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9bd0071de600) 00010000:00010000:0.0:1788843583.214424:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788843583.214428:0:9517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3d200, rc 0) 00000100:00100000:0.0:1788843583.214875:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+63:11376:x1875738116552448:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 854us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843583.214885:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 130 00000100:00100000:1.0:1788843583.225380:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843583.225511:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116552704 00000100:00100000:0.0:1788843583.225525:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116552704 00000100:00100000:0.0:1788843583.225606:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 131 00000100:00100000:0.0:1788843583.225627:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+63:11376:x1875738116552704:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788843583.225746:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1951 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.225769:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1951 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.225783:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1951 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788843583.226025:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:0.0:1788843583.226038:0:6507:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 361278896383ns, next at 362278892355ns, rc = 0 00000004:00010000:0.0:1788843583.226129:0:6507:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b5e034c7 reply state 00000000f53e0128 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1951 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.226200:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1951 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.226210:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9bd0071de600) 00010000:00010000:0.0:1788843583.226214:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788843583.226218:0:6507:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788843583.226352:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+65:11376:x1875738116552704:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 Request processed in 735us (987us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788843583.226362:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 131 00000100:00100000:2.0:1788843583.230295:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843583.230478:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116552832 00000100:00100000:1.0:1788843583.230490:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116552832 00000100:00100000:1.0:1788843583.230582:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 132 00000100:00100000:1.0:1788843583.230595:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+65:11376:x1875738116552832:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788843583.230625:0:11996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843583.230654:0:11996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeba00/0xa762dfcbd58d1958 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490a62 expref: -99 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.230733:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeba00/0xa762dfcbd58d1958 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a62 expref: 66 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.230751:0:11996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeba00/0xa762dfcbd58d1958 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a62 expref: 66 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.230775:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9bd0071de600) 00010000:00010000:1.0:1788843583.230779:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788843583.230783:0:11996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fbeba00, rc 0) 00000100:00100000:1.0:1788843583.230863:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+66:11376:x1875738116552832:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 271us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843583.230871:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 132 00000100:00100000:1.0:1788843583.234211:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843583.234396:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116552960 00000100:00100000:3.0:1788843583.234410:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116552960 00000100:00100000:3.0:1788843583.234514:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 45 00000100:00100000:3.0:1788843583.234529:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:2390:x1875738116552960:12345-192.168.203.33@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788843583.234923:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788843583.235069:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+9:2390:x1875738116552960:12345-192.168.203.33@tcp:2:lhsmtool_posix.0 Request processed in 543us (873us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788843583.235079:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 45 00000100:00100000:3.0:1788843583.247050:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843583.247243:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116553216 00000100:00100000:0.0:1788843583.247258:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116553216 00000100:00100000:0.0:1788843583.247350:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 30 00000100:00100000:0.0:1788843583.247362:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+66:11376:x1875738116553216:12345-192.168.203.33@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788843583.247699:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+67:11376:x1875738116553216:12345-192.168.203.33@tcp:35:lhsmtool_posix.0 Request processed in 337us (664us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1788843583.247709:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 30 00000100:00100000:0.0:1788843583.256029:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843583.258810:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116553472 00000100:00100000:2.0:1788843583.258831:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116553472 00000100:00100000:2.0:1788843583.258911:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 133 00000100:00100000:2.0:1788843583.258925:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+67:11376:x1875738116553472:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788843583.259094:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+67:11376:x1875738116553472:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 Request processed in 172us (3080us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843583.259104:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 133 00000100:00100000:1.0:1788843583.268513:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843583.269065:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116553600 00000100:00100000:3.0:1788843583.269079:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116553600 00000100:00100000:3.0:1788843583.269188:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 134 00000100:00100000:3.0:1788843583.269201:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+67:11376:x1875738116553600:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788843583.269227:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843583.269255:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d195f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490a69 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.269802:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1966 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.269826:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1966 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.269841:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1966 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843583.269900:0:6506:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788843583.269929:0:6506:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1966 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.269964:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71e00/0xa762dfcbd58d195f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a69 expref: 69 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.269986:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1966 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a69 expref: 68 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.269996:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9bd0071de600) 00010000:00010000:3.0:1788843583.269999:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788843583.270004:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd118f70200, rc 0) 00000100:00100000:3.0:1788843583.270092:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+68:11376:x1875738116553600:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 893us (1594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843583.270101:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 134 00000100:00100000:3.0:1788843583.282718:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843583.285231:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116553728 00000100:00100000:2.0:1788843583.285249:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116553728 00000100:00100000:2.0:1788843583.285345:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 46 00000100:00100000:2.0:1788843583.285356:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fda9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+9:2388:x1875738116553728:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788843583.285400:0:8423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843583.285427:0:8423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070f1b190/0xa762dfcbd58d196d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490a70 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788843583.285459:0:8423:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f963e, blocks: 0x0 00010000:00010000:2.0:1788843583.285495:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=361s v=(0 0) 00010000:00010000:2.0:1788843583.285500:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843583.285511:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070f1b190/0xa762dfcbd58d196d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a70 expref: 10 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.285533:0:8423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000070f1b190/0xa762dfcbd58d196d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a70 expref: 10 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.285547:0:8423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007946c00, rc 0) 00000100:00100000:2.0:1788843583.285637:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fda9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+10:2388:x1875738116553728:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 282us (2934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843583.285644:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 46 00000100:00100000:0.0:1788843583.289668:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843583.289770:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116553984 00000100:00100000:2.0:1788843583.289782:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116553984 00000100:00100000:2.0:1788843583.289853:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 135 00000100:00100000:2.0:1788843583.289867:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+68:11376:x1875738116553984:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788843583.290025:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+68:11376:x1875738116553984:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 Request processed in 161us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843583.290034:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 135 00000100:00100000:3.0:1788843583.292749:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843583.292930:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116554112 00000100:00100000:1.0:1788843583.292961:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116554112 00000100:00100000:1.0:1788843583.293042:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 47 00000100:00100000:1.0:1788843583.293056:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00849aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+10:11376:x1875738116554112:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788843583.293080:0:8901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843583.293105:0:8901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063bbee92/0xa762dfcbd58d1974 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490a77 expref: -99 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.293201:0:8901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000070f1b190/0xa762dfcbd58d196d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a70 expref: 11 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.293213:0:8901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843583.293219:0:8901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843583.293225:0:8901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063bbee92/0xa762dfcbd58d1974 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a77 expref: 11 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.293273:0:8901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000070f1b190/0xa762dfcbd58d196d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a70 expref: 11 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.293291:0:8901:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000070f1b190/0xa762dfcbd58d196d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a70 expref: 11 pid: 8423 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843583.293321:0:8901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8901:1875738134452992:192.168.203.33@tcp:104: 00000100:00100000:1.0:1788843583.293446:0:8901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10529ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788843583.296761:0:8901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8901:1875738134452992:192.168.203.33@tcp:104: 00010000:00010000:1.0:1788843583.296820:0:8901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000063bbee92/0xa762dfcbd58d1974 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a77 expref: 11 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.296885:0:8901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fbeb600, rc 0) 00000100:00100000:1.0:1788843583.296977:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00849aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+11:11376:x1875738116554112:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 3922us (4241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843583.296988:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 47 00000100:00100000:3.0:1788843583.299892:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843583.300232:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116554240 00000100:00100000:2.0:1788843583.300269:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116554240 00010000:00010000:2.0:1788843583.300354:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000070f1b190/0xa762dfcbd58d196d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a70 expref: 11 pid: 8423 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843583.300427:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 72 00000100:00100000:2.0:1788843583.300442:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008498000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+11:2390:x1875738116554240:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843583.300474:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843583.300507:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000070f1b190/0xa762dfcbd58d196d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a70 expref: 11 pid: 8423 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.300524:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000070f1b190/0xa762dfcbd58d196d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a70 expref: 11 pid: 8423 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.300555:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070f1b190/0xa762dfcbd58d196d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a70 expref: 11 pid: 8423 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.300579:0:6493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843583.300584:0:6493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843583.300595:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000063bbee92/0xa762dfcbd58d1974 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a77 expref: 10 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.300606:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063bbee92/0xa762dfcbd58d1974 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a77 expref: 10 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.300657:0:6493:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000063bbee92/0xa762dfcbd58d1974 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a77 expref: 10 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843583.300701:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141bf9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6493:1875738134453120:192.168.203.33@tcp:105: 00000100:00100000:2.0:1788843583.300820:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1331cc180 going to sleep for 11 seconds 00000100:00100000:2.0:1788843583.304387:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141bf9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6493:1875738134453120:192.168.203.33@tcp:105: 00010000:00010000:2.0:1788843583.304428:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843583.304528:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008498000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+10:2390:x1875738116554240:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 4089us (4646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843583.304543:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 72 00000100:00100000:3.0:1788843583.305437:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843583.305828:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116554368 00000100:00100000:2.0:1788843583.305842:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116554368 00002000:00100000:2.0:1788843583.305915:0:8427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9bd00849b480 x1875738116554368/t0(0) o4->f25f61b6-5faf-4e05-81a4-dea3dba05dc5@192.168.203.33@tcp:199/0 lens 504/0 e 0 to 0 dl 1788843594 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788843583.305928:0:8427:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd00849b480 with x1875738116554368 ext(0->12) 00002000:00010000:2.0:1788843583.305936:0:8427:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bd00849b480 00000100:00100000:2.0:1788843583.305987:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2 00000100:00100000:2.0:1788843583.306000:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00849b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+10:2390:x1875738116554368:12345-192.168.203.33@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788843583.309861:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00849b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+12:2390:x1875738116554368:12345-192.168.203.33@tcp:4:lhsmtool_posix.0 Request processed in 3846us (4416us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788843583.309884:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2 00002000:00100000:2.0:1788843583.309904:0:8427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9bd00849b480 x1875738116554368/t4294967309(0) o4->f25f61b6-5faf-4e05-81a4-dea3dba05dc5@192.168.203.33@tcp:199/0 lens 504/448 e 0 to 0 dl 1788843594 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788843583.309916:0:8427:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd00849b480 with x1875738116554368 ext(0->12) 00002000:00010000:2.0:1788843583.309925:0:8427:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bd00849b480 00000100:00100000:0.0:1788843583.318081:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843583.319425:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116554496 00000100:00100000:2.0:1788843583.319447:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116554496 00000100:00100000:2.0:1788843583.319557:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 136 00000100:00100000:2.0:1788843583.319570:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+68:11376:x1875738116554496:12345-192.168.203.33@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788843583.323340:0:6485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:1.0:1788843583.323367:0:6485:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:1.0:1788843583.323424:0:6485:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1788843583.323469:0:6485:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bd00749b840 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1788843583.323475:0:6485:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd13fb8fe00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bd00749b000 00000020:00080000:1.0:1788843583.323479:0:6485:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd13fb8f300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bd0065a7000 00000004:00080000:1.0:1788843583.323521:0:6485:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788843583.323551:0:6485:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bd10529e600 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1788843583.323555:0:6485:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd1207dfe00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bd10529e300 00000020:00080000:1.0:1788843583.323558:0:6485:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd1207df100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bd0065a6200 00000020:00080000:1.0:1788843583.323600:0:6538:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1788843583.323699:0:6538:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788843583.323731:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134453248:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788843583.323850:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843583.324089:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+22:11376:x1875738116554496:12345-192.168.203.33@tcp:44:lhsmtool_posix.0 Request processed in 4516us (6014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843583.324102:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 136 00000100:00100000:0.0:1788843583.324739:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134453248 00000100:00100000:0.0:1788843583.324753:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134453248 00000100:00100000:0.0:1788843583.324881:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788843583.324892:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3633:x1875738134453248:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788843583.324924:0:8423:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:0.0:1788843583.324959:0:8423:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f963d, atime: 0x6a9f963d, ctime: 0x6a9f963d, blocks: 0x8 00010000:00010000:0.0:1788843583.324990:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000366bcf19/0xa762dfcbd58d197b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.325451:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=361s v=(0 0) 00010000:00010000:0.0:1788843583.325456:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843583.325464:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000366bcf19/0xa762dfcbd58d197b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.325481:0:8423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000366bcf19/0xa762dfcbd58d197b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.325491:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000366bcf19/0xa762dfcbd58d197b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.325500:0:8423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000366bcf19/0xa762dfcbd58d197b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.325518:0:8423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788843583.326508:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008499880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134453376:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788843583.326605:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843583.326655:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788843583.326668:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008499f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134453504:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788843583.326695:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843583.326743:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134453376 00000100:00100000:3.0:1788843583.326752:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134453376 00000100:00100000:3.0:1788843583.326810:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134453504 00000100:00100000:3.0:1788843583.326814:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134453504 00000100:00100000:3.0:1788843583.326831:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788843583.326840:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008498380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3630:x1875738134453376:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788843583.326873:0:8421:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:3.0:1788843583.326907:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d1982 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843583.326923:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3633:x1875738134453248:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2025us (3066us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788843583.326938:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:3.0:1788843583.326946:0:8421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008d6e2f2d/0xa762dfcbd58d172f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909cf expref: 11 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.326960:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788843583.326966:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788843583.326974:0:8421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d1982 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843583.326990:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00010000:00010000:3.0:1788843583.327013:0:8421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008d6e2f2d/0xa762dfcbd58d172f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909cf expref: 11 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843583.327014:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd006754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3630:x1875738134453504:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1788843583.327043:0:8421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008d6e2f2d/0xa762dfcbd58d172f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909cf expref: 11 pid: 8901 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843583.327079:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006754a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8421:1875738134453632:192.168.203.33@tcp:104: 00002000:00010000:0.0:1788843583.327460:0:8423:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00010000:00010000:2.0:1788843583.327543:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71400/0xa762dfcbd58d1679 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.327555:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71400/0xa762dfcbd58d1679 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.327564:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71400/0xa762dfcbd58d1679 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788843583.327570:0:8423:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788843582 00010000:00010000:2.0:1788843583.327572:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd118f71400 already unused, calling callback (ffffffffc18b74f0) 00002000:00010000:0.0:1788843583.327576:0:8423:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:2.0:1788843583.327581:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71400/0xa762dfcbd58d1679 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788843583.327582:0:8423:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788843582 -> 1788843582 00010000:00010000:2.0:1788843583.327594:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71400/0xa762dfcbd58d1679 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788843583.327608:0:8423:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788843583.327620:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9bd007450d00) 00010000:00010000:2.0:1788843583.327626:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843583.327632:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71400/0xa762dfcbd58d1679 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.327640:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71400/0xa762dfcbd58d1679 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.327671:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d1721 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.327678:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d1721 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.327694:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d1721 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.327699:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb34200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843583.327703:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d1721 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.327709:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d1721 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.327718:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9bd0071def00) 00010000:00010000:2.0:1788843583.327721:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843583.327724:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d1721 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.327730:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb34200/0xa762dfcbd58d1721 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.327748:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d179f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.327755:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d179f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.327761:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d179f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.327767:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3c800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843583.327769:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d179f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.327788:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d179f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.327802:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bd0071de900) 00010000:00010000:2.0:1788843583.327805:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843583.327808:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d179f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.327814:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d179f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.327827:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d17c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.327834:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d17c2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.327841:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d17c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.327847:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3dc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843583.327852:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d17c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.327858:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d17c2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.327866:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bd0071de900) 00010000:00010000:2.0:1788843583.327869:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843583.327872:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d17c2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.327889:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d17c2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843583.327894:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd006754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3630:x1875738134453504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 875us (1187us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788843583.327908:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1788843583.327919:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1894 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.327929:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1894 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.328677:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1894 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.328775:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843583.328780:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1894 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.328789:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1894 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.328804:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd007403000) 00010000:00010000:2.0:1788843583.328808:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843583.328812:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1894 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.328819:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1894 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.328987:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1951 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.328995:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1951 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.329016:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1951 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.329022:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3ca00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843583.329025:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1951 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.329032:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1951 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.329046:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9bd0071de600) 00010000:00010000:2.0:1788843583.329049:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788843583.329052:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1951 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.329060:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1951 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.329094:0:6495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843583.329102:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000366bcf19/0xa762dfcbd58d197b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.329112:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3da00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843583.329116:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000366bcf19/0xa762dfcbd58d197b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.329124:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000366bcf19/0xa762dfcbd58d197b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.329170:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000366bcf19/0xa762dfcbd58d197b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.329177:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000366bcf19/0xa762dfcbd58d197b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.329199:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843583.329201:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843583.329203:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788843583.331319:0:3633:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd0084e2a00/2, rc 0, transno 4294967305 00000100:00100000:1.0:1788843583.331340:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134453248:0@lo:6:osp-syn-0-0.0 00000100:00080000:0.0:1788843583.331517:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788843583.332047:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd11220ac00 going to sleep for 11 seconds 00000004:00080000:3.0:1788843583.332177:0:3630:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd008499f80/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788843583.332185:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008499f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134453504:0@lo:2:osp-syn-1-0.0 00000001:00080000:2.0:1788843583.333984:0:8417:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:2.0:1788843583.334012:0:8417:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:3.0:1788843583.344669:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843583.344797:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843583.344906:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116554752 00000100:00100000:1.0:1788843583.344918:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116554752 00010000:00010000:1.0:1788843583.344967:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008d6e2f2d/0xa762dfcbd58d172f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909cf expref: 12 pid: 8901 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843583.345010:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 73 00000100:00100000:1.0:1788843583.345021:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd133329c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+12:2387:x1875738116554752:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843583.345040:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843583.345047:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008d6e2f2d/0xa762dfcbd58d172f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909cf expref: 12 pid: 8901 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.345062:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008d6e2f2d/0xa762dfcbd58d172f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909cf expref: 12 pid: 8901 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.345093:0:7448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788843583.345098:0:7448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788843583.345105:0:7448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d1982 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.345116:0:7448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d1982 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.345176:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843583.345234:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd133329c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+12:2387:x1875738116554752:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 214us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843583.345241:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 73 00000100:00100000:2.0:1788843583.345741:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116554624 00000100:00100000:2.0:1788843583.345749:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116554624 00000100:00100000:2.0:1788843583.345803:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 51 00000100:00100000:2.0:1788843583.345812:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+12:2388:x1875738116554624:12345-192.168.203.33@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1788843583.346500:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d6e2f2d/0xa762dfcbd58d172f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909cf expref: 12 pid: 8901 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843583.346524:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006754a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8421:1875738134453632:192.168.203.33@tcp:104: 00010000:00010000:0.0:1788843583.346557:0:8421:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d1982 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.346568:0:8421:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d1982 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.346574:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d1982 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.346585:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d1982 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.346593:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d1982 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.346629:0:8421:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788843583.348233:0:10328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843583.348250:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d1982 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.348265:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be3400 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843583.348271:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d1982 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.348282:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d1982 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.348347:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d1982 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.348356:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d1982 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.348383:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843583.348386:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843583.348387:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843583.348855:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008498380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3630:x1875738134453376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 22010us (22244us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788843583.348877:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:1.0:1788843583.348913:0:3630:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd008499880/2, rc 0, transno 4294967311 00000100:00100000:1.0:1788843583.348921:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008499880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134453376:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1788843583.355035:0:9500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:3.0:1788843583.355058:0:9500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:2.0:1788843583.355619:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2388:x1875738116554624:12345-192.168.203.33@tcp:16:lhsmtool_posix.0 Request processed in 9798us (10953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843583.355633:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 51 00000100:00100000:3.0:1788843583.360978:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843583.361203:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116555008 00000100:00100000:1.0:1788843583.361225:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116555008 00000100:00100000:1.0:1788843583.361311:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 137 00000100:00100000:1.0:1788843583.361324:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+16:11376:x1875738116555008:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788843583.361396:0:11996:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843583.361433:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70200/0xa762dfcbd58d1966 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a69 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.361471:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9bd0071de600) 00010000:00010000:1.0:1788843583.361480:0:11996:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788843583.361523:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d1989 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.361542:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d1989 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.361555:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d1989 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788843583.361723:0:11996:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b1217bf5 reply state 00000000f87dd491 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d1989 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.361737:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d1989 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.361743:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9bd0071de600) 00010000:00010000:1.0:1788843583.361746:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788843583.361767:0:11996:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788843583.362404:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+17:11376:x1875738116555008:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 Request processed in 1074us (1443us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1788843583.362415:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 137 00000100:00100000:3.0:1788843583.368450:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843583.369676:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116555136 00000100:00100000:1.0:1788843583.369696:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116555136 00000100:00100000:1.0:1788843583.370504:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 52 00000100:00100000:1.0:1788843583.370522:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2387:x1875738116555136:12345-192.168.203.33@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788843583.370735:0:8424:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788843583.370740:0:8424:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1788843582 -> 1788843581 00002000:00010000:1.0:1788843583.370743:0:8424:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788843581 00002000:00010000:1.0:1788843583.370745:0:8424:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788843582 -> 1788843581 00002000:00010000:1.0:1788843583.370748:0:8424:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788843583.370956:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2387:x1875738116555136:12345-192.168.203.33@tcp:2:lhsmtool_posix.0 Request processed in 438us (2518us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788843583.370965:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 52 00000100:00100000:2.0:1788843583.373568:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843583.375799:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116555392 00000100:00100000:0.0:1788843583.375816:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116555392 00000100:00100000:0.0:1788843583.375893:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 138 00000100:00100000:0.0:1788843583.375904:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+17:11376:x1875738116555392:12345-192.168.203.33@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788843583.375989:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1990 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.376019:0:9517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d194a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a5b expref: 17 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.376030:0:9517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1990 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.376068:0:9517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d194a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a5b expref: 17 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.376082:0:9517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d194a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a5b expref: 17 pid: 9517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843583.376096:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9517:1875738134453760:192.168.203.33@tcp:104: 00000100:00100000:0.0:1788843583.376217:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd102d36b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788843583.385185:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9517:1875738134453760:192.168.203.33@tcp:104: 00010000:00010000:0.0:1788843583.385215:0:9517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1990 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843583.389403:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843583.389714:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116555520 00000100:00100000:1.0:1788843583.389728:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116555520 00010000:00010000:1.0:1788843583.389795:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d194a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a5b expref: 18 pid: 9517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843583.389845:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 74 00000100:00100000:1.0:1788843583.389857:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+18:2389:x1875738116555520:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843583.389877:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843583.389885:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d194a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a5b expref: 18 pid: 9517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.389923:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d194a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a5b expref: 18 pid: 9517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.389956:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d194a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a5b expref: 18 pid: 9517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.389977:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9bd0071de600) 00010000:00010000:1.0:1788843583.389984:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1990 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.389997:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1990 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.390007:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1990 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.390043:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843583.390122:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+17:2389:x1875738116555520:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 266us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843583.390132:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 74 00010000:00010000:0.0:1788843583.390194:0:9517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1990 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.390228:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1990 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.390269:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1990 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.390277:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1990 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.390302:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1990 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.390309:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3cc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843583.390314:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1990 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.390322:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1990 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.390610:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9bd0071de600) 00010000:00010000:0.0:1788843583.390614:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788843583.390620:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1990 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.390628:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1990 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843583.390723:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+16:11376:x1875738116555392:12345-192.168.203.33@tcp:55:lhsmtool_posix.0 Request processed in 14805us (17148us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788843583.390733:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 138 00000100:00100000:2.0:1788843583.395716:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843583.395837:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116555648 00000100:00100000:0.0:1788843583.395853:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116555648 00000100:00100000:0.0:1788843583.395923:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 53 00000100:00100000:0.0:1788843583.395937:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2388:x1875738116555648:12345-192.168.203.33@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788843583.395982:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006a3ac7e1/0xa762dfcbd58d1997 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.396011:0:8421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000063bbee92/0xa762dfcbd58d1974 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a77 expref: 7 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.396020:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843583.396025:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788843583.396030:0:8421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a3ac7e1/0xa762dfcbd58d1997 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.396069:0:8421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000063bbee92/0xa762dfcbd58d1974 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a77 expref: 7 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.396086:0:8421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000063bbee92/0xa762dfcbd58d1974 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a77 expref: 7 pid: 8901 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843583.396100:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8421:1875738134453888:192.168.203.33@tcp:104: 00000100:00100000:0.0:1788843583.396224:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd102d36b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788843583.403622:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843583.403764:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116555776 00000100:00100000:1.0:1788843583.403792:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116555776 00010000:00010000:1.0:1788843583.403871:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000063bbee92/0xa762dfcbd58d1974 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a77 expref: 8 pid: 8901 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843583.403927:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 75 00000100:00100000:1.0:1788843583.403939:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:2389:x1875738116555776:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843583.403983:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843583.404015:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000063bbee92/0xa762dfcbd58d1974 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a77 expref: 8 pid: 8901 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.404033:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000063bbee92/0xa762dfcbd58d1974 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a77 expref: 8 pid: 8901 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.404069:0:7448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788843583.404074:0:7448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788843583.404081:0:7448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006a3ac7e1/0xa762dfcbd58d1997 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.404093:0:7448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a3ac7e1/0xa762dfcbd58d1997 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.404121:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788843583.404231:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063bbee92/0xa762dfcbd58d1974 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a77 expref: 8 pid: 8901 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843583.404255:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8421:1875738134453888:192.168.203.33@tcp:104: 00010000:00010000:0.0:1788843583.404306:0:8421:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006a3ac7e1/0xa762dfcbd58d1997 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.404318:0:8421:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006a3ac7e1/0xa762dfcbd58d1997 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.404325:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a3ac7e1/0xa762dfcbd58d1997 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.404356:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006a3ac7e1/0xa762dfcbd58d1997 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.404365:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a3ac7e1/0xa762dfcbd58d1997 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.404373:0:8421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a3ac7e1/0xa762dfcbd58d1997 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.404380:0:8421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3ce00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843583.404385:0:8421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a3ac7e1/0xa762dfcbd58d1997 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.404393:0:8421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a3ac7e1/0xa762dfcbd58d1997 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.404415:0:8421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a3ac7e1/0xa762dfcbd58d1997 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.404428:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a3ac7e1/0xa762dfcbd58d1997 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843583.404499:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2389:x1875738116555776:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 558us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843583.404510:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 75 00000100:00100000:0.0:1788843583.407259:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2388:x1875738116555648:12345-192.168.203.33@tcp:1:lhsmtool_posix.0 Request processed in 11315us (11548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843583.407272:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 53 00000100:00100000:3.0:1788843583.410982:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843583.411435:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116556032 00000100:00100000:1.0:1788843583.411453:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116556032 00000100:00100000:1.0:1788843583.411549:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 139 00000100:00100000:1.0:1788843583.411562:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+16:11376:x1875738116556032:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788843583.411676:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d199e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.411700:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d188d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a23 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.411730:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d199e lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.411776:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d188d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a23 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.411793:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d188d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a23 expref: 16 pid: 6506 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843583.411812:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084a2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6507:1875738134454016:192.168.203.33@tcp:104: 00000100:00100000:1.0:1788843583.416702:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10529e900 going to sleep for 11 seconds 00000100:00100000:3.0:1788843583.430726:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843583.430835:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116556160 00000100:00100000:2.0:1788843583.430844:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116556160 00010000:00010000:2.0:1788843583.430886:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d188d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a23 expref: 17 pid: 6506 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843583.430929:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 76 00000100:00100000:2.0:1788843583.430944:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+17:2389:x1875738116556160:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843583.430963:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843583.430971:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d188d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a23 expref: 17 pid: 6506 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.431003:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d188d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a23 expref: 17 pid: 6506 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.431038:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd007403000) 00010000:00010000:2.0:1788843583.431045:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d18ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a46 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.431059:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d199e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.431067:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d199e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.431076:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d199e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.431100:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788843583.431108:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70000/0xa762dfcbd58d188d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a23 expref: 17 pid: 6506 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843583.431218:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+16:2389:x1875738116556160:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 273us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843583.431228:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 76 00000100:00100000:1.0:1788843583.431234:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084a2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6507:1875738134454016:192.168.203.33@tcp:104: 00010000:00010000:1.0:1788843583.431272:0:6507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d199e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.431284:0:6507:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d199e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.431292:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d199e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.431547:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeaa00/0xa762dfcbd58d19a5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.431568:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeba00/0xa762dfcbd58d1958 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a62 expref: 16 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.431610:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeaa00/0xa762dfcbd58d19a5 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.431655:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeba00/0xa762dfcbd58d1958 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a62 expref: 16 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.431674:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeba00/0xa762dfcbd58d1958 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a62 expref: 16 pid: 11996 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843583.431691:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084a2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6507:1875738134454144:192.168.203.33@tcp:104: 00000100:00100000:1.0:1788843583.431798:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10529e840 going to sleep for 11 seconds 00000100:00100000:1.0:1788843583.435824:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084a2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6507:1875738134454144:192.168.203.33@tcp:104: 00010000:00010000:1.0:1788843583.435885:0:6507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeaa00/0xa762dfcbd58d19a5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843583.436992:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843583.439258:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116556288 00000100:00100000:1.0:1788843583.439278:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116556288 00010000:00010000:1.0:1788843583.439352:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeba00/0xa762dfcbd58d1958 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a62 expref: 17 pid: 11996 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843583.439397:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 77 00000100:00100000:1.0:1788843583.439407:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00799b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+17:2389:x1875738116556288:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843583.439428:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843583.439435:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeba00/0xa762dfcbd58d1958 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a62 expref: 17 pid: 11996 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.439471:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeba00/0xa762dfcbd58d1958 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a62 expref: 17 pid: 11996 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.439499:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeba00/0xa762dfcbd58d1958 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a62 expref: 17 pid: 11996 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.439520:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9bd0071de600) 00010000:00010000:1.0:1788843583.439526:0:6492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeaa00/0xa762dfcbd58d19a5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.439537:0:6492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeaa00/0xa762dfcbd58d19a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.439545:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeaa00/0xa762dfcbd58d19a5 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.439591:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843583.439666:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00799b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+16:2389:x1875738116556288:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 260us (2686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843583.439674:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 77 00010000:00010000:3.0:1788843583.439738:0:6507:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeaa00/0xa762dfcbd58d19a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.439749:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeaa00/0xa762dfcbd58d19a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788843583.439912:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:3.0:1788843583.440133:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:3.0:1788843583.440210:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:3.0:1788843583.440333:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007998e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6507:1875738134454272:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788843583.440432:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843583.440475:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1102c2000 going to sleep for 11 seconds 00000100:00100000:0.0:1788843583.440516:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134454272 00000100:00100000:0.0:1788843583.440531:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134454272 00000100:00100000:0.0:1788843583.440604:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788843583.440615:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00799aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6507:x1875738134454272:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788843583.440740:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00799aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6507:x1875738134454272:12345-0@lo:1000:mdt00_001.0 Request processed in 128us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843583.440748:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788843583.441583:0:6507:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1788843583.441591:0:6507:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:3.0:1788843583.441610:0:6507:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd008499f80, transno 4294967310 00000100:00100000:3.0:1788843583.441625:0:6507:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9bd008499880 x1875738134453376/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788843599 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843583.441636:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007998e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6507:1875738134454272:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788843583.441776:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:3.0:1788843583.441848:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007998e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6507:1875738134454400:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788843583.441906:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843583.441938:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1102c2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788843583.441977:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134454400 00000100:00100000:1.0:1788843583.441990:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134454400 00000100:00100000:1.0:1788843583.442073:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788843583.442084:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6507:x1875738134454400:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788843583.442335:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6507:x1875738134454400:12345-0@lo:1000:mdt00_001.0 Request processed in 252us (427us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788843583.442344:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788843583.442946:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007998e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6507:1875738134454400:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788843583.442999:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeaa00/0xa762dfcbd58d19a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.443012:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeaa00/0xa762dfcbd58d19a5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.443020:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeaa00/0xa762dfcbd58d19a5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.443026:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbeaa00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1788843583.443032:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeaa00/0xa762dfcbd58d19a5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.443052:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeaa00/0xa762dfcbd58d19a5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.443071:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9bd0071de600) 00010000:00010000:3.0:1788843583.443075:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788843583.443089:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeaa00/0xa762dfcbd58d19a5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.443096:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeaa00/0xa762dfcbd58d19a5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.443124:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea000/0xa762dfcbd58d18e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.443131:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea000/0xa762dfcbd58d18e8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.443137:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea000/0xa762dfcbd58d18e8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.443173:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbea000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1788843583.443176:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea000/0xa762dfcbd58d18e8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.443182:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea000/0xa762dfcbd58d18e8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.443191:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd007403000) 00010000:00010000:3.0:1788843583.443194:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788843583.443201:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d18ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a46 expref: 19 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.443346:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d18ef lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a46 expref: 19 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.443356:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d18ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a46 expref: 19 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843583.443411:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d18ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a46 expref: 19 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843583.443426:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007240700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6507:1875738134454528:192.168.203.33@tcp:105: 00000100:00100000:3.0:1788843583.443528:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd11510e000 going to sleep for 11 seconds 00000100:00100000:3.0:1788843583.454024:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843583.454194:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007240700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6507:1875738134454528:192.168.203.33@tcp:105: 00010000:00010000:0.0:1788843583.454243:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea000/0xa762dfcbd58d18e8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.454256:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea000/0xa762dfcbd58d18e8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.454309:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d19ac lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.454329:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d19ac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.454342:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d19ac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.454376:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d19ac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.454382:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d19ac lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.454389:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d19ac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.454395:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843583.454399:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d19ac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.454407:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d19ac lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.454419:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd007403000) 00010000:00010000:0.0:1788843583.454423:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843583.454427:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d19ac lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.454432:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d19ac lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.454441:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d199e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.454446:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d199e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.454451:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d199e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.454463:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbeb800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843583.454466:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d199e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.454471:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d199e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.454480:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd007403000) 00010000:00010000:0.0:1788843583.454482:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788843583.454485:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d199e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.454490:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d199e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843583.454704:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+19:11376:x1875738116556032:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 Request processed in 43142us (43728us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1788843583.454715:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 139 00000020:00080000:0.0:1788843583.454723:0:6507:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788843583.455558:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116556416 00000100:00100000:2.0:1788843583.455575:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116556416 00000040:00080000:1.0:1788843583.455654:0:13785:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000100:00100000:2.0:1788843583.455664:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 31 00000040:00080000:1.0:1788843583.455665:0:13785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1788843583.455680:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+19:11375:x1875738116556416:12345-192.168.203.33@tcp:49:lfs.0 00000100:00100000:2.0:1788843583.455885:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+19:11375:x1875738116556416:12345-192.168.203.33@tcp:49:lfs.0 Request processed in 209us (1875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843583.455893:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 31 00000040:00080000:1.0:1788843583.456728:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788843583.456746:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788843583.463420:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843583.463491:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116556672 00000100:00100000:2.0:1788843583.463507:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116556672 00000100:00100000:0.0:1788843583.463547:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843583.463582:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 32 00000100:00100000:2.0:1788843583.463595:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd133002c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+19:11376:x1875738116556672:12345-192.168.203.33@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788843583.463854:0:6510:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788843583.463884:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:2.0:1788843583.463916:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d19b3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.463932:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d19b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.463943:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d19b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.463952:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d19b3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.463958:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d19b3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.463964:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d19b3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.463987:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788843583.464075:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd133002c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+21:11376:x1875738116556672:12345-192.168.203.33@tcp:35:lhsmtool_posix.0 Request processed in 482us (669us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1788843583.464083:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 32 00000020:00080000:2.0:1788843583.464088:0:6510:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788843583.464443:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116556928 00000100:00100000:1.0:1788843583.464457:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116556928 00000100:00100000:1.0:1788843583.464545:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 140 00000100:00100000:1.0:1788843583.464559:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+21:11375:x1875738116556928:12345-192.168.203.33@tcp:58:lfs.0 00000040:00080000:1.0:1788843583.464765:0:11996:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788843583.464859:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+21:11375:x1875738116556928:12345-192.168.203.33@tcp:58:lfs.0 Request processed in 303us (1313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843583.464867:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 140 00010000:00010000:0.0:1788843583.465446:0:10329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843583.465459:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d19b3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.465472:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947600 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843583.465478:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d19b3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.465489:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d19b3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.465531:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9bd0071de600) 00010000:00010000:0.0:1788843583.465534:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788843583.465541:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d19b3 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.465549:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d19b3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843583.465567:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843583.465569:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843583.465571:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843583.484847:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843583.484960:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116557056 00000100:00100000:2.0:1788843583.485036:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116557056 00000100:00100000:2.0:1788843583.485134:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 141 00000100:00100000:2.0:1788843583.485534:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+21:11378:x1875738116557056:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1788843583.485571:0:9517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843583.485599:0:9517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d19ba lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490a7e expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.485708:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d19c1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.485726:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d19c1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.485739:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d19c1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.485756:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d19c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.485763:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d19c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.486059:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d19c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.486197:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d19cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.486209:0:9517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d18da lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a3f expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.486218:0:9517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d19cf lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.486274:0:9517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d18da lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a3f expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.486292:0:9517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d18da lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a3f expref: 22 pid: 6506 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843583.486319:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141bf8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9517:1875738134454656:192.168.203.33@tcp:104: 00000100:00100000:2.0:1788843583.486580:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1331cc180 going to sleep for 11 seconds 00000100:00100000:3.0:1788843583.490223:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843583.490317:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116557312 00000100:00100000:0.0:1788843583.490329:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116557312 00000100:00100000:0.0:1788843583.490401:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 33 00000100:00100000:0.0:1788843583.490413:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+23:6162:x1875738116557312:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788843583.490731:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+24:6162:x1875738116557312:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 319us (522us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1788843583.490740:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 33 00000100:00100000:2.0:1788843583.491219:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141bf8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9517:1875738134454656:192.168.203.33@tcp:104: 00010000:00010000:2.0:1788843583.491253:0:9517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d19cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843583.494018:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843583.494128:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116557440 00000100:00100000:1.0:1788843583.494348:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116557440 00010000:00010000:1.0:1788843583.494405:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d18da lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a3f expref: 24 pid: 6506 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843583.494449:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 78 00000100:00100000:1.0:1788843583.494459:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+24:2389:x1875738116557440:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843583.494474:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843583.494481:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d18da lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a3f expref: 24 pid: 6506 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.494494:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d18da lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a3f expref: 24 pid: 6506 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.494516:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71c00/0xa762dfcbd58d18da lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a3f expref: 24 pid: 6506 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.494555:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd007403000) 00010000:00010000:1.0:1788843583.494561:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d19cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.494571:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d19cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.494579:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d19cf lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843583.494677:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843583.494752:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+23:2389:x1875738116557440:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 295us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843583.494761:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 78 00010000:00010000:2.0:1788843583.496943:0:9517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d19cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.496961:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d19cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843583.497020:0:9517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788843583.497025:0:9517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788843583.497048:0:9517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d19cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.497062:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d19cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.497073:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d19c1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.497098:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d19c1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.497106:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d19c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.497111:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843583.497116:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d19c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.497123:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d19c1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.497138:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bd007730100) 00010000:00010000:2.0:1788843583.497525:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843583.497531:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d19c1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.497667:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d19c1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.497685:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d19c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.497691:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d19c8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.497697:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d19c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.497702:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843583.497784:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d19c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.497794:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d19c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.497804:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9bd13dfdad00) 00010000:00010000:2.0:1788843583.497807:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843583.497810:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d19c8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.497817:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d19c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.497863:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d19ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a7e expref: 23 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.497879:0:9517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d19cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a7e expref: 22 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843583.497886:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd007403000) 00010000:00010000:2.0:1788843583.497889:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843583.497892:0:9517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007947600, rc 0) 00000100:00100000:2.0:1788843583.498006:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+22:11378:x1875738116557056:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 12861us (13172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843583.498015:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 141 00010000:00010000:2.0:1788843583.643382:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788843584.431618:0:14253:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788843584.431632:0:14253:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788843584.431670:0:14253:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788843584.431679:0:14253:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788843584.477681:0:13785:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788843584.477696:0:13785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788843584.477735:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788843584.477746:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788843584.478830:0:13785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007240700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13785:1875738134454784:192.168.203.33@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788843584.480328:0:13785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd109144900 going to sleep for 11 seconds 00000100:00100000:0.0:1788843584.490139:0:13785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007240700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13785:1875738134454784:192.168.203.33@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788843584.490789:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843584.491110:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116557568 00000100:00100000:3.0:1788843584.491121:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116557568 00000100:00100000:3.0:1788843584.491229:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 142 00000100:00100000:3.0:1788843584.491241:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+22:11390:x1875738116557568:12345-192.168.203.33@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788843584.491300:0:6507:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788843584.491453:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+22:11390:x1875738116557568:12345-192.168.203.33@tcp:53:lhsmtool_posix.0 Request processed in 213us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843584.491462:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 142 00000100:00100000:3.0:1788843584.493794:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843584.494356:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116557824 00000100:00100000:2.0:1788843584.494370:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116557824 00000100:00100000:2.0:1788843584.494457:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 143 00000100:00100000:2.0:1788843584.494469:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+22:11390:x1875738116557824:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788843584.494495:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843584.494524:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d19d6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490a85 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843584.494680:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d19dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843584.494698:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d19dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843584.494715:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d19dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843584.494729:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788843584.494875:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d19d6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a85 expref: 25 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843584.494896:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d19dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a85 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843584.494906:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd007403000) 00010000:00010000:2.0:1788843584.494909:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843584.494927:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007946e00, rc 0) 00000100:00100000:2.0:1788843584.495006:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+24:11390:x1875738116557824:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 538us (1227us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1788843584.495015:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 143 00000100:00100000:3.0:1788843584.504299:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843584.505990:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116557952 00000100:00100000:0.0:1788843584.506009:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116557952 00000100:00100000:0.0:1788843584.506109:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 10 00000100:00100000:0.0:1788843584.506123:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd136c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+24:2390:x1875738116557952:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843584.506167:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843584.506203:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d19dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a85 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843584.506224:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd007403000) 00010000:00010000:0.0:1788843584.506231:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843584.506318:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd136c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+23:2390:x1875738116557952:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 198us (2625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843584.506326:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 10 00000100:00100000:3.0:1788843584.506791:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843584.507462:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116558208 00000100:00100000:0.0:1788843584.507475:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116558208 00000100:00100000:0.0:1788843584.507533:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 144 00000100:00100000:0.0:1788843584.507542:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+23:11390:x1875738116558208:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788843584.507786:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d19eb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843584.507812:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d19eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843584.507824:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d19eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843584.508242:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d19eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843584.508252:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d19eb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843584.508260:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d19eb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843584.508267:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3ce00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843584.508272:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d19eb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843584.508280:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d19eb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843584.508305:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd007403000) 00010000:00010000:0.0:1788843584.508310:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788843584.508316:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d19eb lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843584.508322:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d19eb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843584.508480:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+24:11390:x1875738116558208:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 Request processed in 935us (1688us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788843584.508490:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 144 00000040:00080000:3.0:1788843584.508822:0:13785:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788843584.508828:0:13785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788843584.509408:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788843584.509421:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788843584.512838:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843584.513014:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116558464 00000100:00100000:2.0:1788843584.513170:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116558464 00000100:00100000:2.0:1788843584.513242:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 34 00000100:00100000:2.0:1788843584.513256:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+24:11390:x1875738116558464:12345-192.168.203.33@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788843584.515714:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+25:11390:x1875738116558464:12345-192.168.203.33@tcp:35:lhsmtool_posix.0 Request processed in 2441us (2870us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788843584.515733:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 34 00010000:00010000:1.0:1788843584.668723:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843584.924070:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134455168:0@lo:400:kworker.0 00000100:00100000:0.0:1788843584.924205:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843584.924415:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134455680:0@lo:400:kworker.0 00000100:00100000:0.0:1788843584.924448:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843584.924469:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141bf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134456192:0@lo:400:kworker.0 00000100:00100000:0.0:1788843584.924487:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843584.924512:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788843584.924517:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134455296:0@lo:400:kworker.0 00000100:00100000:0.0:1788843584.924536:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843584.924556:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134455808:0@lo:400:kworker.0 00000100:00100000:0.0:1788843584.924582:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843584.924599:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141bf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134456320:0@lo:400:kworker.0 00000100:00100000:0.0:1788843584.924624:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843584.924663:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134455680 00000100:00100000:0.0:1788843584.924672:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134455680 00000100:00100000:0.0:1788843584.924739:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134456192 00000100:00100000:0.0:1788843584.924743:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134456192 00000100:00100000:0.0:1788843584.924760:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134455296 00000100:00100000:0.0:1788843584.924762:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134455296 00000100:00100000:0.0:1788843584.924777:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788843584.924936:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd006754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134455680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843584.925027:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134454912:0@lo:400:kworker.0 00000100:00100000:2.0:1788843584.925070:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843584.925096:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134455424:0@lo:400:kworker.0 00000100:00100000:2.0:1788843584.925123:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843584.925167:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134455936:0@lo:400:kworker.0 00000100:00100000:0.0:1788843584.925186:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd006754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134455680:12345-0@lo:400:kworker.0 Request processed in 252us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843584.925195:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843584.925215:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141bf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134456448:0@lo:400:kworker.0 00000100:00100000:2.0:1788843584.925234:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843584.925268:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788843584.925365:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788843584.925373:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1060d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134456192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843584.925406:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1060d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134456192:12345-0@lo:400:kworker.0 Request processed in 34us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843584.925430:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788843584.925442:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788843584.925448:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1060d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134455296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843584.925475:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1060d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134455296:12345-0@lo:400:kworker.0 Request processed in 27us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843584.925480:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00080000:0.0:1788843584.925501:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788843584.925521:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134455808 00000100:00100000:2.0:1788843584.925525:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788843584.925526:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134455808 00000100:00100000:2.0:1788843584.925536:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134455040:0@lo:400:kworker.0 00000100:00100000:0.0:1788843584.925562:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134456320 00000100:00100000:0.0:1788843584.925566:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134456320 00000100:00100000:2.0:1788843584.925570:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843584.925589:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134455936 00000100:00100000:0.0:1788843584.925593:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134455936 00000100:00100000:2.0:1788843584.925594:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134455552:0@lo:400:kworker.0 00000100:00100000:0.0:1788843584.925615:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134456448 00000100:00100000:0.0:1788843584.925619:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134456448 00000100:00100000:2.0:1788843584.925624:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843584.925642:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788843584.925647:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1875738134456064:0@lo:400:kworker.0 00000100:00100000:0.0:1788843584.925654:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1060d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134455808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843584.925697:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1060d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134455808:12345-0@lo:400:kworker.0 Request processed in 48us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843584.925703:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788843584.925714:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788843584.925720:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1060d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134456320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843584.925743:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843584.925753:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1060d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134456320:12345-0@lo:400:kworker.0 Request processed in 31us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843584.925761:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788843584.925777:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788843584.925782:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134455040 00000100:00100000:0.0:1788843584.925787:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134455936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843584.925788:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134455040 00000100:00100000:2.0:1788843584.925810:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134455552 00000100:00100000:2.0:1788843584.925813:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134455552 00000100:00100000:2.0:1788843584.925835:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134456064 00000100:00100000:2.0:1788843584.925837:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134456064 00000100:00100000:2.0:1788843584.925852:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1788843584.925857:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134455040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843584.925901:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134455936:12345-0@lo:400:kworker.0 Request processed in 117us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843584.925908:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788843584.925921:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788843584.925927:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3632:x1875738134456448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843584.925956:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3632:x1875738134456448:12345-0@lo:400:kworker.0 Request processed in 28us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843584.925962:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:0.0:1788843584.925978:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788843584.925982:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788843584.925984:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843584.926018:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134455296:0@lo:400:kworker.0 00000100:00100000:0.0:1788843584.926031:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134455808:0@lo:400:kworker.0 00000100:00100000:0.0:1788843584.926042:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141bf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134456320:0@lo:400:kworker.0 00010000:00080000:0.0:1788843584.926057:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0084a0a80 x1875738134455680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843584.926068:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134455680:0@lo:400:kworker.0 00010000:00080000:0.0:1788843584.926080:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141bf0e00 x1875738134456192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843584.926087:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141bf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134456192:0@lo:400:kworker.0 00000100:00100000:1.0:1788843584.926455:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134455168 00000100:00100000:1.0:1788843584.926465:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134455168 00000100:00100000:1.0:1788843584.926500:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134455424 00000100:00100000:1.0:1788843584.926502:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134455424 00000100:00100000:1.0:1788843584.926521:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788843584.926532:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134455168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843584.926588:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134455168:12345-0@lo:400:kworker.0 Request processed in 60us (2391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843584.926595:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788843584.926613:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134455040:12345-0@lo:400:kworker.0 Request processed in 753us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843584.926614:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788843584.926625:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788843584.926631:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134455424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843584.926645:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1788843584.926655:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134455552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843584.926671:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134455424:12345-0@lo:400:kworker.0 Request processed in 46us (1546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843584.926688:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788843584.926705:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134455552:12345-0@lo:400:kworker.0 Request processed in 51us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843584.926714:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1788843584.926730:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1788843584.926739:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1875738134456064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843584.926739:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134455168:0@lo:400:kworker.0 00000100:00100000:2.0:1788843584.926773:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1875738134456064:12345-0@lo:400:kworker.0 Request processed in 37us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843584.926780:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1788843584.926824:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134455040:0@lo:400:kworker.0 00000100:00100000:2.0:1788843584.926836:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134455552:0@lo:400:kworker.0 00000100:00100000:3.0:1788843584.926845:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141bf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134456576:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788843584.926851:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1875738134456064:0@lo:400:kworker.0 00000100:00100000:1.0:1788843584.926856:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134454912 00000100:00100000:1.0:1788843584.926861:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134454912 00000100:00100000:2.0:1788843584.926866:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134455424:0@lo:400:kworker.0 00000100:00100000:3.0:1788843584.926899:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843584.926902:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1788843584.926910:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3632:x1875738134454912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843584.927753:0:3632:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1788843584.927759:0:3632:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:2.0:1788843584.927783:0:3632:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd006756300, transno 4294967302 00000004:00080000:2.0:1788843584.927808:0:3632:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:2.0:1788843584.927823:0:3632:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd0084e2a00, transno 4294967305 00000100:00100000:2.0:1788843584.927831:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134455936:0@lo:400:kworker.0 00000100:00100000:2.0:1788843584.927848:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141bf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134456448:0@lo:400:kworker.0 00000100:00100000:2.0:1788843584.927901:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134456576 00000100:00100000:2.0:1788843584.927907:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134456576 00000100:00100000:2.0:1788843584.927948:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788843584.927956:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134456576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788843584.927986:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788843584.930749:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3632:x1875738134454912:12345-0@lo:400:kworker.0 Request processed in 3819us (5658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843584.930770:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1788843584.931641:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134456576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3679us (4737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843584.931656:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788843584.931663:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134454912:0@lo:400:kworker.0 00000100:00100000:3.0:1788843584.931745:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141bf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134456576:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788843585.434757:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134456832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788843585.434867:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843585.434964:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788843585.434971:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141bf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134456704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788843585.434996:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843585.435166:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134456832 00000100:00100000:3.0:1788843585.435178:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134456832 00000100:00100000:3.0:1788843585.435235:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134456704 00000100:00100000:3.0:1788843585.435239:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134456704 00000100:00100000:3.0:1788843585.435258:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788843585.435269:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134456832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788843585.435306:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843585.435364:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134456832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843585.435371:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788843585.435390:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788843585.435396:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134456704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788843585.435418:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788843585.435652:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788843585.435664:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141bf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134456960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788843585.435699:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843585.435779:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134456960 00000100:00100000:0.0:1788843585.435785:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134456960 00000100:00100000:0.0:1788843585.435847:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788843585.435857:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3633:x1875738134456960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788843585.435890:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788843585.435929:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3633:x1875738134456960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843585.435935:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788843585.436098:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134456832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843585.436215:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134456704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 818us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843585.436222:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788843585.436580:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141bf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134456704:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788843585.436663:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788843585.436694:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141bf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134456960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788843585.452469:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843585.453331:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116558592 00000100:00100000:0.0:1788843585.453348:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116558592 00000100:00100000:0.0:1788843585.453501:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 385 00000100:00100000:0.0:1788843585.453514:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+13:2389:x1875738116558592:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1788843585.453619:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+13:2389:x1875738116558592:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 107us (1178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843585.453627:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 385 00000100:00100000:2.0:1788843585.457880:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843585.458266:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843585.465544:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116558848 00000100:00100000:3.0:1788843585.465565:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116558848 00000100:00100000:2.0:1788843585.465648:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843585.465674:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116558720 00000100:00100000:3.0:1788843585.465679:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116558720 00000100:00100000:2.0:1788843585.465696:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843585.465713:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 300 00000100:00100000:3.0:1788843585.465726:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2389:x1875738116558848:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843585.465733:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843585.465820:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2389:x1875738116558848:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 98us (7956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843585.465853:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 300 00000100:00100000:3.0:1788843585.465874:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116559232 00000100:00100000:3.0:1788843585.465878:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116559232 00000100:00100000:3.0:1788843585.465895:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 301 00000100:00100000:3.0:1788843585.465901:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+25:2390:x1875738116558720:12345-192.168.203.33@tcp:400:kworker.0 00000100:00080000:1.0:1788843585.465978:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788843585.465983:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788843585.466013:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116559104 00000100:00100000:1.0:1788843585.466016:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116559104 00000100:00100000:1.0:1788843585.466048:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116558976 00000100:00100000:1.0:1788843585.466050:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116558976 00000100:00100000:1.0:1788843585.466069:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 126 00000100:00100000:1.0:1788843585.466076:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12036aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2389:x1875738116559104:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843585.466198:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843585.466356:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116559360 00000100:00100000:2.0:1788843585.466361:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116559360 00000100:00100000:2.0:1788843585.466388:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 302 00000100:00100000:2.0:1788843585.466396:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2390:x1875738116559232:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843585.466438:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2390:x1875738116559232:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 43us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843585.466445:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 302 00000100:00100000:2.0:1788843585.466459:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 303 00000100:00100000:2.0:1788843585.466465:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2390:x1875738116559360:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843585.466490:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2390:x1875738116559360:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 26us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843585.466496:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 303 00000100:00100000:2.0:1788843585.466523:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 127 00000100:00100000:2.0:1788843585.466529:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2390:x1875738116558976:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843585.466553:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2390:x1875738116558976:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 24us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843585.466559:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 127 00000100:00100000:3.0:1788843585.466567:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+25:2390:x1875738116558720:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 662us (8299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843585.466576:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 301 00000100:00080000:2.0:1788843585.471200:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788843585.471214:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788843585.471218:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788843585.471311:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12036aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2389:x1875738116559104:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 5221us (5657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843585.471329:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 126 00010000:00010000:0.0:1788843585.690386:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788843586.439658:0:14305:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788843586.439671:0:14305:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788843586.439775:0:14305:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788843586.439784:0:14305:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788843586.459324:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141bf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134457088:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788843586.459429:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843586.459516:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134457088 00000100:00100000:2.0:1788843586.459518:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788843586.459525:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134457088 00000100:00100000:2.0:1788843586.459534:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134457216:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788843586.459578:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843586.459581:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788843586.459590:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134457088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788843586.459635:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788843586.459706:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134457088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843586.459713:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788843586.459730:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134457216 00000100:00100000:1.0:1788843586.459734:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134457216 00000100:00100000:1.0:1788843586.459760:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788843586.459765:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134457216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788843586.459782:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788843586.459818:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134457216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843586.459824:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788843586.459868:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134457216:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788843586.459902:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141bf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134457088:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788843586.630466:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843586.630527:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116559616 00000100:00100000:3.0:1788843586.630539:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116559616 00000100:00100000:3.0:1788843586.630610:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 145 00000100:00100000:3.0:1788843586.630622:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd006756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+25:11411:x1875738116559616:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1788843586.630650:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843586.630678:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3600/0xa762dfcbd58d19f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490a8c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843586.630839:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3e00/0xa762dfcbd58d19f9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843586.630858:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3e00/0xa762dfcbd58d19f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843586.630874:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3e00/0xa762dfcbd58d19f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843586.630888:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788843586.631047:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3600/0xa762dfcbd58d19f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a8c expref: 28 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843586.631068:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3e00/0xa762dfcbd58d19f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a8c expref: 27 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843586.631079:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd007403000) 00010000:00010000:3.0:1788843586.631083:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788843586.631086:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be3e00, rc 0) 00000100:00100000:3.0:1788843586.631187:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd006756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+27:11411:x1875738116559616:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 565us (733us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788843586.631194:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 145 00000100:00100000:1.0:1788843586.635522:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843586.637155:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116559744 00000100:00100000:3.0:1788843586.637174:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116559744 00000100:00100000:3.0:1788843586.637331:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 146 00000100:00100000:3.0:1788843586.637348:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+27:11411:x1875738116559744:12345-192.168.203.33@tcp:54:lfs.0 00010000:00010000:3.0:1788843586.637850:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d1a07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843586.637877:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d1a07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843586.637892:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d1a07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843586.638116:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d1a07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843586.638128:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d1a07 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843586.638170:0:11996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d1a07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843586.638178:0:11996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be2000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1788843586.638185:0:11996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d1a07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843586.638194:0:11996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d1a07 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843586.638494:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd007403000) 00010000:00010000:3.0:1788843586.638499:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788843586.638505:0:11996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d1a07 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843586.638512:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d1a07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843586.638618:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+27:11411:x1875738116559744:12345-192.168.203.33@tcp:54:lfs.0 Request processed in 1271us (3106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843586.638627:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 146 00010000:00010000:0.0:1788843586.714515:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843586.725533:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843586.725897:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116559872 00000100:00100000:2.0:1788843586.725910:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116559872 00000100:00100000:2.0:1788843586.725993:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 54 00000100:00100000:2.0:1788843586.726006:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2390:x1875738116559872:12345-192.168.203.33@tcp:101:cat.0 00010000:00010000:2.0:1788843586.726032:0:8901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843586.726063:0:8901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040cae72d/0xa762dfcbd58d1a0e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490a93 expref: -99 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788843586.726095:0:8901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f963d, atime: 0x6a9f963d, ctime: 0x6a9f963d, blocks: 0x8 00010000:00010000:2.0:1788843586.726119:0:8901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=364s v=(0 0) 00010000:00010000:2.0:1788843586.726124:0:8901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843586.726135:0:8901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040cae72d/0xa762dfcbd58d1a0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a93 expref: 7 pid: 8901 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843586.726204:0:8901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000040cae72d/0xa762dfcbd58d1a0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a93 expref: 7 pid: 8901 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843586.726220:0:8901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007946200, rc 0) 00000100:00100000:2.0:1788843586.726307:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2390:x1875738116559872:12345-192.168.203.33@tcp:101:cat.0 Request processed in 303us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843586.726314:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 54 00000100:00100000:3.0:1788843586.733133:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843586.733313:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116560000 00000100:00100000:0.0:1788843586.733327:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116560000 00002000:00100000:0.0:1788843586.733399:0:8428:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9bd141aea680 x1875738116560000/t0(0) o3->f25f61b6-5faf-4e05-81a4-dea3dba05dc5@192.168.203.33@tcp:202/0 lens 488/0 e 0 to 0 dl 1788843597 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788843586.733412:0:8428:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd141aea680 with x1875738116560000 ext(0->4095) 00002000:00010000:0.0:1788843586.733419:0:8428:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bd141aea680 00000100:00100000:0.0:1788843586.733461:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 3 00000100:00100000:0.0:1788843586.733473:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141aea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2389:x1875738116560000:12345-192.168.203.33@tcp:3:cat.0 00000100:00100000:0.0:1788843586.733903:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141aea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2389:x1875738116560000:12345-192.168.203.33@tcp:3:cat.0 Request processed in 428us (784us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788843586.733914:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 3 00002000:00100000:0.0:1788843586.733922:0:8428:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9bd141aea680 x1875738116560000/t0(0) o3->f25f61b6-5faf-4e05-81a4-dea3dba05dc5@192.168.203.33@tcp:202/0 lens 488/4536 e 0 to 0 dl 1788843597 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788843586.733952:0:8428:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd141aea680 with x1875738116560000 ext(0->4095) 00002000:00010000:0.0:1788843586.733956:0:8428:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bd141aea680 00010000:00010000:2.0:1788843587.739668:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843588.763777:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788843589.023352:0:6485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:0.0:1788843589.023416:0:6485:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bd1102c2000 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788843589.023423:0:6485:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd13fb8f200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bd1102c2c00 00000020:00080000:0.0:1788843589.023426:0:6485:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd13fb8fc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bd13df5d000 00000020:00080000:0.0:1788843589.023459:0:6485:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1788843589.023726:0:6538:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1788843589.023824:0:6538:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1788843589.024062:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d1989 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843589.024078:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d1989 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843589.024085:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d1989 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843589.024116:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbeae00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843589.024123:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d1989 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843589.024132:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d1989 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788843589.024267:0:9500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:3.0:1788843589.024278:0:9500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:1.0:1788843589.024400:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9bd0071de600) 00010000:00010000:1.0:1788843589.024404:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843589.024410:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d1989 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843589.024417:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d1989 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788843589.658343:0:13785:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788843589.658355:0:13785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788843589.658379:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788843589.658388:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788843589.789057:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788843589.980938:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788843590.044309:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141bf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134457344:0@lo:400:kworker.0 00000100:00100000:1.0:1788843590.044412:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843590.044474:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008498e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134457856:0@lo:400:kworker.0 00000100:00100000:1.0:1788843590.044509:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843590.044530:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134458368:0@lo:400:kworker.0 00000100:00100000:1.0:1788843590.044556:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843590.044577:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134458880:0@lo:400:kworker.0 00000100:00100000:1.0:1788843590.044602:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843590.044645:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788843590.044651:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008499c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1875738134457728:0@lo:400:kworker.0 00000100:00100000:1.0:1788843590.044681:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843590.044699:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134458240:0@lo:400:kworker.0 00000100:00100000:1.0:1788843590.044740:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843590.044760:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134458752:0@lo:400:kworker.0 00000100:00100000:1.0:1788843590.044780:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843590.044817:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141bf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134457472:0@lo:400:kworker.0 00000100:00100000:1.0:1788843590.044849:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843590.044868:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008499f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134457984:0@lo:400:kworker.0 00000100:00100000:1.0:1788843590.044889:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843590.044905:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1875738134458496:0@lo:400:kworker.0 00000100:00100000:1.0:1788843590.044941:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843590.044961:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788843590.044968:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141bf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134457600:0@lo:400:kworker.0 00000100:00100000:1.0:1788843590.044993:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843590.045011:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008498000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134458112:0@lo:400:kworker.0 00000100:00100000:1.0:1788843590.045033:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843590.045050:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1875738134458624:0@lo:400:kworker.0 00000100:00100000:1.0:1788843590.045072:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843590.045100:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134457344 00000100:00100000:1.0:1788843590.045110:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134457344 00000100:00100000:1.0:1788843590.045192:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1788843590.045203:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3631:x1875738134457344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843590.045276:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3631:x1875738134457344:12345-0@lo:400:kworker.0 Request processed in 74us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843590.045291:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1788843590.045335:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134457856 00000100:00100000:1.0:1788843590.045340:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134457856 00000100:00100000:1.0:1788843590.045366:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134457600 00000100:00100000:1.0:1788843590.045370:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134457600 00000100:00100000:1.0:1788843590.045386:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788843590.045393:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134457856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843590.045432:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134457856:12345-0@lo:400:kworker.0 Request processed in 39us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843590.045439:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788843590.045452:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788843590.045458:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0085ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134457600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843590.045495:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0085ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134457600:12345-0@lo:400:kworker.0 Request processed in 36us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843590.045500:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788843590.045520:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134458368 00000100:00100000:1.0:1788843590.045523:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134458368 00000100:00100000:1.0:1788843590.045553:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134458880 00000100:00100000:1.0:1788843590.045556:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134458880 00000100:00100000:1.0:1788843590.045570:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134458240 00000100:00100000:1.0:1788843590.045573:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134458240 00000100:00100000:1.0:1788843590.045586:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134458752 00000100:00100000:1.0:1788843590.045589:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134458752 00000100:00100000:1.0:1788843590.045602:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788843590.045608:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134458368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843590.045643:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134458368:12345-0@lo:400:kworker.0 Request processed in 34us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843590.045649:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788843590.045670:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788843590.045676:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134458880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843590.045706:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134458880:12345-0@lo:400:kworker.0 Request processed in 31us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843590.045713:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788843590.045724:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788843590.045730:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0085eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134458240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843590.045756:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0085eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134458240:12345-0@lo:400:kworker.0 Request processed in 26us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843590.045762:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788843590.045774:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788843590.045780:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0085ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134458752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843590.045808:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0085ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134458752:12345-0@lo:400:kworker.0 Request processed in 29us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843590.045814:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788843590.045865:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141bf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134457600:0@lo:400:kworker.0 00000100:00100000:1.0:1788843590.045904:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134458240:0@lo:400:kworker.0 00000100:00100000:1.0:1788843590.045914:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134458752:0@lo:400:kworker.0 00000100:00100000:1.0:1788843590.045924:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141bf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134457344:0@lo:400:kworker.0 00000100:00100000:1.0:1788843590.045932:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008498e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134457856:0@lo:400:kworker.0 00000100:00100000:1.0:1788843590.045943:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134458368:0@lo:400:kworker.0 00000100:00100000:1.0:1788843590.045951:0:3631:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1788843590.045956:0:3631:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd008499880, transno 4294967311 00000004:00080000:1.0:1788843590.045979:0:3631:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:1.0:1788843590.046002:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134458880:0@lo:400:kworker.0 00000100:00100000:3.0:1788843590.047542:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134457728 00000100:00100000:3.0:1788843590.047571:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134457728 00000100:00100000:3.0:1788843590.047627:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134457472 00000100:00100000:3.0:1788843590.047632:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134457472 00000100:00100000:3.0:1788843590.047647:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134457984 00000100:00100000:3.0:1788843590.047650:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134457984 00000100:00100000:3.0:1788843590.047667:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134458496 00000100:00100000:3.0:1788843590.047669:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134458496 00000100:00100000:3.0:1788843590.047683:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134458112 00000100:00100000:3.0:1788843590.047686:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134458112 00000100:00100000:3.0:1788843590.047700:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134458624 00000100:00100000:3.0:1788843590.047702:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134458624 00000100:00100000:3.0:1788843590.047721:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788843590.047730:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1875738134457728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843590.047849:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1875738134457728:12345-0@lo:400:kworker.0 Request processed in 120us (3166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843590.047856:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788843590.047875:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1788843590.047881:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0085ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134457472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843590.048335:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788843590.048365:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134459008:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788843590.049279:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788843590.049371:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788843590.049377:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788843590.049380:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788843590.049384:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788843590.049404:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134459008 00000100:00100000:2.0:1788843590.049414:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134459008 00000100:00100000:2.0:1788843590.049474:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788843590.049484:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008627800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134459008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788843590.049526:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788843590.049591:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008627800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134459008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843590.049598:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788843590.049692:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134459008:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788843590.050137:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0085ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134457472:12345-0@lo:400:kworker.0 Request processed in 2252us (5283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843590.050160:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1788843590.050188:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788843590.050198:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0085ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134457984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843590.050263:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0085ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134457984:12345-0@lo:400:kworker.0 Request processed in 57us (5361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843590.050270:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788843590.050283:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788843590.050290:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0085ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1875738134458496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843590.050342:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0085ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1875738134458496:12345-0@lo:400:kworker.0 Request processed in 53us (5400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843590.050348:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788843590.050360:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1788843590.050368:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0085ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134458112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843590.050403:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0085ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134458112:12345-0@lo:400:kworker.0 Request processed in 36us (5368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843590.050409:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1788843590.050422:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788843590.050429:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0085efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1875738134458624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843590.050459:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0085efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1875738134458624:12345-0@lo:400:kworker.0 Request processed in 31us (5387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843590.050465:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788843590.050533:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008499c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1875738134457728:0@lo:400:kworker.0 00010000:00080000:3.0:1788843590.050572:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd008498000 x1875738134458112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843590.050584:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008498000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134458112:0@lo:400:kworker.0 00010000:00080000:3.0:1788843590.050597:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141b9d180 x1875738134458624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843590.050606:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1875738134458624:0@lo:400:kworker.0 00000100:00100000:3.0:1788843590.050620:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141bf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134457472:0@lo:400:kworker.0 00000100:00100000:3.0:1788843590.050633:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008499f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134457984:0@lo:400:kworker.0 00000100:00100000:3.0:1788843590.050658:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1875738134458496:0@lo:400:kworker.0 00000100:00100000:3.0:1788843590.554512:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788843590.554547:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0085edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134459136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843590.554641:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843590.554710:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134459136 00000100:00100000:2.0:1788843590.554720:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134459136 00000100:00100000:2.0:1788843590.554782:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788843590.554794:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134459136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788843590.554830:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788843590.554886:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134459136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843590.554894:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788843590.554950:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0085edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134459136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843590.555358:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134459392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843590.555395:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843590.555431:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788843590.555437:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0085eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134459264:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788843590.555462:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843590.555545:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134459392 00000100:00100000:1.0:1788843590.555550:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134459392 00000100:00100000:1.0:1788843590.555585:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134459264 00000100:00100000:1.0:1788843590.555588:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134459264 00000100:00100000:1.0:1788843590.555604:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788843590.555611:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134459392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788843590.555626:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788843590.555686:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134459392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843590.555694:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788843590.555707:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788843590.555713:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134459264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788843590.555724:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788843590.555750:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134459264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843590.555755:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788843590.555874:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0085eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134459264:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788843590.555889:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134459392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843590.576672:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843590.576719:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843590.576803:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116560128 00000100:00100000:0.0:1788843590.576817:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116560128 00000100:00100000:1.0:1788843590.577209:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843590.577262:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843590.577323:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116560640 00000100:00100000:2.0:1788843590.577329:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116560640 00000100:00100000:2.0:1788843590.577420:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 132 00000100:00100000:2.0:1788843590.577432:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0085ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2387:x1875738116560640:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843590.577738:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0085ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2387:x1875738116560640:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 305us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843590.577747:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 132 00000100:00080000:2.0:1788843590.577777:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788843590.578470:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 387 00000100:00100000:0.0:1788843590.578481:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+13:2387:x1875738116560128:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1788843590.578548:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+13:2387:x1875738116560128:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 68us (1890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843590.578555:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 387 00000100:00100000:3.0:1788843590.582203:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116560384 00000100:00100000:3.0:1788843590.582218:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116560384 00000100:00100000:3.0:1788843590.582315:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116560896 00000100:00100000:3.0:1788843590.582320:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116560896 00000100:00100000:3.0:1788843590.582347:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 310 00000100:00100000:3.0:1788843590.582358:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0085ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116560384:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843590.582565:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 311 00000100:00100000:2.0:1788843590.582577:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0085ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2387:x1875738116560896:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843590.582650:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0085ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116560384:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 293us (5929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843590.582660:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 310 00000100:00080000:0.0:1788843590.582853:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788843590.582942:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843590.582994:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116560256 00000100:00100000:0.0:1788843590.582999:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116560256 00000100:00100000:0.0:1788843590.583040:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 312 00000100:00100000:0.0:1788843590.583047:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0085ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+13:2387:x1875738116560256:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843590.587273:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0085ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2387:x1875738116560896:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 4671us (9981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843590.587293:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 311 00000100:00080000:2.0:1788843590.587410:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843590.588302:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843590.588349:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843590.588591:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116560768 00000100:00100000:2.0:1788843590.588604:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116560768 00000100:00100000:2.0:1788843590.588685:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 313 00000100:00100000:2.0:1788843590.588696:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0085ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2387:x1875738116560768:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843590.588790:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0085ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2387:x1875738116560768:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 95us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843590.588798:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 313 00000100:00080000:1.0:1788843590.588920:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843590.589341:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116560512 00000100:00100000:3.0:1788843590.589347:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116560512 00000100:00100000:0.0:1788843590.589422:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0085ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+13:2387:x1875738116560256:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 6371us (7517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843590.589432:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 312 00000100:00100000:3.0:1788843590.589649:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 133 00000100:00100000:3.0:1788843590.589658:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0085eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116560512:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843590.589713:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0085eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116560512:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 57us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843590.589721:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 133 00000100:00080000:1.0:1788843590.589827:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788843590.810414:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843591.578577:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0085ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134459520:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788843591.578685:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843591.578728:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134459520 00000100:00100000:0.0:1788843591.578738:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134459520 00000100:00100000:2.0:1788843591.578760:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788843591.578769:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134459648:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788843591.578800:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788843591.578812:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008625880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134459520:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788843591.578822:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:0.0:1788843591.578856:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788843591.578861:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134459648 00000100:00100000:2.0:1788843591.578867:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134459648 00000100:00100000:2.0:1788843591.578891:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788843591.578899:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134459648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788843591.578922:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788843591.578942:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008625880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134459520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843591.578951:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788843591.578964:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134459648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843591.578972:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788843591.579024:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134459648:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788843591.579039:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0085ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134459520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788843591.762980:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843591.763104:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116561024 00000100:00100000:2.0:1788843591.763116:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116561024 00000100:00100000:2.0:1788843591.763264:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 147 00000100:00100000:2.0:1788843591.763276:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+13:11064:x1875738116561024:12345-192.168.203.33@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788843591.763413:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+13:11064:x1875738116561024:12345-192.168.203.33@tcp:60:lhsmtool_posix.0 Request processed in 139us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843591.763422:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 147 00000100:00100000:2.0:1788843591.775546:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843591.775666:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116561152 00000100:00100000:3.0:1788843591.775679:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116561152 00000100:00100000:3.0:1788843591.775765:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 148 00000100:00100000:3.0:1788843591.775779:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:11064:x1875738116561152:12345-192.168.203.33@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788843591.775924:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:11064:x1875738116561152:12345-192.168.203.33@tcp:60:lhsmtool_posix.0 Request processed in 148us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843591.775933:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 148 00000100:00100000:1.0:1788843591.785206:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843591.785401:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116561408 00000100:00100000:2.0:1788843591.785417:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116561408 00000100:00100000:2.0:1788843591.785496:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 35 00000100:00100000:2.0:1788843591.785509:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0085edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+13:11064:x1875738116561408:12345-192.168.203.33@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788843591.785839:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0085edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+14:11064:x1875738116561408:12345-192.168.203.33@tcp:35:lhsmtool_posix.0 Request processed in 331us (647us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788843591.785886:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 35 00010000:00010000:2.0:1788843591.835646:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843592.141609:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843592.147804:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116561536 00000100:00100000:2.0:1788843592.147826:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116561536 00000100:00100000:2.0:1788843592.147932:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 149 00000100:00100000:2.0:1788843592.147949:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0085ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:11870:x1875738116561536:12345-192.168.203.33@tcp:101:lsof.0 00010000:00010000:2.0:1788843592.147984:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843592.148011:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1a15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490a9a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843592.148097:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1a1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843592.148270:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1a1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843592.148287:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1a1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843592.148352:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788843592.148356:0:6508:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788843592.148404:0:6508:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1a1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843592.148433:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1a15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a9a expref: 7 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843592.148453:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1a1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a9a expref: 6 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843592.148485:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd13dfda000) 00010000:00010000:2.0:1788843592.148488:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788843592.148492:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007946e00, rc 0) 00000100:00100000:2.0:1788843592.148571:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0085ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+6:11870:x1875738116561536:12345-192.168.203.33@tcp:101:lsof.0 Request processed in 629us (6979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843592.148579:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 149 00000100:00080000:0.0:1788843592.152643:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788843592.858805:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843593.884356:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788843594.660556:0:6485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:0.0:1788843594.660581:0:6485:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1788843594.660689:0:6538:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1788843594.660710:0:6538:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1788843594.907027:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843595.162531:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008627b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134459776:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788843595.162625:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843595.162703:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134459776 00000100:00100000:1.0:1788843595.162721:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134459776 00000100:00080000:0.0:1788843595.162775:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788843595.162811:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788843595.162826:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134459776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788843595.162867:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788843595.162953:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134459776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 131us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843595.162961:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788843595.163063:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141aebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134460032:0@lo:400:kworker.0 00000100:00100000:0.0:1788843595.163097:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134459904:0@lo:400:kworker.0 00000100:00100000:2.0:1788843595.163125:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843595.163188:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843595.163228:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134459904 00000100:00100000:1.0:1788843595.163235:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134459904 00000100:00100000:3.0:1788843595.163266:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134460032 00000100:00100000:3.0:1788843595.163277:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134460032 00000100:00100000:1.0:1788843595.163286:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1788843595.163296:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e092050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3631:x1875738134459904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843595.163336:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788843595.163348:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008625c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134460032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843595.167850:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134460544:0@lo:400:kworker.0 00000100:00100000:2.0:1788843595.167944:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843595.167989:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1875738134461056:0@lo:400:kworker.0 00000100:00100000:2.0:1788843595.168013:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843595.168048:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788843595.168055:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134460160:0@lo:400:kworker.0 00000100:00100000:2.0:1788843595.168100:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843595.168121:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134460672:0@lo:400:kworker.0 00000100:00100000:2.0:1788843595.168164:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843595.168184:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134461184:0@lo:400:kworker.0 00000100:00100000:2.0:1788843595.168210:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843595.168278:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134460160 00000100:00100000:2.0:1788843595.168287:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134460160 00000100:00100000:2.0:1788843595.168367:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788843595.168379:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134460160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843595.168448:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134460160:12345-0@lo:400:kworker.0 Request processed in 71us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843595.168475:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788843595.168515:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134460544 00000100:00100000:2.0:1788843595.168520:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134460544 00000100:00100000:2.0:1788843595.171430:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134461056 00000100:00100000:2.0:1788843595.171449:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134461056 00000100:00100000:2.0:1788843595.171475:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134460672 00000100:00100000:2.0:1788843595.171478:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134460672 00000100:00100000:2.0:1788843595.171517:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788843595.171531:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008626d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134460544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843595.171665:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008626d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134460544:12345-0@lo:400:kworker.0 Request processed in 138us (3721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843595.171673:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788843595.171695:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788843595.171701:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008624700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1875738134461056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843595.171730:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008624700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1875738134461056:12345-0@lo:400:kworker.0 Request processed in 30us (3716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843595.171736:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788843595.171748:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1788843595.171754:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134460672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843595.171780:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134460672:12345-0@lo:400:kworker.0 Request processed in 27us (3617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843595.171786:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1788843595.171814:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134461184 00000100:00100000:2.0:1788843595.171818:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134461184 00000100:00100000:2.0:1788843595.171856:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788843595.171863:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008625180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134461184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843595.171916:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008625180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134461184:12345-0@lo:400:kworker.0 Request processed in 53us (3705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843595.171922:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788843595.171986:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134460160:0@lo:400:kworker.0 00010000:00080000:2.0:1788843595.172005:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd008622680 x1875738134460672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843595.172017:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134460672:0@lo:400:kworker.0 00000100:00100000:2.0:1788843595.172028:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134461184:0@lo:400:kworker.0 00000100:00100000:2.0:1788843595.172041:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134460544:0@lo:400:kworker.0 00010000:00080000:2.0:1788843595.172051:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd008623480 x1875738134461056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843595.172060:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1875738134461056:0@lo:400:kworker.0 00000100:00100000:0.0:1788843595.172440:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134460416:0@lo:400:kworker.0 00000100:00100000:2.0:1788843595.172646:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134460288:0@lo:400:kworker.0 00000100:00100000:0.0:1788843595.173629:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843595.173672:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008623800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1875738134460928:0@lo:400:kworker.0 00000100:00100000:0.0:1788843595.173704:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843595.173758:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134460416 00000100:00100000:0.0:1788843595.173767:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134460416 00000100:00100000:0.0:1788843595.173811:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788843595.173820:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134460416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843595.173896:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134460416:12345-0@lo:400:kworker.0 Request processed in 76us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843595.173906:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:0.0:1788843595.173932:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788843595.173939:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788843595.173941:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843595.173960:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134460928 00000100:00100000:0.0:1788843595.173964:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134460928 00000100:00100000:2.0:1788843595.173973:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843595.174012:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134460288 00000100:00100000:0.0:1788843595.174018:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134460288 00000100:00100000:2.0:1788843595.174025:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008620380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134460800:0@lo:400:kworker.0 00000100:00100000:0.0:1788843595.174045:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1788843595.174057:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1875738134460928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843595.174067:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843595.175365:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1875738134460928:12345-0@lo:400:kworker.0 Request processed in 1304us (1652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843595.175376:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1788843595.175405:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1788843595.175416:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008626a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134460288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843595.175493:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008626a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134460288:12345-0@lo:400:kworker.0 Request processed in 81us (1526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843595.175501:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00080000:0.0:1788843595.175525:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843595.175572:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134460416:0@lo:400:kworker.0 00000100:00100000:0.0:1788843595.175587:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008623800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1875738134460928:0@lo:400:kworker.0 00000100:00100000:0.0:1788843595.175654:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134460800 00000100:00100000:0.0:1788843595.175659:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134460800 00000100:00100000:0.0:1788843595.175705:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788843595.175712:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008624e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134460800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843595.175754:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008624e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134460800:12345-0@lo:400:kworker.0 Request processed in 43us (1689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843595.175761:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:0.0:1788843595.175778:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788843595.176711:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e092050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3631:x1875738134459904:12345-0@lo:400:kworker.0 Request processed in 13406us (13514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843595.176729:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1788843595.176803:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134459904:0@lo:400:kworker.0 00000100:00100000:3.0:1788843595.178350:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008625c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134460032:12345-0@lo:400:kworker.0 Request processed in 14997us (15218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843595.178365:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788843595.178543:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141aebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134460032:0@lo:400:kworker.0 00000100:00100000:2.0:1788843595.180648:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008620380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134460800:0@lo:400:kworker.0 00000100:00100000:2.0:1788843595.180669:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134461312:0@lo:400:kworker.0 00000100:00100000:2.0:1788843595.180754:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843595.180839:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008627b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134459776:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788843595.180867:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134461312 00000100:00100000:0.0:1788843595.180885:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134461312 00000100:00100000:2.0:1788843595.180898:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134460288:0@lo:400:kworker.0 00000100:00100000:0.0:1788843595.181061:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788843595.181074:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008625500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134461312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843595.181210:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008625500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134461312:12345-0@lo:400:kworker.0 Request processed in 138us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843595.181237:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788843595.184488:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134461312:0@lo:400:kworker.0 00000100:00080000:1.0:1788843595.184640:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788843595.674512:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008627b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134461440:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788843595.674583:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843595.674967:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788843595.674978:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134461568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843595.675010:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843595.675043:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134461440 00000100:00100000:3.0:1788843595.675051:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134461440 00000100:00100000:3.0:1788843595.675093:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134461568 00000100:00100000:3.0:1788843595.675096:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134461568 00000100:00100000:3.0:1788843595.675113:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788843595.675121:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008625f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134461440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788843595.675174:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788843595.675245:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008625f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134461440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 123us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843595.675251:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788843595.675269:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788843595.675274:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008623b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134461568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788843595.675283:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788843595.675309:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008623b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134461568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843595.675315:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788843595.675369:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134461568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843595.675405:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008627b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134461440:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788843595.675957:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788843595.675968:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134461696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788843595.676008:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843595.676077:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134461696 00000100:00100000:0.0:1788843595.676082:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134461696 00000100:00100000:0.0:1788843595.676118:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788843595.676126:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134461696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788843595.676137:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843595.676223:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134461696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843595.676230:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788843595.676446:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134461696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788843595.701343:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843595.701384:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843595.701407:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843595.701429:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843595.701449:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843595.701485:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843595.701507:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843595.701742:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116561920 00000100:00100000:1.0:1788843595.701752:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116561920 00000100:00100000:1.0:1788843595.701810:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116562432 00000100:00100000:1.0:1788843595.701813:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116562432 00000100:00100000:1.0:1788843595.701826:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116561792 00000100:00100000:1.0:1788843595.701829:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116561792 00000100:00100000:1.0:1788843595.701841:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116562304 00000100:00100000:1.0:1788843595.701843:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116562304 00000100:00100000:1.0:1788843595.701861:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 320 00000100:00100000:1.0:1788843595.701884:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2390:x1875738116561920:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843595.701980:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2390:x1875738116561920:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 103us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843595.701989:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 320 00000100:00100000:1.0:1788843595.702007:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 321 00000100:00100000:1.0:1788843595.702013:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2390:x1875738116562432:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843595.702036:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2390:x1875738116562432:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 24us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843595.702042:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 321 00000100:00100000:1.0:1788843595.702052:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 322 00000100:00100000:1.0:1788843595.702058:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+13:2390:x1875738116561792:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843595.702083:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+13:2390:x1875738116561792:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 25us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843595.702089:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 322 00000100:00100000:1.0:1788843595.702098:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 323 00000100:00100000:1.0:1788843595.702104:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+6:2390:x1875738116562304:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843595.702122:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+6:2390:x1875738116562304:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 18us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843595.702128:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 323 00000100:00080000:1.0:1788843595.702164:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788843595.702169:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788843595.702310:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116562176 00000100:00100000:1.0:1788843595.702315:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116562176 00000100:00100000:1.0:1788843595.702348:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116562048 00000100:00100000:1.0:1788843595.702357:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116562048 00000100:00100000:1.0:1788843595.702384:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 137 00000100:00100000:1.0:1788843595.702392:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2390:x1875738116562176:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843595.702424:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2390:x1875738116562176:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 34us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843595.702431:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 137 00000100:00100000:1.0:1788843595.702444:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 138 00000100:00100000:1.0:1788843595.702450:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2390:x1875738116562048:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843595.702474:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2390:x1875738116562048:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 25us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843595.702480:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 138 00000100:00080000:1.0:1788843595.702525:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788843595.702528:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788843595.702785:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116561664 00000100:00100000:2.0:1788843595.702790:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116561664 00000100:00100000:2.0:1788843595.702829:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 389 00000100:00100000:2.0:1788843595.702836:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+13:2390:x1875738116561664:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843595.702868:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+13:2390:x1875738116561664:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 34us (1537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843595.702874:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 389 00010000:00010000:2.0:1788843595.939378:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788843596.313949:0:14502:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 00:59:53 (1788843593) 00000100:00100000:3.0:1788843596.699749:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008624a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134461824:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788843596.699831:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843596.699920:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134461824 00000100:00100000:3.0:1788843596.699928:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134461824 00000100:00100000:3.0:1788843596.699970:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788843596.699980:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134461824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788843596.700014:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788843596.700061:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134461824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843596.700068:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788843596.700113:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008624a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134461824:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788843596.701649:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788843596.701668:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0085eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134461952:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788843596.701723:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843596.701817:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134461952 00000100:00100000:2.0:1788843596.701825:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134461952 00000100:00100000:2.0:1788843596.701871:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788843596.701881:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134461952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788843596.701907:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788843596.701961:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134461952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843596.701969:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788843596.702085:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0085eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134461952:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788843596.954412:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843597.951376:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843597.952125:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116562688 00000100:00100000:0.0:1788843597.952136:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116562688 00000100:00100000:0.0:1788843597.952266:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 150 00000100:00100000:0.0:1788843597.952277:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0085eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+13:12138:x1875738116562688:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788843597.952298:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843597.952317:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1a23 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490aa1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843597.952400:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1a2a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843597.952413:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1a2a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843597.952425:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1a2a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843597.952440:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1a31 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843597.952446:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1a31 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843597.952462:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1a31 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843597.952572:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1a38 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843597.952581:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1a38 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843597.952588:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1a38 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843597.952597:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788843597.952680:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1a2a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843597.952686:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1a2a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843597.952692:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1a2a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843597.952697:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3dc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843597.952701:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1a2a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843597.952708:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1a2a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843597.952719:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bd0071de800) 00010000:00010000:0.0:1788843597.952722:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843597.952726:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1a2a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843597.952741:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1a2a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843597.952755:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1a31 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843597.952759:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1a31 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843597.952764:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1a31 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843597.952769:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3c800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843597.952772:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1a31 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843597.952777:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1a31 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843597.952800:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9bd00658b300) 00010000:00010000:0.0:1788843597.952802:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843597.952805:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1a31 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843597.952811:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1a31 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788843597.952969:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788843597.954545:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1a23 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490aa1 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843597.954571:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1a38 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490aa1 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843597.954593:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd00746cd00) 00010000:00010000:0.0:1788843597.954596:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843597.954599:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3da00, rc 0) 00000100:00100000:0.0:1788843597.954677:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0085eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+15:12138:x1875738116562688:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 2393us (3299us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1788843597.954686:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 150 00000100:00100000:0.0:1788843597.969082:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843597.969121:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843597.969227:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116562944 00000100:00100000:2.0:1788843597.969236:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116562944 00000100:00100000:2.0:1788843597.969304:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 11 00000100:00100000:2.0:1788843597.969314:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13332a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+15:2388:x1875738116562944:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843597.969345:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843597.969371:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1a38 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490aa1 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843597.969402:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd00746cd00) 00010000:00010000:2.0:1788843597.969407:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843597.969468:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13332a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+14:2388:x1875738116562944:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 156us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843597.969476:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 11 00000100:00100000:1.0:1788843597.970620:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116562816 00000100:00100000:1.0:1788843597.970630:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116562816 00000100:00100000:1.0:1788843597.970677:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 151 00000100:00100000:1.0:1788843597.970686:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+14:12138:x1875738116562816:12345-192.168.203.33@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788843597.970768:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+14:12138:x1875738116562816:12345-192.168.203.33@tcp:59:lhsmtool_posix.0 Request processed in 83us (1705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843597.970775:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 151 00000100:00100000:1.0:1788843597.974034:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843597.974136:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116563072 00000100:00100000:0.0:1788843597.974176:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116563072 00000100:00100000:0.0:1788843597.974247:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 152 00000100:00100000:0.0:1788843597.974258:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0085edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:12138:x1875738116563072:12345-192.168.203.33@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788843597.974361:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0085edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:12138:x1875738116563072:12345-192.168.203.33@tcp:59:lhsmtool_posix.0 Request processed in 104us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843597.974368:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 152 00000100:00080000:1.0:1788843597.974910:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788843597.980510:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788843598.171060:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788843598.875354:0:13785:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788843598.875367:0:13785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788843598.875977:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788843598.876026:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788843599.004747:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788843599.199960:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788843599.899061:0:13785:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788843599.899073:0:13785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788843599.899246:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1788843599.899272:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788843600.026644:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843600.201461:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843600.204353:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116563200 00000100:00100000:0.0:1788843600.204369:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116563200 00000100:00100000:0.0:1788843600.204497:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 153 00000100:00100000:0.0:1788843600.204508:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+14:12180:x1875738116563200:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1788843600.204534:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843600.204559:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1a46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490aa8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.204664:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1a4d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.204682:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1a4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.204696:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1a4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.204711:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1a54 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.204718:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1a54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.204725:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1a54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.204780:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1a4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.204786:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1a4d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.204793:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1a4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.204800:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843600.204805:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1a4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.204823:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1a4d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.204837:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd13dfda000) 00010000:00010000:0.0:1788843600.204841:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843600.204846:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1a4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.204853:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1a4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.204868:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1a54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.204875:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1a54 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.204881:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1a54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.204886:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843600.204888:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1a54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.204894:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1a54 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.204901:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9bd00658be00) 00010000:00010000:0.0:1788843600.204903:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843600.204906:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1a54 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.204920:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1a54 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.204958:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1a46 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490aa8 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.204969:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd13dfda000) 00010000:00010000:0.0:1788843600.204971:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843600.204975:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1a46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490aa8 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.204984:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3cc00, rc 0) 00000100:00080000:2.0:1788843600.205280:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843600.205684:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+14:12180:x1875738116563200:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1174us (4235us total) trans 0 rc 301/301 00000100:00100000:0.0:1788843600.205694:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 153 00000100:00100000:3.0:1788843600.224313:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843600.224442:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116563456 00000100:00100000:2.0:1788843600.224456:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116563456 00000100:00100000:2.0:1788843600.224519:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 154 00000100:00100000:2.0:1788843600.224541:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+14:12180:x1875738116563456:12345-192.168.203.33@tcp:36:lfs.0 00010000:00010000:2.0:1788843600.224631:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843600.224668:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d139a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908cc expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843600.224689:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd13dfda000) 00010000:00010000:2.0:1788843600.224696:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788843600.224777:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1a5b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843600.224799:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1a1c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a9a expref: 5 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843600.224824:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1a5b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843600.224868:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1a1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a9a expref: 5 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843600.224885:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1a1c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a9a expref: 5 pid: 6508 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843600.224903:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008626680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6507:1875738134462080:192.168.203.33@tcp:104: 00000100:00100000:2.0:1788843600.225029:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0070146c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843600.231452:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008626680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6507:1875738134462080:192.168.203.33@tcp:104: 00010000:00010000:3.0:1788843600.231605:0:6507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1a5b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843600.234289:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843600.234408:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116563584 00000100:00100000:2.0:1788843600.234422:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116563584 00010000:00010000:2.0:1788843600.234505:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1a1c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a9a expref: 6 pid: 6508 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843600.234568:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 79 00000100:00100000:2.0:1788843600.234581:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f956d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+6:2389:x1875738116563584:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843600.234601:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843600.234610:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1a1c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a9a expref: 6 pid: 6508 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788843600.234778:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788843600.234911:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1a1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a9a expref: 6 pid: 6508 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843600.234940:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1a1c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a9a expref: 6 pid: 6508 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843600.234981:0:7448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd13dfda000) 00010000:00010000:2.0:1788843600.234988:0:7448:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1a5b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843600.234998:0:7448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1a5b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843600.235007:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1a5b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843600.235071:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843600.235194:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f956d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2389:x1875738116563584:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 614us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843600.235203:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 79 00010000:00010000:3.0:1788843600.235288:0:6507:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1a5b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.235297:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1a5b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.235325:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d1a62 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.235335:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d1a62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.235343:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d1a62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.236818:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d1a69 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.236842:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d1a69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.236878:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d1a69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788843600.237024:0:6507:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d844cd11 reply state 0000000032ba8816 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d1a69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.237039:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d1a69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.237051:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bd007450c00) 00010000:00010000:3.0:1788843600.237055:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788843600.237059:0:6507:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788843600.237066:0:6507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788843600.237075:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1a5b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.237082:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1a5b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.237090:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1a5b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.237254:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1788843600.237260:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1a5b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.237269:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1a5b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.237282:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd13dfda000) 00010000:00010000:3.0:1788843600.237285:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843600.237296:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1a5b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.237302:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1a5b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788843600.237325:0:6507:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d844cd11 reply state 0000000032ba8816 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d1a62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.237334:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d1a62 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.237340:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9bd007450000) 00010000:00010000:3.0:1788843600.237342:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788843600.237344:0:6507:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788843600.237535:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+15:12180:x1875738116563456:12345-192.168.203.33@tcp:36:lfs.0 Request processed in 12931us (13161us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788843600.237548:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 154 00000100:00100000:3.0:1788843600.284565:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788843600.284615:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008620700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134462208:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788843600.284724:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843600.284800:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134462208 00000100:00100000:3.0:1788843600.284810:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134462208 00000100:00100000:3.0:1788843600.284883:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788843600.284894:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008623100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134462208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788843600.284934:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843600.284989:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008623100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134462208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843600.284997:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:3.0:1788843600.285022:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843600.285082:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008620700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134462208:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788843600.285471:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134462464:0@lo:400:kworker.0 00000100:00100000:0.0:1788843600.285519:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843600.285547:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134462976:0@lo:400:kworker.0 00000100:00100000:0.0:1788843600.285569:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843600.285592:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134463488:0@lo:400:kworker.0 00000100:00100000:0.0:1788843600.285610:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843600.285627:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788843600.285632:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f984380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134462592:0@lo:400:kworker.0 00000100:00100000:0.0:1788843600.285656:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843600.285687:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd006756d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134463104:0@lo:400:kworker.0 00000100:00100000:0.0:1788843600.285710:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843600.285726:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134463616:0@lo:400:kworker.0 00000100:00100000:0.0:1788843600.285751:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843600.285788:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134462464 00000100:00100000:0.0:1788843600.285794:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134462464 00000100:00100000:0.0:1788843600.285829:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134462976 00000100:00100000:0.0:1788843600.285833:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134462976 00000100:00100000:0.0:1788843600.285855:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134463488 00000100:00100000:0.0:1788843600.285857:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134463488 00000100:00100000:0.0:1788843600.285869:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788843600.285875:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134462464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843600.285917:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134462464:12345-0@lo:400:kworker.0 Request processed in 42us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843600.285924:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788843600.285935:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134463104 00000100:00100000:0.0:1788843600.285938:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134463104 00000100:00100000:0.0:1788843600.285951:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788843600.285956:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134462976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843600.285979:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134462976:12345-0@lo:400:kworker.0 Request processed in 23us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843600.285985:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788843600.285993:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1788843600.285998:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134463488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843600.286018:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134463488:12345-0@lo:400:kworker.0 Request processed in 20us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843600.286023:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1788843600.286039:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1788843600.286044:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134463104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843600.286066:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134463104:12345-0@lo:400:kworker.0 Request processed in 22us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843600.286072:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1788843600.286096:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134462592 00000100:00100000:0.0:1788843600.286099:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134462592 00000100:00100000:0.0:1788843600.286124:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788843600.286129:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134462592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843600.286198:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134462592:12345-0@lo:400:kworker.0 Request processed in 68us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843600.286204:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788843600.286222:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134463616 00000100:00100000:0.0:1788843600.286225:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134463616 00000100:00100000:0.0:1788843600.286251:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788843600.286256:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134463616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843600.286282:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134463616:12345-0@lo:400:kworker.0 Request processed in 26us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843600.286288:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:0.0:1788843600.286312:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788843600.286316:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788843600.286318:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843600.286340:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f984380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134462592:0@lo:400:kworker.0 00010000:00080000:0.0:1788843600.286353:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd006756d80 x1875738134463104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843600.286364:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006756d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134463104:0@lo:400:kworker.0 00000100:00100000:0.0:1788843600.286382:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134463616:0@lo:400:kworker.0 00000100:00100000:0.0:1788843600.286390:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134462464:0@lo:400:kworker.0 00000100:00100000:0.0:1788843600.286398:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd006755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134462976:0@lo:400:kworker.0 00010000:00080000:0.0:1788843600.286406:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007aca300 x1875738134463488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843600.286414:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134463488:0@lo:400:kworker.0 00000100:00100000:2.0:1788843600.286517:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134462720:0@lo:400:kworker.0 00000100:00100000:2.0:1788843600.286551:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843600.286576:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134463232:0@lo:400:kworker.0 00000100:00100000:2.0:1788843600.286594:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843600.286609:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134463744:0@lo:400:kworker.0 00000100:00100000:2.0:1788843600.286626:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843600.286647:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788843600.286652:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134462336:0@lo:400:kworker.0 00000100:00100000:2.0:1788843600.286679:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843600.286700:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134462848:0@lo:400:kworker.0 00000100:00100000:2.0:1788843600.286722:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843600.286737:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1875738134463360:0@lo:400:kworker.0 00000100:00100000:2.0:1788843600.286763:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843600.286784:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134463232 00000100:00100000:2.0:1788843600.286788:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134463232 00000100:00100000:2.0:1788843600.286812:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134463744 00000100:00100000:2.0:1788843600.286814:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134463744 00000100:00100000:2.0:1788843600.286829:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788843600.286834:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008626680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134463232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843600.286866:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008626680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134463232:12345-0@lo:400:kworker.0 Request processed in 31us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843600.286872:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788843600.286884:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788843600.286889:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008624a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134463744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843600.286909:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008624a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134463744:12345-0@lo:400:kworker.0 Request processed in 20us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843600.286915:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788843600.286929:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134462336 00000100:00100000:2.0:1788843600.286932:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134462336 00000100:00100000:2.0:1788843600.286954:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1788843600.286959:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3632:x1875738134462336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843600.286983:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3632:x1875738134462336:12345-0@lo:400:kworker.0 Request processed in 24us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843600.286989:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1788843600.287015:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134462848 00000100:00100000:2.0:1788843600.287018:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134462848 00000100:00100000:2.0:1788843600.287034:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788843600.287039:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134462848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843600.287064:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134462848:12345-0@lo:400:kworker.0 Request processed in 25us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843600.287075:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:2.0:1788843600.287094:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788843600.287097:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788843600.287112:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134462336:0@lo:400:kworker.0 00000100:00100000:2.0:1788843600.287120:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134462848:0@lo:400:kworker.0 00000100:00100000:2.0:1788843600.287128:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134463232:0@lo:400:kworker.0 00000100:00100000:2.0:1788843600.287136:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134463744:0@lo:400:kworker.0 00000100:00100000:0.0:1788843600.287243:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134462720 00000100:00100000:0.0:1788843600.287247:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134462720 00000100:00100000:0.0:1788843600.287277:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134463360 00000100:00100000:0.0:1788843600.287280:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134463360 00000100:00100000:0.0:1788843600.287301:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1788843600.287306:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008624380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134462720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843600.287342:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008624380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134462720:12345-0@lo:400:kworker.0 Request processed in 36us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843600.287348:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1788843600.287358:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1788843600.287363:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008625f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1875738134463360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843600.287383:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008625f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1875738134463360:12345-0@lo:400:kworker.0 Request processed in 21us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843600.287389:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00080000:0.0:1788843600.287402:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843600.287423:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1875738134463360:0@lo:400:kworker.0 00000100:00100000:0.0:1788843600.287432:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134462720:0@lo:400:kworker.0 00000100:00100000:1.0:1788843600.342939:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843600.344819:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116563712 00000100:00100000:3.0:1788843600.344841:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116563712 00000100:00100000:3.0:1788843600.344932:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 155 00000100:00100000:3.0:1788843600.344943:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+15:12188:x1875738116563712:12345-192.168.203.33@tcp:101:lctl.0 00010000:00010000:3.0:1788843600.344974:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843600.345004:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3600/0xa762dfcbd58d1a70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490aaf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.345088:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2600/0xa762dfcbd58d1a77 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.345117:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2600/0xa762dfcbd58d1a77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.345131:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2600/0xa762dfcbd58d1a77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843600.345217:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788843600.345222:0:6506:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788843600.345250:0:6506:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2600/0xa762dfcbd58d1a77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.345280:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3600/0xa762dfcbd58d1a70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490aaf expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.345304:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2600/0xa762dfcbd58d1a77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490aaf expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.345314:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd007450600) 00010000:00010000:3.0:1788843600.345336:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788843600.345341:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be2600, rc 0) 00000100:00100000:3.0:1788843600.345431:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+16:12188:x1875738116563712:12345-192.168.203.33@tcp:101:lctl.0 Request processed in 489us (2508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843600.345438:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 155 00000100:00100000:2.0:1788843600.420692:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843600.420800:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116563840 00000100:00100000:1.0:1788843600.420814:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116563840 00000100:00100000:1.0:1788843600.420904:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 156 00000100:00100000:1.0:1788843600.420917:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008627b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+16:12194:x1875738116563840:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:1.0:1788843600.420942:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843600.420967:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeac00/0xa762dfcbd58d1a7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490ab6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.421053:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea200/0xa762dfcbd58d1a85 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.421072:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea200/0xa762dfcbd58d1a85 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.421086:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea200/0xa762dfcbd58d1a85 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.421098:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d1a8c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.421106:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d1a8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.421113:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d1a8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.421250:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb200/0xa762dfcbd58d1a93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.421260:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb200/0xa762dfcbd58d1a93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.421287:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb200/0xa762dfcbd58d1a93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843600.421333:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788843600.421336:0:6508:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788843600.421360:0:6508:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb200/0xa762dfcbd58d1a93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.421374:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea200/0xa762dfcbd58d1a85 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.421381:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea200/0xa762dfcbd58d1a85 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.421390:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea200/0xa762dfcbd58d1a85 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.421397:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbea200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843600.421402:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea200/0xa762dfcbd58d1a85 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.421417:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea200/0xa762dfcbd58d1a85 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.421431:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd007450600) 00010000:00010000:1.0:1788843600.421435:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843600.421440:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea200/0xa762dfcbd58d1a85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.421447:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea200/0xa762dfcbd58d1a85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.421489:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d1a8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.421496:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d1a8c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.421503:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d1a8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.421509:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbea800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843600.421512:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d1a8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.421519:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d1a8c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.421528:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9bd007450000) 00010000:00010000:1.0:1788843600.421531:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843600.421534:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d1a8c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.421540:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d1a8c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.421570:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeac00/0xa762dfcbd58d1a7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ab6 expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.421584:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb200/0xa762dfcbd58d1a93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ab6 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.421603:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bd007450c00) 00010000:00010000:1.0:1788843600.421605:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788843600.421608:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fbeb200, rc 0) 00000100:00100000:1.0:1788843600.421697:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008627b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+17:12194:x1875738116563840:12345-192.168.203.33@tcp:101:bash.0 Request processed in 783us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843600.421706:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 156 00000100:00100000:3.0:1788843600.428412:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843600.428570:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116564096 00000100:00100000:2.0:1788843600.428584:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116564096 00000100:00100000:2.0:1788843600.428670:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 157 00000100:00100000:2.0:1788843600.428683:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+17:12194:x1875738116564096:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:2.0:1788843600.428709:0:9517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843600.428736:0:9517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1a9a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490abd expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843600.428894:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1aa1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843600.428912:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1aa1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843600.428926:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1aa1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843600.429248:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1aa8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843600.429285:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1aa8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843600.429299:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1aa8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788843600.429675:0:9517:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788843600.429898:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947800/0xa762dfcbd58d1aaf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843600.429908:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947800/0xa762dfcbd58d1aaf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843600.429917:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947800/0xa762dfcbd58d1aaf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843600.429950:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1aa1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843600.429958:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1aa1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843600.429966:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1aa1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843600.429972:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843600.429976:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1aa1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843600.429985:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1aa1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843600.430008:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bd007450c00) 00010000:00010000:2.0:1788843600.430011:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843600.430016:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1aa1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843600.430021:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1aa1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788843600.430036:0:9517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000829ecc0a reply state 0000000069cf6af2 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1aa8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843600.430046:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1aa8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843600.430052:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bd13dfda100) 00010000:00010000:2.0:1788843600.430054:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788843600.430057:0:9517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788843600.430096:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1a9a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490abd expref: 20 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843600.430111:0:9517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947800/0xa762dfcbd58d1aaf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490abd expref: 19 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843600.430118:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd13dfda600) 00010000:00010000:2.0:1788843600.430120:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843600.430123:0:9517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007947800, rc 0) 00000100:00100000:2.0:1788843600.430239:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+20:12194:x1875738116564096:12345-192.168.203.33@tcp:101:bash.0 Request processed in 1558us (1840us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1788843600.430250:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 157 00000100:00100000:2.0:1788843600.439012:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843600.439289:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116564224 00000100:00100000:1.0:1788843600.439300:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116564224 00000100:00100000:1.0:1788843600.439439:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 55 00000100:00100000:1.0:1788843600.439519:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2390:x1875738116564224:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:1.0:1788843600.439538:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843600.439558:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e456407/0xa762dfcbd58d1abd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490ac4 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788843600.439583:0:8424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843600.439601:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=378s v=(0 0) 00010000:00010000:1.0:1788843600.439606:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843600.439615:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e456407/0xa762dfcbd58d1abd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ac4 expref: 6 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.439633:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002e456407/0xa762dfcbd58d1abd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ac4 expref: 6 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.439646:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fbeac00, rc 0) 00000100:00100000:1.0:1788843600.439704:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2390:x1875738116564224:12345-192.168.203.33@tcp:101:bash.0 Request processed in 255us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843600.439726:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 55 00000100:00080000:0.0:1788843600.439754:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843600.445237:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843600.445286:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116564352 00000100:00100000:0.0:1788843600.445300:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116564352 00000100:00100000:0.0:1788843600.445389:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 56 00000100:00100000:0.0:1788843600.445401:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008622300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:12194:x1875738116564352:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:0.0:1788843600.445423:0:8423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843600.445448:0:8423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047bf716a/0xa762dfcbd58d1ac4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490acb expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.445489:0:8423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002e456407/0xa762dfcbd58d1abd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ac4 expref: 7 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.445500:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843600.445505:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843600.445512:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047bf716a/0xa762dfcbd58d1ac4 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490acb expref: 7 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.445556:0:8423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002e456407/0xa762dfcbd58d1abd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ac4 expref: 7 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.445572:0:8423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002e456407/0xa762dfcbd58d1abd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ac4 expref: 7 pid: 8424 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843600.445590:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ac8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8423:1875738134463872:192.168.203.33@tcp:104: 00000100:00100000:0.0:1788843600.445713:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007475900 going to sleep for 11 seconds 00000100:00100000:3.0:1788843600.461496:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843600.461687:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116564480 00000100:00100000:2.0:1788843600.461697:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116564480 00000100:00100000:0.0:1788843600.461698:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ac8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8423:1875738134463872:192.168.203.33@tcp:104: 00010000:00010000:2.0:1788843600.461745:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002e456407/0xa762dfcbd58d1abd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ac4 expref: 8 pid: 8424 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.461750:0:8423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000047bf716a/0xa762dfcbd58d1ac4 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490acb expref: 8 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.461771:0:8423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3d800, rc 0) 00000100:00100000:2.0:1788843600.461801:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 80 00000100:00100000:2.0:1788843600.461811:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008621180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:2390:x1875738116564480:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843600.461828:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788843600.461847:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008622300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:12194:x1875738116564352:12345-192.168.203.33@tcp:101:bash.0 Request processed in 16448us (16628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843600.461855:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 56 00010000:00010000:2.0:1788843600.462669:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002e456407/0xa762dfcbd58d1abd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ac4 expref: 7 pid: 8424 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843600.462690:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002e456407/0xa762dfcbd58d1abd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ac4 expref: 7 pid: 8424 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843600.462721:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e456407/0xa762dfcbd58d1abd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ac4 expref: 7 pid: 8424 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843600.462740:0:6491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843600.462745:0:6491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843600.462755:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000047bf716a/0xa762dfcbd58d1ac4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490acb expref: 6 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843600.462766:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047bf716a/0xa762dfcbd58d1ac4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490acb expref: 6 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843600.462839:0:6491:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000047bf716a/0xa762dfcbd58d1ac4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490acb expref: 6 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843600.463226:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6491:1875738134464000:192.168.203.33@tcp:105: 00000100:00100000:2.0:1788843600.463416:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007014000 going to sleep for 11 seconds 00000100:00100000:0.0:1788843600.469981:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843600.470132:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6491:1875738134464000:192.168.203.33@tcp:105: 00010000:00010000:2.0:1788843600.470199:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843600.470284:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008621180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2390:x1875738116564480:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 8466us (8796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843600.470298:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 80 00000100:00100000:1.0:1788843600.470429:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116564736 00000100:00100000:1.0:1788843600.470438:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116564736 00000100:00100000:1.0:1788843600.470500:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 36 00000100:00100000:1.0:1788843600.470511:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+20:12194:x1875738116564736:12345-192.168.203.33@tcp:35:bash.0 00000100:00100000:1.0:1788843600.470955:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+21:12194:x1875738116564736:12345-192.168.203.33@tcp:35:bash.0 Request processed in 444us (988us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1788843600.470963:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 36 00000100:00100000:2.0:1788843600.566902:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843600.567029:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116564992 00000100:00100000:3.0:1788843600.567043:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116564992 00000100:00100000:3.0:1788843600.567121:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 158 00000100:00100000:3.0:1788843600.567133:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+21:12204:x1875738116564992:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1788843600.567227:0:11996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843600.567255:0:11996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1acb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490ad2 expref: -99 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843600.567390:0:11996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788843600.567523:0:11996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1acb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ad2 expref: 23 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.567802:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd007450600) 00010000:00010000:3.0:1788843600.567806:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788843600.567813:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1acb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ad2 expref: 23 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.567830:0:11996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be2400, rc 0) 00000100:00100000:2.0:1788843600.567983:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+22:12204:x1875738116564992:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 851us (1095us total) trans 4294967421 rc 301/301 00000100:00100000:2.0:1788843600.567993:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 158 00000100:00100000:3.0:1788843600.575273:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843600.575388:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116565248 00000100:00100000:1.0:1788843600.575408:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116565248 00000100:00100000:1.0:1788843600.575488:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 37 00000100:00100000:1.0:1788843600.575501:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+22:12204:x1875738116565248:12345-192.168.203.33@tcp:35:lfs.0 00000100:00100000:1.0:1788843600.575813:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+23:12204:x1875738116565248:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 314us (556us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1788843600.575822:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 37 00000100:00100000:1.0:1788843600.685784:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843600.686073:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116565376 00000100:00100000:3.0:1788843600.686107:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116565376 00000100:00100000:3.0:1788843600.686234:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 159 00000100:00100000:3.0:1788843600.686249:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+23:12210:x1875738116565376:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1788843600.686284:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843600.686314:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1ad9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490ad9 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.686405:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3600/0xa762dfcbd58d1ae0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.686424:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3600/0xa762dfcbd58d1ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.686437:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3600/0xa762dfcbd58d1ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843600.686495:0:6507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788843600.686499:0:6507:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788843600.686521:0:6507:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3600/0xa762dfcbd58d1ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.686551:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1ad9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ad9 expref: 25 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.686574:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3600/0xa762dfcbd58d1ae0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ad9 expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.686584:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bd007450c00) 00010000:00010000:3.0:1788843600.686588:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788843600.686592:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be3600, rc 0) 00000100:00100000:3.0:1788843600.686678:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+24:12210:x1875738116565376:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 434us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843600.686686:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 159 00000100:00100000:3.0:1788843600.696353:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843600.698251:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116565632 00000100:00100000:0.0:1788843600.698267:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116565632 00000100:00100000:0.0:1788843600.698363:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 160 00000100:00100000:0.0:1788843600.698376:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+24:12210:x1875738116565632:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1788843600.698402:0:9517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843600.698434:0:9517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1ae7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490ae0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.698586:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1aee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.698605:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1aee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.698619:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1aee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843600.698633:0:9517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788843600.698784:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1ae7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ae0 expref: 27 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.698835:0:9517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1aee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ae0 expref: 26 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.698844:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd13dfda600) 00010000:00010000:0.0:1788843600.698848:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788843600.698852:0:9517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3cc00, rc 0) 00000100:00100000:0.0:1788843600.699109:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+26:12210:x1875738116565632:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 734us (2770us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1788843600.699117:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 160 00000100:00100000:2.0:1788843600.707487:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843600.708095:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843600.708274:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116566016 00000100:00100000:3.0:1788843600.708288:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116566016 00000100:00100000:3.0:1788843600.708377:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 12 00000100:00100000:3.0:1788843600.708404:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007765500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+26:2389:x1875738116566016:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843600.708426:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843600.708479:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1aee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ae0 expref: 26 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.708505:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd13dfda600) 00010000:00010000:3.0:1788843600.708512:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843600.708594:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007765500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+25:2389:x1875738116566016:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 206us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843600.708602:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 12 00000100:00100000:0.0:1788843600.709291:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116565888 00000100:00100000:0.0:1788843600.709300:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116565888 00000100:00100000:0.0:1788843600.709347:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 161 00000100:00100000:0.0:1788843600.709356:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+25:12210:x1875738116565888:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1788843600.709385:0:11996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843600.709407:0:11996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1afc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490ae7 expref: -99 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.709545:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1b03 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.709565:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1b03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.709579:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1b03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843600.709593:0:11996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788843600.710283:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1afc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ae7 expref: 28 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.710306:0:11996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1b03 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ae7 expref: 27 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.710316:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd13dfda600) 00010000:00010000:0.0:1788843600.710320:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788843600.710323:0:11996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3d200, rc 0) 00000100:00100000:0.0:1788843600.710397:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+27:12210:x1875738116565888:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1041us (2923us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1788843600.710405:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 161 00000100:00100000:2.0:1788843600.731818:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843600.732085:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116566144 00000100:00100000:1.0:1788843600.732109:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116566144 00000100:00100000:1.0:1788843600.732242:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 57 00000100:00100000:1.0:1788843600.732255:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2387:x1875738116566144:12345-192.168.203.33@tcp:1:lfs.0 00010000:00010000:1.0:1788843600.732315:0:8424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008940daf1/0xa762dfcbd58d1b11 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.732340:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000047bf716a/0xa762dfcbd58d1ac4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490acb expref: 6 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.732372:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843600.732376:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788843600.732381:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008940daf1/0xa762dfcbd58d1b11 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.732424:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000047bf716a/0xa762dfcbd58d1ac4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490acb expref: 6 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.732440:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000047bf716a/0xa762dfcbd58d1ac4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490acb expref: 6 pid: 8423 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843600.732458:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8424:1875738134464128:192.168.203.33@tcp:104: 00000100:00100000:1.0:1788843600.732580:0:8424:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd103709780 going to sleep for 11 seconds 00000100:00100000:2.0:1788843600.739029:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843600.739217:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116566272 00000100:00100000:0.0:1788843600.739232:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116566272 00002000:00100000:0.0:1788843600.739301:0:8428:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9bd136c45f80 x1875738116566272/t0(0) o4->f25f61b6-5faf-4e05-81a4-dea3dba05dc5@192.168.203.33@tcp:216/0 lens 504/0 e 0 to 0 dl 1788843611 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788843600.739316:0:8428:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd136c45f80 with x1875738116566272 ext(0->12) 00010000:00010000:0.0:1788843600.739329:0:8428:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000047bf716a/0xa762dfcbd58d1ac4 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490acb expref: 7 pid: 8423 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.739352:0:8428:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000047bf716a/0xa762dfcbd58d1ac4 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490acb expref: 7 pid: 8423 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788843600.739360:0:8428:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bd136c45f80 00000100:00100000:0.0:1788843600.739399:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2 00000100:00100000:0.0:1788843600.739409:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd136c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2390:x1875738116566272:12345-192.168.203.33@tcp:4:lfs.0 00000100:00100000:1.0:1788843600.741529:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8424:1875738134464128:192.168.203.33@tcp:104: 00010000:00010000:1.0:1788843600.741571:0:8424:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008940daf1/0xa762dfcbd58d1b11 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843600.745848:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd136c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+9:2390:x1875738116566272:12345-192.168.203.33@tcp:4:lfs.0 Request processed in 6420us (6813us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788843600.745884:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2 00002000:00100000:0.0:1788843600.745902:0:8428:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9bd136c45f80 x1875738116566272/t4294967306(0) o4->f25f61b6-5faf-4e05-81a4-dea3dba05dc5@192.168.203.33@tcp:216/0 lens 504/448 e 0 to 0 dl 1788843611 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788843600.745914:0:8428:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd136c45f80 with x1875738116566272 ext(0->12) 00010000:00010000:0.0:1788843600.745928:0:8428:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000047bf716a/0xa762dfcbd58d1ac4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490acb expref: 9 pid: 8423 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.745952:0:8428:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000047bf716a/0xa762dfcbd58d1ac4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490acb expref: 9 pid: 8423 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788843600.745961:0:8428:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bd136c45f80 00000100:00100000:3.0:1788843600.749588:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843600.750220:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116566400 00000100:00100000:1.0:1788843600.750235:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116566400 00010000:00010000:1.0:1788843600.750292:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000047bf716a/0xa762dfcbd58d1ac4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490acb expref: 9 pid: 8423 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843600.750351:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 81 00000100:00100000:1.0:1788843600.750365:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008621500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+9:2389:x1875738116566400:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843600.750407:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788843600.750432:0:6492:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788843600.750436:0:6492:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788843599 00002000:00010000:1.0:1788843600.750438:0:6492:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788843599 00002000:00010000:1.0:1788843600.750440:0:6492:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788843599 00002000:00010000:1.0:1788843600.750442:0:6492:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788843600.750450:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000047bf716a/0xa762dfcbd58d1ac4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490acb expref: 9 pid: 8423 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.750465:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000047bf716a/0xa762dfcbd58d1ac4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490acb expref: 9 pid: 8423 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.750494:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047bf716a/0xa762dfcbd58d1ac4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490acb expref: 9 pid: 8423 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.750516:0:6492:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788843600.750521:0:6492:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788843600.750528:0:6492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008940daf1/0xa762dfcbd58d1b11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.750540:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008940daf1/0xa762dfcbd58d1b11 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.750591:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843600.750684:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008621500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:2389:x1875738116566400:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 321us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843600.750693:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 81 00010000:00010000:3.0:1788843600.751347:0:8424:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008940daf1/0xa762dfcbd58d1b11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.751363:0:8424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008940daf1/0xa762dfcbd58d1b11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.751392:0:8424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008940daf1/0xa762dfcbd58d1b11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.751419:0:8424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008940daf1/0xa762dfcbd58d1b11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.751427:0:8424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008940daf1/0xa762dfcbd58d1b11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.751434:0:8424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbea200 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:3.0:1788843600.751440:0:8424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008940daf1/0xa762dfcbd58d1b11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.751451:0:8424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008940daf1/0xa762dfcbd58d1b11 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.751468:0:8424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008940daf1/0xa762dfcbd58d1b11 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.751477:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008940daf1/0xa762dfcbd58d1b11 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843600.751562:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2387:x1875738116566144:12345-192.168.203.33@tcp:1:lfs.0 Request processed in 19307us (19757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843600.751572:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 57 00000100:00100000:2.0:1788843600.757722:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843600.757828:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116566656 00000100:00100000:1.0:1788843600.757841:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116566656 00000100:00100000:1.0:1788843600.757912:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 38 00000100:00100000:1.0:1788843600.757924:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102881450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+27:12210:x1875738116566656:12345-192.168.203.33@tcp:35:lfs.0 00000004:00010000:1.0:1788843600.758016:0:6509:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1b03 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ae7 expref: 27 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788843600.758348:0:6509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1788843600.758385:0:6509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1788843600.758765:0:6509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1788843600.758811:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d1b18 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.758829:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947800/0xa762dfcbd58d1aaf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490abd expref: 31 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.758838:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d1b18 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.758881:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947800/0xa762dfcbd58d1aaf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490abd expref: 31 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.758901:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947800/0xa762dfcbd58d1aaf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490abd expref: 31 pid: 9517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843600.758918:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6509:1875738134464256:192.168.203.33@tcp:104: 00000100:00100000:1.0:1788843600.759037:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd118d47480 going to sleep for 11 seconds 00000100:00100000:2.0:1788843600.766760:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843600.766924:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116566784 00000100:00100000:3.0:1788843600.766934:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116566784 00000100:00100000:1.0:1788843600.766946:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6509:1875738134464256:192.168.203.33@tcp:104: 00010000:00010000:3.0:1788843600.766993:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947800/0xa762dfcbd58d1aaf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490abd expref: 32 pid: 9517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.767008:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d1b18 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843600.767052:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 82 00000100:00100000:3.0:1788843600.767063:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+32:2390:x1875738116566784:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843600.767085:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843600.767093:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947800/0xa762dfcbd58d1aaf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490abd expref: 32 pid: 9517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.767107:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947800/0xa762dfcbd58d1aaf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490abd expref: 32 pid: 9517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.767137:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947800/0xa762dfcbd58d1aaf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490abd expref: 32 pid: 9517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.767212:0:7448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd13dfda600) 00010000:00010000:3.0:1788843600.767219:0:7448:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d1b18 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.767230:0:7448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d1b18 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.767238:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d1b18 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843600.767270:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788843600.767287:0:6509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d1b18 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.767296:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d1b18 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788843600.767444:0:6509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:1.0:1788843600.767601:0:6509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1788843600.767711:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6509:1875738134464384:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788843600.768010:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843600.768063:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10652be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788843600.768219:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134464384 00000100:00100000:3.0:1788843600.768227:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134464384 00000100:00100000:3.0:1788843600.768282:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788843600.768292:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141aebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6509:x1875738134464384:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788843600.768421:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141aebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6509:x1875738134464384:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 130us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843600.768429:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788843600.768668:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6509:1875738134464384:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788843600.768860:0:6509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:0.0:1788843600.769071:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007aca300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6509:1875738134464512:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788843600.769122:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843600.769200:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd118d47180 going to sleep for 11 seconds 00000100:00100000:3.0:1788843600.769400:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134464512 00000100:00100000:3.0:1788843600.769407:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134464512 00000100:00100000:3.0:1788843600.769445:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788843600.769453:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6509:x1875738134464512:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788843600.769613:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6509:x1875738134464512:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 160us (490us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788843600.769622:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788843600.769689:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+34:2390:x1875738116566784:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 2624us (2940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843600.769700:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 82 00000100:00100000:0.0:1788843600.770227:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007aca300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6509:1875738134464512:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788843600.770309:0:6509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:0.0:1788843600.770367:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d1b18 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.770379:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d1b18 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.770388:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d1b18 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.770414:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbea800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843600.770420:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d1b18 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.770430:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d1b18 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.770451:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd13dfda600) 00010000:00010000:0.0:1788843600.770454:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788843600.770460:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d1b18 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.770467:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea800/0xa762dfcbd58d1b18 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788843600.770788:0:6509:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788843600.770871:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1788843600.770884:0:6509:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 378823742437ns, next at 379823739540ns, rc = 0 00000001:00080000:0.0:1788843600.770895:0:6509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:0.0:1788843600.770922:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd13dfda600) 00010000:00010000:0.0:1788843600.770925:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788843600.770933:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1b03 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ae7 expref: 35 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843600.772497:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102881450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+34:12210:x1875738116566656:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 14569us (14784us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1788843600.772508:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 38 00000020:00080000:0.0:1788843600.772517:0:6509:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788843600.776998:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843600.777359:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116566912 00000100:00100000:0.0:1788843600.777373:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116566912 00000100:00100000:0.0:1788843600.777440:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 162 00000100:00100000:0.0:1788843600.777453:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+34:12210:x1875738116566912:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1788843600.777484:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843600.777513:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1b1f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490aee expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.777590:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1b1f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490aee expref: 35 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.777606:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1b1f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490aee expref: 35 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843600.777629:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:0.0:1788843600.777634:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788843600.777639:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3dc00, rc 0) 00000100:00100000:0.0:1788843600.777729:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+35:12210:x1875738116566912:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 267us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843600.777737:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 162 00000100:00100000:3.0:1788843600.790770:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843600.791552:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116567168 00000100:00100000:2.0:1788843600.791570:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116567168 00000100:00100000:2.0:1788843600.791654:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 39 00000100:00100000:2.0:1788843600.791665:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+35:12210:x1875738116567168:12345-192.168.203.33@tcp:35:lfs.0 00000100:00100000:2.0:1788843600.794286:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+36:12210:x1875738116567168:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 2606us (3523us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788843600.794306:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 39 00000100:00100000:3.0:1788843600.794717:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788843600.794726:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788843600.794742:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134464640:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788843600.794743:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008620a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134464768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788843600.794817:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843600.794870:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134464640 00000100:00100000:2.0:1788843600.794878:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134464640 00000100:00100000:2.0:1788843600.794925:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788843600.795200:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134464640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788843600.795238:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788843600.797134:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788843600.805404:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843600.805502:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134464640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 354us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843600.805520:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788843600.805542:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134464768 00000100:00100000:3.0:1788843600.805555:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134464768 00000100:00100000:3.0:1788843600.805627:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788843600.805637:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008622a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134464768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788843600.805835:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788843600.805998:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008622a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134464768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 362us (11049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843600.806006:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788843600.806069:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008620a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134464768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788843600.806862:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134464640:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788843600.808527:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134464896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843600.808642:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843600.808813:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134464896 00000100:00100000:2.0:1788843600.808825:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134464896 00000100:00100000:2.0:1788843600.808883:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788843600.808892:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3630:x1875738134464896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788843600.808921:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788843600.808989:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3630:x1875738134464896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843600.809016:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788843600.809550:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134464896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843600.812079:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843600.812128:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843600.812218:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843600.812249:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843600.812593:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116567552 00000100:00100000:1.0:1788843600.812607:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116567552 00000100:00100000:1.0:1788843600.812701:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 142 00000100:00100000:1.0:1788843600.812726:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008623800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2389:x1875738116567552:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843600.812825:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008623800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2389:x1875738116567552:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 113us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843600.812833:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 142 00000100:00100000:1.0:1788843600.812866:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116567424 00000100:00100000:1.0:1788843600.812870:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116567424 00000100:00100000:1.0:1788843600.812904:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116567680 00000100:00100000:1.0:1788843600.812916:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116567680 00000100:00100000:1.0:1788843600.812957:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 330 00000100:00100000:1.0:1788843600.812964:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2389:x1875738116567424:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843600.812998:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2389:x1875738116567424:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 35us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843600.813005:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 330 00000100:00100000:1.0:1788843600.813017:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 331 00000100:00100000:1.0:1788843600.813023:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2389:x1875738116567680:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843600.813047:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2389:x1875738116567680:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 24us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843600.813052:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 331 00000100:00100000:2.0:1788843600.814102:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116567296 00000100:00100000:2.0:1788843600.814118:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116567296 00000100:00100000:2.0:1788843600.814201:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 391 00000100:00100000:2.0:1788843600.814211:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+13:2389:x1875738116567296:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843600.814283:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+13:2389:x1875738116567296:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 74us (2064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843600.814292:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 391 00000100:00080000:3.0:1788843600.814691:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788843600.814700:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788843600.916327:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843600.917294:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116567936 00000100:00100000:1.0:1788843600.917310:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116567936 00000100:00100000:1.0:1788843600.917411:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 163 00000100:00100000:1.0:1788843600.917423:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+36:12220:x1875738116567936:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1788843600.917456:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843600.917482:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeba00/0xa762dfcbd58d1b26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490af5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843600.917646:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788843600.917782:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeba00/0xa762dfcbd58d1b26 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490af5 expref: 38 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.917801:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd007450600) 00010000:00010000:1.0:1788843600.917804:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788843600.917810:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeba00/0xa762dfcbd58d1b26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490af5 expref: 38 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.917855:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fbeba00, rc 0) 00000100:00100000:1.0:1788843600.918093:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+37:12220:x1875738116567936:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 670us (1780us total) trans 4294967435 rc 301/301 00000100:00100000:1.0:1788843600.918103:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 163 00000100:00100000:3.0:1788843600.921836:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843600.923975:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116568064 00000100:00100000:1.0:1788843600.923995:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116568064 00000100:00100000:1.0:1788843600.924085:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 164 00000100:00100000:1.0:1788843600.924097:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+37:12220:x1875738116568064:12345-192.168.203.33@tcp:34:lfs.0 00010000:00010000:1.0:1788843600.924348:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeba00/0xa762dfcbd58d1b34 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.924372:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeba00/0xa762dfcbd58d1b34 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.924385:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeba00/0xa762dfcbd58d1b34 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.924397:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d1b3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.924405:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d1b3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.924411:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d1b3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.925049:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d1b42 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.925085:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d1b42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.925094:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d1b42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788843600.925199:0:6506:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d1b42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.925216:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeba00/0xa762dfcbd58d1b34 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.925225:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeba00/0xa762dfcbd58d1b34 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.925232:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeba00/0xa762dfcbd58d1b34 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.925238:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbeba00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843600.925243:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeba00/0xa762dfcbd58d1b34 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.925251:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeba00/0xa762dfcbd58d1b34 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.925267:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bd007450c00) 00010000:00010000:1.0:1788843600.925271:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843600.925277:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeba00/0xa762dfcbd58d1b34 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.925283:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeba00/0xa762dfcbd58d1b34 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.925309:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d1b3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.925314:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d1b3b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.925320:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d1b3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.925325:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbeae00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843600.925328:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d1b3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.925334:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d1b3b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.925343:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bd13dfda100) 00010000:00010000:1.0:1788843600.925346:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843600.925349:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d1b3b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.925354:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeae00/0xa762dfcbd58d1b3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.925365:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d1b42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.925370:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d1b42 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.925375:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d1b42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.925386:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbeb800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843600.925389:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d1b42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.925395:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d1b42 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.925405:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:1.0:1788843600.925407:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843600.925410:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d1b42 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843600.925415:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d1b42 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843600.925754:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+37:12220:x1875738116568064:12345-192.168.203.33@tcp:34:lfs.0 Request processed in 1651us (4306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843600.925776:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 164 00000100:00100000:2.0:1788843600.940050:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843600.940198:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116568320 00000100:00100000:0.0:1788843600.940212:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116568320 00000100:00100000:0.0:1788843600.940294:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 40 00000100:00100000:0.0:1788843600.940307:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+37:12220:x1875738116568320:12345-192.168.203.33@tcp:35:lfs.0 00000100:00100000:0.0:1788843600.942398:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+38:12220:x1875738116568320:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 1774us (2044us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1788843600.942450:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 40 00000100:00100000:2.0:1788843601.036725:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843601.036856:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116568576 00000100:00100000:0.0:1788843601.036870:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116568576 00000100:00100000:0.0:1788843601.036955:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 165 00000100:00100000:0.0:1788843601.036967:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+38:12223:x1875738116568576:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1788843601.036998:0:9517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843601.037025:0:9517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1b49 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490afc expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.037117:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1b50 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.037135:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1b50 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.037225:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1b50 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.037237:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1b57 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.037245:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1b57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.037252:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1b57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.037389:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1b5e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.037420:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1b5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.037428:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1b5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843601.037439:0:9517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788843601.037715:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1b50 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.037724:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1b50 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.037731:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1b50 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.037738:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3ca00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843601.037743:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1b50 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.037751:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1b50 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.037767:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bd007450c00) 00010000:00010000:0.0:1788843601.037770:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843601.037775:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1b50 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.037781:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1b50 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.037798:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1b57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.037811:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1b57 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.037817:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1b57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.037822:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3da00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843601.037825:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1b57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.037831:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1b57 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.037840:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bd13dfda100) 00010000:00010000:0.0:1788843601.037842:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843601.037845:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1b57 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.037851:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1b57 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.037897:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1b49 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490afc expref: 41 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.037912:0:9517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1b5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490afc expref: 40 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.037919:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:0.0:1788843601.037921:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788843601.037931:0:9517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3d200, rc 0) 00000100:00100000:0.0:1788843601.038022:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+40:12223:x1875738116568576:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1056us (1312us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1788843601.038030:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 165 00000100:00100000:3.0:1788843601.044385:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843601.045711:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116568704 00000100:00100000:1.0:1788843601.045732:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116568704 00000100:00100000:1.0:1788843601.045825:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 166 00000100:00100000:1.0:1788843601.045838:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+40:12223:x1875738116568704:12345-192.168.203.33@tcp:54:lfs.0 00010000:00010000:1.0:1788843601.045939:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d1b6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843601.045961:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d1b6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843601.045976:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d1b6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843601.046052:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d1b6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843601.046061:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d1b6c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843601.046075:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d1b6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843601.046082:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbeb800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843601.046088:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d1b6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843601.046097:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d1b6c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843601.046113:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:1.0:1788843601.046117:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788843601.046122:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d1b6c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843601.046129:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d1b6c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843601.046276:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+40:12223:x1875738116568704:12345-192.168.203.33@tcp:54:lfs.0 Request processed in 440us (1905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843601.046285:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 166 00010000:00010000:1.0:1788843601.050657:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843601.052498:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843601.052600:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116568960 00000100:00100000:3.0:1788843601.052614:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116568960 00000100:00100000:3.0:1788843601.052688:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 41 00000100:00100000:3.0:1788843601.052710:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+40:12223:x1875738116568960:12345-192.168.203.33@tcp:35:lfs.0 00000100:00100000:3.0:1788843601.053036:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+41:12223:x1875738116568960:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 328us (552us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788843601.053046:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 41 00000100:00100000:2.0:1788843601.358099:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843601.358299:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116569216 00000100:00100000:1.0:1788843601.358312:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116569216 00000100:00100000:1.0:1788843601.358420:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 167 00000100:00100000:1.0:1788843601.358434:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+41:12255:x1875738116569216:12345-192.168.203.33@tcp:101:cat.0 00010000:00010000:1.0:1788843601.358474:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843601.358503:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d1b73 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490b03 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843601.358641:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeba00/0xa762dfcbd58d1b7a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843601.358657:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeba00/0xa762dfcbd58d1b7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843601.358670:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeba00/0xa762dfcbd58d1b7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843601.358683:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788843601.358825:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb800/0xa762dfcbd58d1b73 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b03 expref: 44 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843601.358847:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeba00/0xa762dfcbd58d1b7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b03 expref: 43 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843601.358863:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:1.0:1788843601.358867:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788843601.358871:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fbeba00, rc 0) 00000100:00100000:1.0:1788843601.359224:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+43:12255:x1875738116569216:12345-192.168.203.33@tcp:101:cat.0 Request processed in 791us (1139us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1788843601.359233:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 167 00000100:00100000:1.0:1788843601.367342:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843601.367411:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843601.367607:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116569472 00000100:00100000:3.0:1788843601.367620:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116569472 00000100:00100000:3.0:1788843601.367699:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 42 00000100:00100000:3.0:1788843601.367710:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+43:12255:x1875738116569472:12345-192.168.203.33@tcp:35:cat.0 00000100:00100000:3.0:1788843601.368012:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+44:12255:x1875738116569472:12345-192.168.203.33@tcp:35:cat.0 Request processed in 302us (681us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1788843601.368021:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 42 00000100:00100000:0.0:1788843601.368695:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116569600 00000100:00100000:0.0:1788843601.368705:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116569600 00000100:00100000:0.0:1788843601.368769:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 13 00000100:00100000:0.0:1788843601.368778:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008499880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+44:2389:x1875738116569600:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843601.368795:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843601.368825:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeba00/0xa762dfcbd58d1b7a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b03 expref: 44 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.369003:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:0.0:1788843601.369011:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843601.369049:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008499880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+43:2389:x1875738116569600:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 273us (1637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843601.369056:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 13 00000100:00100000:2.0:1788843601.439293:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843601.439507:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116569856 00000100:00100000:0.0:1788843601.439520:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116569856 00000100:00100000:0.0:1788843601.439605:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 168 00000100:00100000:0.0:1788843601.439618:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+43:12261:x1875738116569856:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1788843601.439661:0:9517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843601.439665:0:9517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788843601.439702:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3600/0xa762dfcbd58d1ae0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ad9 expref: 43 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.439728:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bd007450c00) 00010000:00010000:0.0:1788843601.439752:0:9517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788843601.439771:0:9517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1b88 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490b0a expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.439921:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1b8f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.439937:0:9517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1b5e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490afc expref: 43 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.439947:0:9517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1b8f lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.439989:0:9517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1b5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490afc expref: 43 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.440007:0:9517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1b5e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490afc expref: 43 pid: 9517 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843601.440023:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fa2f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9517:1875738134465024:192.168.203.33@tcp:104: 00000100:00100000:0.0:1788843601.440210:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0074750c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843601.445401:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fa2f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9517:1875738134465024:192.168.203.33@tcp:104: 00010000:00010000:1.0:1788843601.445442:0:9517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1b8f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843601.448564:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843601.448703:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116569984 00000100:00100000:0.0:1788843601.448718:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116569984 00010000:00010000:0.0:1788843601.448773:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1b5e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490afc expref: 44 pid: 9517 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843601.448826:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 83 00000100:00100000:0.0:1788843601.448840:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd133328c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+44:2390:x1875738116569984:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843601.448860:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843601.448886:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1b5e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490afc expref: 44 pid: 9517 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.448902:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1b5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490afc expref: 44 pid: 9517 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.449017:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1b5e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490afc expref: 44 pid: 9517 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.449042:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:0.0:1788843601.449049:0:6493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1b8f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.449061:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1b8f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.449070:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1b8f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.449114:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843601.449261:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd133328c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+43:2390:x1875738116569984:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 422us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843601.449270:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 83 00010000:00010000:1.0:1788843601.449500:0:9517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1b8f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843601.449510:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1b8f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843601.449533:0:9517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788843601.449707:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1b88 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b0a expref: 44 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843601.449727:0:9517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1b8f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b0a expref: 43 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843601.449736:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:1.0:1788843601.449739:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788843601.449742:0:9517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3da00, rc 0) 00000100:00100000:1.0:1788843601.449790:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+43:12261:x1875738116569856:12345-192.168.203.33@tcp:101:dd.0 Request processed in 10175us (10511us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1788843601.449798:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 168 00000100:00100000:2.0:1788843601.454123:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843601.454341:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116570112 00000100:00100000:0.0:1788843601.454355:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116570112 00000100:00100000:0.0:1788843601.454429:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 169 00000100:00100000:0.0:1788843601.454441:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+43:12261:x1875738116570112:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1788843601.454484:0:11996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843601.454513:0:11996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1b9d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490b11 expref: -99 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.454581:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1ba4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.454598:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.454610:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.454749:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1b9d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b11 expref: 45 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.454770:0:11996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1ba4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b11 expref: 44 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.454779:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:0.0:1788843601.454782:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788843601.454786:0:11996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3ce00, rc 0) 00000100:00100000:0.0:1788843601.454871:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+44:12261:x1875738116570112:12345-192.168.203.33@tcp:101:dd.0 Request processed in 432us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843601.454879:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 169 00000100:00100000:0.0:1788843601.465539:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843601.466603:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116570368 00000100:00100000:2.0:1788843601.466619:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116570368 00000100:00100000:2.0:1788843601.466706:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 170 00000100:00100000:2.0:1788843601.466719:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fa2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+44:12261:x1875738116570368:12345-192.168.203.33@tcp:36:dd.0 00010000:00010000:2.0:1788843601.467017:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1bab lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843601.467038:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1bab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843601.467050:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1bab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788843601.467206:0:6506:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:2.0:1788843601.467237:0:6506:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005391f61d reply state 0000000061135787 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1bab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843601.467252:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1bab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843601.467261:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:2.0:1788843601.467265:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788843601.467269:0:6506:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788843601.467391:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fa2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+47:12261:x1875738116570368:12345-192.168.203.33@tcp:36:dd.0 Request processed in 673us (1866us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1788843601.467400:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 170 00000020:00080000:2.0:1788843601.467405:0:6506:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788843601.764508:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843601.764700:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116570496 00000100:00100000:0.0:1788843601.764715:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116570496 00000100:00100000:0.0:1788843601.764803:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 171 00000100:00100000:0.0:1788843601.764816:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008499f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+47:12275:x1875738116570496:12345-192.168.203.33@tcp:101:stat.0 00010000:00010000:0.0:1788843601.764856:0:9517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843601.764904:0:9517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1bb2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490b18 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.764991:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1bb9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.765010:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1bb9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.765024:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1bb9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.765036:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1bc0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.765043:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.765048:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.765203:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1bc7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.765215:0:9517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1b8f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b0a expref: 48 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.765224:0:9517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1bc7 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.765271:0:9517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1b8f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b0a expref: 48 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.765301:0:9517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1b8f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b0a expref: 48 pid: 9517 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843601.765325:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f956d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9517:1875738134465152:192.168.203.33@tcp:104: 00000100:00100000:0.0:1788843601.765468:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007475cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843601.772539:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843601.773122:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f956d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9517:1875738134465152:192.168.203.33@tcp:104: 00010000:00010000:1.0:1788843601.773215:0:9517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1bc7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843601.773733:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116570752 00000100:00100000:3.0:1788843601.773746:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116570752 00000100:00100000:3.0:1788843601.773838:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 43 00000100:00100000:3.0:1788843601.773850:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+49:6162:x1875738116570752:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788843601.774356:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+50:6162:x1875738116570752:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 505us (1831us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1788843601.774366:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 43 00000100:00100000:2.0:1788843601.789988:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843601.790137:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116570880 00000100:00100000:1.0:1788843601.790178:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116570880 00010000:00010000:1.0:1788843601.790243:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1b8f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b0a expref: 50 pid: 9517 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843601.790283:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 84 00000100:00100000:1.0:1788843601.790293:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+50:2390:x1875738116570880:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843601.790312:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843601.790319:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1b8f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b0a expref: 50 pid: 9517 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843601.790335:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1b8f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b0a expref: 50 pid: 9517 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843601.790365:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1b8f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b0a expref: 50 pid: 9517 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843601.790396:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:1.0:1788843601.790402:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1bc7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843601.790415:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843601.790424:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1bc7 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843601.790623:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843601.790716:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+49:2390:x1875738116570880:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 423us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843601.790725:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 84 00010000:00010000:2.0:1788843601.792203:0:9517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843601.792225:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843601.792300:0:9517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788843601.792305:0:9517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788843601.792333:0:9517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843601.792353:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843601.792365:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1bb9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843601.792399:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1bb9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843601.792408:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1bb9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843601.792415:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3cc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843601.792420:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1bb9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843601.792428:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1bb9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843601.792650:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bd007450c00) 00010000:00010000:2.0:1788843601.792654:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843601.792659:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1bb9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843601.792667:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1bb9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843601.792684:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843601.792690:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1bc0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843601.792697:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1bc0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843601.792703:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843601.792712:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1bc0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843601.792719:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1bc0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843601.792727:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bd13dfda100) 00010000:00010000:2.0:1788843601.792730:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843601.792733:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1bc0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843601.792740:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1bc0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843601.792785:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1bb2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b18 expref: 49 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843601.793004:0:9517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1bc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b18 expref: 48 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843601.793015:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:2.0:1788843601.793018:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843601.793021:0:9517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3c800, rc 0) 00000100:00100000:2.0:1788843601.793121:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008499f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+48:12275:x1875738116570496:12345-192.168.203.33@tcp:101:stat.0 Request processed in 28306us (28641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843601.793131:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 171 00000100:00100000:0.0:1788843601.818619:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008498000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134465280:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788843601.818729:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843601.818791:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134465280 00000100:00100000:0.0:1788843601.818800:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134465280 00000100:00100000:0.0:1788843601.818868:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788843601.818879:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134465280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788843601.818922:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788843601.818969:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134465280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843601.818977:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788843601.819040:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008498000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134465280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788843601.820577:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788843601.820601:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0085edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134465408:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788843601.820680:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843601.820814:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134465408 00000100:00100000:0.0:1788843601.820823:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134465408 00000100:00100000:0.0:1788843601.820916:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788843601.820926:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008499c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134465408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788843601.820962:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788843601.821025:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008499c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134465408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843601.821065:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788843601.821165:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0085edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134465408:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788843601.849809:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843601.850487:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116571136 00000100:00100000:3.0:1788843601.850504:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116571136 00000100:00100000:0.0:1788843601.850737:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 172 00000100:00100000:0.0:1788843601.850753:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+48:12281:x1875738116571136:12345-192.168.203.33@tcp:36:truncate.0 00010000:00010000:0.0:1788843601.850853:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843601.850895:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1bc7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b18 expref: 48 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.850921:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:0.0:1788843601.850928:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788843601.851456:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1bce lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.851476:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1bce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.851488:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1bce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788843601.851546:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:0.0:1788843601.851576:0:6507:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e434b37a reply state 0000000032c0a0ce transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1bce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.851590:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1bce lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843601.851597:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:0.0:1788843601.851600:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788843601.851603:0:6507:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788843601.851741:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+50:12281:x1875738116571136:12345-192.168.203.33@tcp:36:truncate.0 Request processed in 991us (1946us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1788843601.851772:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 172 00000020:00080000:0.0:1788843601.851779:0:6507:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788843602.015315:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843602.015590:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116571264 00000100:00100000:0.0:1788843602.015610:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116571264 00000100:00100000:0.0:1788843602.015708:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 173 00000100:00100000:0.0:1788843602.015731:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+50:12295:x1875738116571264:12345-192.168.203.33@tcp:101:stat.0 00010000:00010000:0.0:1788843602.015762:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843602.015791:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1bd5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490b1f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.015905:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1bdc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.015923:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1bdc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.015938:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1bdc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.015952:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1be3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.015958:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1be3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.015964:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1be3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.016057:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1bea lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.016078:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1bea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.016085:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1bea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843602.016400:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788843602.016406:0:6508:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788843602.016435:0:6508:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1bea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.016450:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1bea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.016459:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1bdc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.016467:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1bdc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.016474:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1bdc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.016480:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3ca00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843602.016485:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1bdc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.016494:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1bdc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.016509:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bd007450c00) 00010000:00010000:0.0:1788843602.016519:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843602.016526:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1bdc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.016532:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1bdc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.016550:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1be3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.016556:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1be3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.016562:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1be3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.016566:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843602.016569:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1be3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.016575:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1be3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.016583:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bd13dfda100) 00010000:00010000:0.0:1788843602.016586:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843602.016588:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1be3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.016595:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1be3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.016633:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1bd5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b1f expref: 52 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.016662:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1bea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b1f expref: 51 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.016669:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:0.0:1788843602.016671:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788843602.016674:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3d200, rc 0) 00000100:00080000:3.0:1788843602.016860:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843602.017037:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+51:12295:x1875738116571264:12345-192.168.203.33@tcp:101:stat.0 Request processed in 1309us (1732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843602.017046:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 173 00010000:00010000:0.0:1788843602.074671:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843602.107297:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843602.107407:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116571520 00000100:00100000:3.0:1788843602.107422:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116571520 00000100:00100000:3.0:1788843602.107517:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 174 00000100:00100000:3.0:1788843602.107531:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008498000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+51:12305:x1875738116571520:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1788843602.107561:0:9517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843602.107589:0:9517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1bf1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490b26 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843602.107728:0:9517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788843602.107875:0:9517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1bf1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b26 expref: 53 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.107893:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd007450600) 00010000:00010000:3.0:1788843602.107897:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788843602.107903:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1bf1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b26 expref: 53 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.107920:0:9517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be3000, rc 0) 00000100:00100000:3.0:1788843602.108003:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008498000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+52:12305:x1875738116571520:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 474us (722us total) trans 4294967447 rc 301/301 00000100:00100000:3.0:1788843602.108012:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 174 00000100:00100000:2.0:1788843602.112588:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843602.112699:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116571776 00000100:00100000:3.0:1788843602.112714:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116571776 00000100:00100000:3.0:1788843602.112798:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 44 00000100:00100000:3.0:1788843602.112812:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e1e6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+52:12305:x1875738116571776:12345-192.168.203.33@tcp:35:lfs.0 00000100:00100000:3.0:1788843602.113382:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e1e6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+53:12305:x1875738116571776:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 569us (805us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1788843602.113392:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 44 00000100:00100000:1.0:1788843602.175731:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843602.175857:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116572032 00000100:00100000:0.0:1788843602.175870:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116572032 00000100:00100000:0.0:1788843602.175959:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 175 00000100:00100000:0.0:1788843602.175972:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008499880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+53:12311:x1875738116572032:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:0.0:1788843602.176004:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843602.176034:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1bff lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490b2d expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.176230:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1c06 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.176249:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1bea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b1f expref: 54 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.176260:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1c06 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.176335:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1bea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b1f expref: 54 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.176351:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1bea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b1f expref: 54 pid: 6508 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843602.176368:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0085edf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6507:1875738134465536:192.168.203.33@tcp:104: 00000100:00100000:0.0:1788843602.176511:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd104bedf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788843602.180326:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843602.180432:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116572160 00000100:00100000:3.0:1788843602.180446:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116572160 00010000:00010000:3.0:1788843602.180517:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1bea lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b1f expref: 55 pid: 6508 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843602.180563:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 85 00000100:00100000:3.0:1788843602.180576:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+55:2390:x1875738116572160:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843602.180597:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843602.180604:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1bea lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b1f expref: 55 pid: 6508 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.180619:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1bea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b1f expref: 55 pid: 6508 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.180652:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:3.0:1788843602.180658:0:6493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1c06 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.180669:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1c06 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.180678:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1c06 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.180702:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843602.180798:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+55:2390:x1875738116572160:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 224us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843602.180806:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 85 00010000:00010000:0.0:1788843602.181530:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1bea lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b1f expref: 54 pid: 6508 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843602.181560:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0085edf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6507:1875738134465536:192.168.203.33@tcp:104: 00010000:00010000:0.0:1788843602.181590:0:6507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1c06 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.181600:0:6507:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1c06 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.181605:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1c06 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843602.181631:0:6507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788843602.181818:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1bff lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b2d expref: 55 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.182128:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1c06 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b2d expref: 54 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.182222:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:0.0:1788843602.182226:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788843602.182230:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3d000, rc 0) 00000100:00100000:0.0:1788843602.182443:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008499880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+54:12311:x1875738116572032:12345-192.168.203.33@tcp:101:bash.0 Request processed in 6472us (6726us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1788843602.182571:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 175 00000100:00100000:2.0:1788843602.186723:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843602.186987:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116572416 00000100:00100000:1.0:1788843602.187001:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116572416 00000100:00100000:1.0:1788843602.187078:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 176 00000100:00100000:1.0:1788843602.187091:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+54:12311:x1875738116572416:12345-192.168.203.33@tcp:36:bash.0 00010000:00010000:1.0:1788843602.187450:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1c14 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.187472:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1c14 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.187485:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1c14 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788843602.187542:0:11996:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:1.0:1788843602.187566:0:11996:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c9135555 reply state 0000000034ddc25c transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1c14 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.187582:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1c14 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.187607:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:1.0:1788843602.187610:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788843602.187615:0:11996:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788843602.187730:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+57:12311:x1875738116572416:12345-192.168.203.33@tcp:36:bash.0 Request processed in 641us (1019us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1788843602.187737:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 176 00000020:00080000:1.0:1788843602.187744:0:11996:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788843602.192932:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843602.193105:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116572544 00000100:00100000:1.0:1788843602.193120:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116572544 00000100:00100000:1.0:1788843602.193241:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 177 00000100:00100000:1.0:1788843602.193253:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+57:12311:x1875738116572544:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:1.0:1788843602.193286:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843602.193315:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebe00/0xa762dfcbd58d1c1b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490b34 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.193439:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d1c22 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.193567:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1c06 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b2d expref: 58 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.193578:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d1c22 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.193625:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1c06 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b2d expref: 58 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.193641:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1c06 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b2d expref: 58 pid: 6507 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843602.193676:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f956d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6506:1875738134465664:192.168.203.33@tcp:104: 00000100:00100000:1.0:1788843602.193788:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10652b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843602.197104:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843602.197494:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116572672 00000100:00100000:3.0:1788843602.197507:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116572672 00010000:00010000:3.0:1788843602.197561:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1c06 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b2d expref: 59 pid: 6507 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843602.197615:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 86 00000100:00100000:3.0:1788843602.197627:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+59:2389:x1875738116572672:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843602.197656:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843602.197664:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1c06 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b2d expref: 59 pid: 6507 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.197680:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1c06 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b2d expref: 59 pid: 6507 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.197710:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:3.0:1788843602.197717:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d1c22 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.197729:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d1c22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.197738:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d1c22 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.197761:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843602.197841:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+59:2389:x1875738116572672:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 208us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843602.197862:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 86 00010000:00010000:1.0:1788843602.199093:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1c06 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b2d expref: 58 pid: 6507 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843602.199122:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f956d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6506:1875738134465664:192.168.203.33@tcp:104: 00010000:00010000:1.0:1788843602.199208:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d1c22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.199220:0:6506:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d1c22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.199227:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d1c22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843602.199302:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788843602.199307:0:6506:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788843602.199334:0:6506:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d1c22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.199376:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebe00/0xa762dfcbd58d1c1b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b34 expref: 58 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.199393:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d1c22 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b34 expref: 57 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.199401:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:1.0:1788843602.199423:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788843602.199428:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fbea400, rc 0) 00000100:00100000:1.0:1788843602.199510:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+57:12311:x1875738116572544:12345-192.168.203.33@tcp:101:bash.0 Request processed in 6258us (6592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843602.199519:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 177 00000100:00100000:2.0:1788843602.202809:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843602.203126:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116572928 00000100:00100000:1.0:1788843602.203163:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116572928 00000100:00100000:1.0:1788843602.203236:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 45 00000100:00100000:1.0:1788843602.203247:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1203d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+57:12311:x1875738116572928:12345-192.168.203.33@tcp:35:bash.0 00000100:00100000:1.0:1788843602.203558:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1203d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+58:12311:x1875738116572928:12345-192.168.203.33@tcp:35:bash.0 Request processed in 311us (763us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1788843602.203566:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 45 00000100:00100000:2.0:1788843602.296296:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843602.296438:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116573184 00000100:00100000:0.0:1788843602.296451:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116573184 00000100:00100000:0.0:1788843602.296534:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 178 00000100:00100000:0.0:1788843602.296546:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+58:12321:x1875738116573184:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1788843602.296580:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843602.296608:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1c29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490b3b expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843602.296754:0:6507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788843602.297242:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1c29 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b3b expref: 60 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.297264:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd007450600) 00010000:00010000:0.0:1788843602.297267:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788843602.297273:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1c29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b3b expref: 60 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.297292:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3c800, rc 0) 00000100:00100000:0.0:1788843602.297425:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+59:12321:x1875738116573184:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 881us (1144us total) trans 4294967453 rc 301/301 00000100:00100000:0.0:1788843602.297468:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 178 00000100:00100000:2.0:1788843602.299934:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843602.300047:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116573312 00000100:00100000:3.0:1788843602.300061:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116573312 00000100:00100000:3.0:1788843602.300353:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 179 00000100:00100000:3.0:1788843602.300365:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+59:12321:x1875738116573312:12345-192.168.203.33@tcp:34:lfs.0 00010000:00010000:3.0:1788843602.300584:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1c37 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.300611:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1c37 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.300628:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1c37 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.300705:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1c3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.300716:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1c3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.300724:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1c3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.300829:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1c45 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.300839:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1c45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.300847:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1c45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788843602.300932:0:9517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1c45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.301336:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1c37 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.301343:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1c37 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.301350:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1c37 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.301355:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be3000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1788843602.301360:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1c37 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.301367:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1c37 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.301382:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bd007450c00) 00010000:00010000:3.0:1788843602.301386:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843602.301391:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1c37 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.301397:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1c37 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.301412:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1c3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.301418:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1c3e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.301433:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1c3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.301438:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be2400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1788843602.301440:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1c3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.301446:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1c3e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.301726:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bd13dfda100) 00010000:00010000:3.0:1788843602.301730:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843602.301734:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1c3e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.301741:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1c3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.301755:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1c45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.301762:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1c45 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.301769:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1c45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.301774:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be3c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1788843602.301778:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1c45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.301795:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1c45 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.301804:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:3.0:1788843602.301807:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843602.301810:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1c45 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843602.301817:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1c45 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843602.301927:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+59:12321:x1875738116573312:12345-192.168.203.33@tcp:34:lfs.0 Request processed in 1558us (2002us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843602.301937:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 179 00000100:00100000:3.0:1788843602.304628:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843602.304855:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116573568 00000100:00100000:1.0:1788843602.304870:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116573568 00000100:00100000:1.0:1788843602.304942:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 46 00000100:00100000:1.0:1788843602.304955:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+59:12321:x1875738116573568:12345-192.168.203.33@tcp:35:lfs.0 00000100:00100000:1.0:1788843602.305328:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+60:12321:x1875738116573568:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 374us (713us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788843602.305338:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 46 00000100:00100000:2.0:1788843602.346898:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843602.347199:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116573824 00000100:00100000:1.0:1788843602.347216:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116573824 00000100:00100000:1.0:1788843602.347299:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 180 00000100:00100000:1.0:1788843602.347312:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+60:12324:x1875738116573824:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1788843602.347346:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843602.347375:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebe00/0xa762dfcbd58d1c4c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490b42 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.347511:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb000/0xa762dfcbd58d1c53 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.347529:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb000/0xa762dfcbd58d1c53 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.347541:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb000/0xa762dfcbd58d1c53 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.347554:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d1c5a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.347562:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d1c5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.347568:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d1c5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.347717:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb400/0xa762dfcbd58d1c61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.347727:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb400/0xa762dfcbd58d1c61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.347734:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb400/0xa762dfcbd58d1c61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843602.347746:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788843602.347856:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb000/0xa762dfcbd58d1c53 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.347864:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb000/0xa762dfcbd58d1c53 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.347879:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb000/0xa762dfcbd58d1c53 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.347887:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbeb000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843602.347892:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb000/0xa762dfcbd58d1c53 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.347901:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb000/0xa762dfcbd58d1c53 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.347921:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bd007450c00) 00010000:00010000:1.0:1788843602.347926:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843602.347932:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb000/0xa762dfcbd58d1c53 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.347938:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb000/0xa762dfcbd58d1c53 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.347955:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d1c5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.347961:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d1c5a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.347966:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d1c5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.347971:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbebc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843602.347974:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d1c5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.347991:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d1c5a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.347999:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bd13dfda100) 00010000:00010000:1.0:1788843602.348001:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843602.348004:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d1c5a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.348010:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d1c5a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.348061:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebe00/0xa762dfcbd58d1c4c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b42 expref: 63 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.348077:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb400/0xa762dfcbd58d1c61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b42 expref: 62 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.348084:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:1.0:1788843602.348086:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788843602.348089:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fbeb400, rc 0) 00000100:00100000:1.0:1788843602.348635:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+62:12324:x1875738116573824:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1320us (1748us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1788843602.348702:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 180 00000100:00100000:2.0:1788843602.351798:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843602.352131:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116573952 00000100:00100000:0.0:1788843602.352186:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116573952 00000100:00100000:0.0:1788843602.352274:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 181 00000100:00100000:0.0:1788843602.352287:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141a75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+62:12324:x1875738116573952:12345-192.168.203.33@tcp:54:lfs.0 00010000:00010000:0.0:1788843602.352391:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1c6f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.352414:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1c6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.352427:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1c6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.352489:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1c6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.352498:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1c6f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.352506:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1c6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.352513:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3c800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843602.352518:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1c6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.352528:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1c6f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.352544:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:0.0:1788843602.352568:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788843602.352574:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1c6f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.352582:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1c6f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843602.352963:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141a75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+62:12324:x1875738116573952:12345-192.168.203.33@tcp:54:lfs.0 Request processed in 674us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843602.352973:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 181 00000100:00100000:3.0:1788843602.355767:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843602.356301:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116574080 00000100:00100000:0.0:1788843602.356315:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116574080 00000100:00100000:0.0:1788843602.356407:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 14 00000100:00100000:0.0:1788843602.356420:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008621180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+62:2388:x1875738116574080:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843602.356442:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843602.356956:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb400/0xa762dfcbd58d1c61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b42 expref: 62 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.356985:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:0.0:1788843602.356991:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843602.357015:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843602.357544:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116574336 00000100:00100000:1.0:1788843602.357554:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116574336 00000100:00100000:1.0:1788843602.357606:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 47 00000100:00100000:1.0:1788843602.357616:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008621500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+62:12324:x1875738116574336:12345-192.168.203.33@tcp:35:lfs.0 00000100:00100000:0.0:1788843602.357764:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008621180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+62:2388:x1875738116574080:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 1347us (2013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843602.357773:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 14 00000100:00100000:1.0:1788843602.358918:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008621500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+62:12324:x1875738116574336:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 1294us (1893us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1788843602.358931:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 47 00000100:00100000:3.0:1788843602.514803:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843602.515075:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116574592 00000100:00100000:1.0:1788843602.515088:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116574592 00000100:00100000:1.0:1788843602.515219:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 182 00000100:00100000:1.0:1788843602.515232:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+62:12342:x1875738116574592:12345-192.168.203.33@tcp:101:cat.0 00010000:00010000:1.0:1788843602.515265:0:9517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843602.515296:0:9517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebe00/0xa762dfcbd58d1c76 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490b49 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.515431:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d1c7d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.515449:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d1c7d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.515473:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d1c7d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843602.515486:0:9517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788843602.515618:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebe00/0xa762dfcbd58d1c76 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b49 expref: 65 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.515642:0:9517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d1c7d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b49 expref: 64 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.515653:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:1.0:1788843602.515673:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788843602.515678:0:9517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fbebc00, rc 0) 00000100:00100000:1.0:1788843602.515870:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+64:12342:x1875738116574592:12345-192.168.203.33@tcp:101:cat.0 Request processed in 640us (1079us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1788843602.515880:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 182 00000100:00100000:3.0:1788843602.557894:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843602.557993:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116574720 00000100:00100000:1.0:1788843602.558008:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116574720 00000100:00100000:1.0:1788843602.558100:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 183 00000100:00100000:1.0:1788843602.558115:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+64:12343:x1875738116574720:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1788843602.558197:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843602.558228:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebe00/0xa762dfcbd58d1c8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490b50 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.558378:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1c92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.558399:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1c92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.558412:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1c92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843602.558507:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788843602.558512:0:6506:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788843602.558539:0:6506:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1c92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.558576:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebe00/0xa762dfcbd58d1c8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b50 expref: 66 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.558602:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1c92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b50 expref: 65 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.558612:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bd007450c00) 00010000:00010000:0.0:1788843602.558616:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788843602.558620:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3c800, rc 0) 00000100:00100000:0.0:1788843602.558707:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+65:12343:x1875738116574720:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 596us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843602.558725:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 183 00000100:00100000:2.0:1788843602.568093:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843602.568391:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116575104 00000100:00100000:0.0:1788843602.568405:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116575104 00000100:00100000:0.0:1788843602.568581:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 48 00000100:00100000:0.0:1788843602.568595:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141a77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+65:12343:x1875738116575104:12345-192.168.203.33@tcp:35:lfs.0 00000100:00100000:0.0:1788843602.570779:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141a77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+66:12343:x1875738116575104:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 2173us (2687us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1788843602.570795:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 48 00000100:00100000:3.0:1788843602.573773:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843602.573911:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116575232 00000100:00100000:1.0:1788843602.573924:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116575232 00000100:00100000:1.0:1788843602.574031:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 15 00000100:00100000:1.0:1788843602.574044:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+66:12343:x1875738116575232:12345-192.168.203.33@tcp:103:lfs.0 00010000:00010000:1.0:1788843602.574064:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788843602.574095:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d1c22 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b34 expref: 66 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.574122:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d1c7d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b49 expref: 65 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.574136:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1b1f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490aee expref: 64 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.574247:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:1.0:1788843602.574252:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843602.574328:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+63:12343:x1875738116575232:12345-192.168.203.33@tcp:103:lfs.0 Request processed in 287us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843602.574337:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 15 00000100:00100000:3.0:1788843602.578984:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843602.579435:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116575360 00000100:00100000:0.0:1788843602.579451:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116575360 00000100:00100000:0.0:1788843602.579554:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 184 00000100:00100000:0.0:1788843602.579568:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+63:12343:x1875738116575360:12345-192.168.203.33@tcp:58:lfs.0 00010000:00010000:0.0:1788843602.579748:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1c99 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.579776:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1c99 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.579801:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1c99 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788843602.579975:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1788843602.580116:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+63:12343:x1875738116575360:12345-192.168.203.33@tcp:58:lfs.0 Request processed in 549us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843602.580125:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 184 00000100:00100000:3.0:1788843602.615566:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843602.616033:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116575488 00000100:00100000:0.0:1788843602.616048:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116575488 00000100:00100000:0.0:1788843602.616136:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 185 00000100:00100000:0.0:1788843602.616217:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+63:12345:x1875738116575488:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1788843602.616245:0:11996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843602.616273:0:11996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1ca0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490b57 expref: -99 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.616357:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1ca7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.616388:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1ca7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.616402:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1ca7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.616436:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1cae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.616444:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1cae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.616450:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1cae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.616632:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1cb5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.616643:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.616651:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843602.616707:0:11996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788843602.617022:0:11996:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788843602.617056:0:11996:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.617072:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.617081:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1ca7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.617090:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1ca7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.617109:0:11996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1ca7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.617116:0:11996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3cc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843602.617121:0:11996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1ca7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.617130:0:11996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1ca7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.617190:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bd007450c00) 00010000:00010000:0.0:1788843602.617194:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843602.617201:0:11996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1ca7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.617208:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1ca7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.617226:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1cae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.617232:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1cae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.617237:0:11996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1cae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.617242:0:11996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3da00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843602.617245:0:11996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1cae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.617262:0:11996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1cae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.617271:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bd13dfda100) 00010000:00010000:0.0:1788843602.617273:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843602.617277:0:11996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1cae lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.617283:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1cae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.617322:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1ca0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b57 expref: 65 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.617340:0:11996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1cb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b57 expref: 64 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.617348:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:0.0:1788843602.617351:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788843602.617353:0:11996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3dc00, rc 0) 00000100:00100000:0.0:1788843602.619518:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+64:12345:x1875738116575488:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 3284us (3947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843602.619534:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 185 00000040:00080000:3.0:1788843602.970425:0:13785:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788843602.970441:0:13785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788843602.971651:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788843602.971685:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788843602.971904:0:13785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007935180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13785:1875738134465792:192.168.203.33@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788843602.972046:0:13785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00789c300 going to sleep for 11 seconds 00000100:00100000:1.0:1788843602.975723:0:13785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007935180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13785:1875738134465792:192.168.203.33@tcp:107:hsm_cdtr.0 00000001:00080000:0.0:1788843602.981307:0:6485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000004:00080000:0.0:1788843602.981385:0:6485:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788843602.981411:0:6485:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bd007475540 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1788843602.981417:0:6485:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd0077b5500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bd0074753c0 00000020:00080000:0.0:1788843602.981430:0:6485:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd0077b5200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bd007743400 00000020:00080000:0.0:1788843602.981481:0:6538:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1788843602.981569:0:6538:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788843602.981709:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1788843602.981738:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d1a62 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843602.981739:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007935180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134465920:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788843602.981757:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d1a62 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.981765:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d1a62 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.981772:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be3a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843602.981778:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d1a62 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.981787:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d1a62 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.981811:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9bd007450000) 00010000:00010000:1.0:1788843602.981815:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843602.981819:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d1a62 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.981826:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d1a62 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.981871:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d1a69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.981877:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d1a69 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.981882:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d1a69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.981887:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be2000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843602.981890:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d1a69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.981896:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d1a69 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.981905:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bd007450c00) 00010000:00010000:1.0:1788843602.981907:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843602.981911:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d1a69 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.981917:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d1a69 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.981932:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1aa8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.981938:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1aa8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.981944:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1aa8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.981954:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843602.981957:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1aa8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.981963:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1aa8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.981972:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bd13dfda100) 00010000:00010000:1.0:1788843602.981974:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843602.981977:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1aa8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.981982:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1aa8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.981999:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1bab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.982005:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1bab lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.982010:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1bab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.982015:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843602.982017:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1bab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.982023:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1bab lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.982042:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:1.0:1788843602.982044:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843602.982048:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1bab lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.982054:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1bab lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.982066:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1bce lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.982072:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1bce lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.982078:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1bce lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.982083:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843602.982086:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1bce lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.982093:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1bce lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.982100:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:1.0:1788843602.982102:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843602.982105:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1bce lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.982110:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1bce lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.982132:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1c14 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.982138:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1c14 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.982185:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1c14 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.982191:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbea600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843602.982193:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1c14 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.982200:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1c14 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.982208:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:1.0:1788843602.982210:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843602.982213:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1c14 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843602.982219:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1c14 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843602.982441:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843602.985737:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134465920 00000100:00100000:0.0:1788843602.985760:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134465920 00000100:00100000:0.0:1788843602.985883:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788843602.985899:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3631:x1875738134465920:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788843602.985940:0:8421:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:0.0:1788843602.985987:0:8421:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f964f, atime: 0x6a9f964f, ctime: 0x6a9f964f, blocks: 0x8 00010000:00010000:0.0:1788843602.985997:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000366bcf19/0xa762dfcbd58d1cbc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.986017:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=381s v=(0 0) 00010000:00010000:0.0:1788843602.986023:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843602.986031:0:8421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000366bcf19/0xa762dfcbd58d1cbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.986053:0:8421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000366bcf19/0xa762dfcbd58d1cbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.986064:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000366bcf19/0xa762dfcbd58d1cbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.986073:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000366bcf19/0xa762dfcbd58d1cbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.986093:0:8421:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788843602.986409:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3631:x1875738134465920:12345-0@lo:6:osp-syn-0-0.0 Request processed in 515us (3968us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788843602.986419:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:0.0:1788843602.986451:0:10329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843602.986458:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000366bcf19/0xa762dfcbd58d1cbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.986468:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3da00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843602.986473:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000366bcf19/0xa762dfcbd58d1cbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.986484:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000366bcf19/0xa762dfcbd58d1cbc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.986505:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000366bcf19/0xa762dfcbd58d1cbc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.986513:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000366bcf19/0xa762dfcbd58d1cbc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843602.986537:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843602.986539:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843602.986541:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788843602.986591:0:3631:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd007935180/2, rc 0, transno 4294967308 00000100:00100000:0.0:1788843602.986599:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007935180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134465920:0@lo:6:osp-syn-0-0.0 00000100:00080000:1.0:1788843602.987862:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788843602.993121:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843602.995186:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116575616 00000100:00100000:0.0:1788843602.995205:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116575616 00000100:00100000:0.0:1788843602.995307:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 186 00000100:00100000:0.0:1788843602.995319:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141a74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+17:12356:x1875738116575616:12345-192.168.203.33@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788843602.995362:0:6506:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788843602.995606:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141a74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+17:12356:x1875738116575616:12345-192.168.203.33@tcp:53:lhsmtool_posix.0 Request processed in 288us (2499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843602.995614:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 186 00000100:00100000:2.0:1788843603.004695:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843603.004974:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116575744 00000100:00100000:0.0:1788843603.004987:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116575744 00000100:00100000:0.0:1788843603.005062:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 187 00000100:00100000:0.0:1788843603.005074:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+17:12356:x1875738116575744:12345-192.168.203.33@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788843603.005209:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1cc3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.005234:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1cc3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.005257:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1cc3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.005277:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1cca lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.005284:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1cca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.005291:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1cca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.005337:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1cd1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.005372:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.005380:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843603.005451:0:6507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788843603.005456:0:6507:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788843603.005473:0:6507:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.005487:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1cc3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.005495:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1cc3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.005503:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1cc3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.005510:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3da00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843603.005515:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1cc3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.005524:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1cc3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.005540:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd00746cd00) 00010000:00010000:0.0:1788843603.005543:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843603.005548:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1cc3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.005567:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1cc3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.005583:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1cca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.005590:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1cca lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.005596:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1cca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.005601:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3cc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843603.005604:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1cca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.005610:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1cca lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.005617:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9bd00658c300) 00010000:00010000:0.0:1788843603.005620:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843603.005623:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1cca lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.005629:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1cca lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.005645:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.005651:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1cd1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.005664:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1cd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.005669:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843603.005672:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1cd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.005679:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1cd1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.005687:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:0.0:1788843603.005689:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843603.005692:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1cd1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.005698:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1cd1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843603.005798:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+17:12356:x1875738116575744:12345-192.168.203.33@tcp:34:lhsmtool_posix.0 Request processed in 724us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843603.005807:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 187 00000100:00100000:1.0:1788843603.016343:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843603.019837:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116576000 00000100:00100000:0.0:1788843603.019857:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116576000 00000100:00100000:0.0:1788843603.019960:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 188 00000100:00100000:0.0:1788843603.019973:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+17:12356:x1875738116576000:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788843603.020001:0:11996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843603.020029:0:11996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1cd8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490b5e expref: -99 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.020221:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1cdf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.020241:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1cdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.020255:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1cdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843603.020268:0:11996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788843603.020395:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1cdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.020404:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1cdf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.020411:0:11996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1cdf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.020417:0:11996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3ca00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843603.020422:0:11996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1cdf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.020430:0:11996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1cdf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.020444:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:0.0:1788843603.020448:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788843603.020453:0:11996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1cdf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.020471:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1cdf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.020526:0:11996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1cd8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b5e expref: 19 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.020538:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd00746cd00) 00010000:00010000:0.0:1788843603.020540:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788843603.020544:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1cd8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b5e expref: 19 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.020555:0:11996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3d800, rc 0) 00000100:00100000:0.0:1788843603.021056:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+18:12356:x1875738116576000:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 1081us (4724us total) trans 4294967459 rc 301/301 00000100:00100000:0.0:1788843603.021068:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 188 00000100:00100000:0.0:1788843603.027756:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843603.027937:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116576128 00000100:00100000:2.0:1788843603.027951:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116576128 00000100:00100000:2.0:1788843603.028034:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 189 00000100:00100000:2.0:1788843603.028046:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0085edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+18:12356:x1875738116576128:12345-192.168.203.33@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788843603.028095:0:6506:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788843603.028300:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0085edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+18:12356:x1875738116576128:12345-192.168.203.33@tcp:53:lhsmtool_posix.0 Request processed in 255us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843603.028309:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 189 00000100:00100000:2.0:1788843603.039569:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843603.042544:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116576384 00000100:00100000:0.0:1788843603.042566:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116576384 00000100:00100000:0.0:1788843603.043446:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 190 00000100:00100000:0.0:1788843603.043466:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+18:12356:x1875738116576384:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788843603.043494:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843603.043497:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788843603.043532:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1c92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b50 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.043556:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bd007450c00) 00010000:00010000:0.0:1788843603.043580:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788843603.043598:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1ced lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490b65 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788843603.044214:0:6507:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788843603.044391:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1cf4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.044408:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1cf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.044421:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1cf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.044485:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1ced lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b65 expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.044504:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1cf4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b65 expref: 19 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.044511:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9bd00658c300) 00010000:00010000:0.0:1788843603.044514:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788843603.044517:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3ca00, rc 0) 00000100:00100000:0.0:1788843603.044613:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+19:12356:x1875738116576384:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 1154us (5059us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788843603.044623:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 190 00000100:00100000:1.0:1788843603.048954:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843603.049219:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116576640 00000100:00100000:1.0:1788843603.049231:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116576640 00000100:00100000:1.0:1788843603.049296:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 191 00000100:00100000:1.0:1788843603.049307:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+20:12356:x1875738116576640:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788843603.049488:0:11996:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843603.049525:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d1cf4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b65 expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.049550:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9bd00658c300) 00010000:00010000:1.0:1788843603.049564:0:11996:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788843603.049592:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb600/0xa762dfcbd58d1d02 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.049610:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb600/0xa762dfcbd58d1d02 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.049622:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb600/0xa762dfcbd58d1d02 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.050415:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeaa00/0xa762dfcbd58d1d09 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x75b1f9bf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.050443:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeaa00/0xa762dfcbd58d1d09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x75b1f9bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.050460:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeaa00/0xa762dfcbd58d1d09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x75b1f9bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.050518:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb600/0xa762dfcbd58d1d02 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.050526:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb600/0xa762dfcbd58d1d02 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.050533:0:11996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb600/0xa762dfcbd58d1d02 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.050554:0:11996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbeb600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843603.050560:0:11996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb600/0xa762dfcbd58d1d02 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.050568:0:11996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb600/0xa762dfcbd58d1d02 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.050582:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bd007450c00) 00010000:00010000:1.0:1788843603.050585:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843603.050591:0:11996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb600/0xa762dfcbd58d1d02 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.050598:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb600/0xa762dfcbd58d1d02 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.050615:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeaa00/0xa762dfcbd58d1d09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x75b1f9bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.050622:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeaa00/0xa762dfcbd58d1d09 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x75b1f9bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.050628:0:11996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeaa00/0xa762dfcbd58d1d09 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x75b1f9bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.050634:0:11996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbeaa00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843603.050636:0:11996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeaa00/0xa762dfcbd58d1d09 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x75b1f9bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.050641:0:11996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeaa00/0xa762dfcbd58d1d09 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x75b1f9bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.050660:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x75b1f9bf (ffff9bd00746c600) 00010000:00010000:1.0:1788843603.050663:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843603.050666:0:11996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeaa00/0xa762dfcbd58d1d09 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x75b1f9bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.050672:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeaa00/0xa762dfcbd58d1d09 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x75b1f9bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843603.050782:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+18:12356:x1875738116576640:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 Request processed in 1472us (1843us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788843603.050806:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 191 00000100:00100000:1.0:1788843603.055065:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843603.055190:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116576768 00000100:00100000:2.0:1788843603.055205:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116576768 00000100:00100000:2.0:1788843603.055275:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 192 00000100:00100000:2.0:1788843603.055288:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+18:12356:x1875738116576768:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788843603.055317:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843603.055525:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947800/0xa762dfcbd58d1d10 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490b6c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.055590:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1d17 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.055608:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1d17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.055621:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1d17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.055939:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947800/0xa762dfcbd58d1d10 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b6c expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.055962:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1d17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b6c expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.055973:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:2.0:1788843603.055976:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788843603.055981:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007947000, rc 0) 00000100:00100000:2.0:1788843603.056103:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+19:12356:x1875738116576768:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 817us (1507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843603.056112:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 192 00000100:00100000:2.0:1788843603.059969:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843603.060065:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116577024 00000100:00100000:3.0:1788843603.060080:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116577024 00000100:00100000:3.0:1788843603.060194:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 193 00000100:00100000:3.0:1788843603.060206:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+19:12356:x1875738116577024:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788843603.060320:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1d1e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.060344:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1d1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.060357:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1d1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788843603.060588:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1788843603.060601:0:6507:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 381113459038ns, next at 382113455365ns, rc = 0 00000004:00010000:3.0:1788843603.060675:0:6507:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f85668d0 reply state 00000000a6a2556d transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1d1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.060691:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1d1e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.060700:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:3.0:1788843603.060703:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788843603.060708:0:6507:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788843603.060837:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+21:12356:x1875738116577024:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 Request processed in 632us (883us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788843603.060845:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 193 00000100:00100000:1.0:1788843603.064135:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843603.064285:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116577152 00000100:00100000:2.0:1788843603.064299:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116577152 00000100:00100000:2.0:1788843603.064380:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 194 00000100:00100000:2.0:1788843603.064393:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+21:12356:x1875738116577152:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788843603.064427:0:11996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843603.064472:0:11996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1d25 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490b73 expref: -99 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.064553:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1d25 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b73 expref: 22 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.064571:0:11996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1d25 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b73 expref: 22 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.064607:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:2.0:1788843603.064611:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788843603.064615:0:11996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007947400, rc 0) 00000100:00100000:2.0:1788843603.064692:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+22:12356:x1875738116577152:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 302us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843603.064699:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 194 00000100:00100000:2.0:1788843603.069440:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843603.069534:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116577280 00000100:00100000:1.0:1788843603.069547:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116577280 00000100:00100000:1.0:1788843603.069635:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 59 00000100:00100000:1.0:1788843603.069647:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+6:2390:x1875738116577280:12345-192.168.203.33@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788843603.069972:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2390:x1875738116577280:12345-192.168.203.33@tcp:2:lhsmtool_posix.0 Request processed in 327us (552us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788843603.069981:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 59 00000100:00080000:3.0:1788843603.070544:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788843603.073371:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843603.073742:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116577536 00000100:00100000:0.0:1788843603.073756:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116577536 00000100:00100000:0.0:1788843603.073945:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 49 00000100:00100000:0.0:1788843603.073958:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+22:12356:x1875738116577536:12345-192.168.203.33@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788843603.074431:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+23:12356:x1875738116577536:12345-192.168.203.33@tcp:35:lhsmtool_posix.0 Request processed in 473us (1074us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1788843603.074441:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 49 00000100:00100000:1.0:1788843603.076971:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843603.077132:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116577792 00000100:00100000:3.0:1788843603.077185:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116577792 00000100:00100000:3.0:1788843603.077254:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 195 00000100:00100000:3.0:1788843603.077266:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+23:12356:x1875738116577792:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788843603.077414:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+23:12356:x1875738116577792:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 Request processed in 149us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843603.077422:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 195 00000100:00100000:1.0:1788843603.081283:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843603.081640:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116577920 00000100:00100000:0.0:1788843603.081654:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116577920 00000100:00100000:0.0:1788843603.081729:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 196 00000100:00100000:0.0:1788843603.081742:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+23:12356:x1875738116577920:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788843603.081769:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843603.081795:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1d2c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490b7a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.081932:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1d33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.081952:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1d33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.081966:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1d33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843603.082028:0:6508:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788843603.082054:0:6508:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1d33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.082087:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1d2c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b7a expref: 25 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.082111:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1d33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b7a expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.082135:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:0.0:1788843603.082534:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788843603.082541:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3c800, rc 0) 00000100:00100000:0.0:1788843603.082617:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+24:12356:x1875738116577920:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 877us (1348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843603.082626:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 196 00010000:00010000:0.0:1788843603.099780:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843603.103217:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843603.103619:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116578048 00000100:00100000:0.0:1788843603.103632:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116578048 00000100:00100000:0.0:1788843603.103743:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 60 00000100:00100000:0.0:1788843603.103756:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2389:x1875738116578048:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788843603.103781:0:8421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843603.103809:0:8421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047bf716a/0xa762dfcbd58d1d3a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490b81 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788843603.103853:0:8421:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f9652, blocks: 0x0 00010000:00010000:0.0:1788843603.103880:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=381s v=(0 0) 00010000:00010000:0.0:1788843603.103885:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843603.103895:0:8421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047bf716a/0xa762dfcbd58d1d3a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b81 expref: 8 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.103914:0:8421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000047bf716a/0xa762dfcbd58d1d3a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b81 expref: 8 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.103930:0:8421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3d800, rc 0) 00000100:00100000:0.0:1788843603.104019:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:2389:x1875738116578048:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 265us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843603.104027:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 60 00000100:00100000:1.0:1788843603.111720:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843603.111947:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116578304 00000100:00100000:3.0:1788843603.111961:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116578304 00000100:00100000:3.0:1788843603.112040:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 197 00000100:00100000:3.0:1788843603.112054:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+24:12356:x1875738116578304:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788843603.112299:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+24:12356:x1875738116578304:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 Request processed in 246us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843603.112307:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 197 00000100:00100000:1.0:1788843603.121901:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843603.124964:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116578432 00000100:00100000:0.0:1788843603.124987:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116578432 00000100:00100000:1.0:1788843603.135977:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 61 00000100:00100000:1.0:1788843603.135994:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1054e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:12356:x1875738116578432:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788843603.136018:0:8901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843603.136043:0:8901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008940daf1/0xa762dfcbd58d1d41 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490b88 expref: -99 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.136089:0:8901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000047bf716a/0xa762dfcbd58d1d3a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b81 expref: 9 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.136099:0:8901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843603.136104:0:8901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843603.136110:0:8901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008940daf1/0xa762dfcbd58d1d41 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b88 expref: 9 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.136185:0:8901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000047bf716a/0xa762dfcbd58d1d3a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b81 expref: 9 pid: 8421 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.136203:0:8901:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000047bf716a/0xa762dfcbd58d1d3a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b81 expref: 9 pid: 8421 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843603.136221:0:8901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd1054e1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8901:1875738134466048:192.168.203.33@tcp:104: 00000100:00100000:1.0:1788843603.136356:0:8901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10652be40 going to sleep for 11 seconds 00000100:00100000:1.0:1788843603.140888:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843603.140947:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116578560 00000100:00100000:1.0:1788843603.140960:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116578560 00010000:00010000:1.0:1788843603.141020:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000047bf716a/0xa762dfcbd58d1d3a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b81 expref: 10 pid: 8421 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843603.141087:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 87 00000100:00100000:1.0:1788843603.141099:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00799b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+10:2390:x1875738116578560:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843603.141124:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843603.141192:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000047bf716a/0xa762dfcbd58d1d3a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b81 expref: 10 pid: 8421 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.141209:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000047bf716a/0xa762dfcbd58d1d3a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b81 expref: 10 pid: 8421 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.141243:0:7448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843603.141249:0:7448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843603.141259:0:7448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008940daf1/0xa762dfcbd58d1d41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b88 expref: 10 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.141271:0:7448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008940daf1/0xa762dfcbd58d1d41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b88 expref: 10 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.142434:0:7448:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008940daf1/0xa762dfcbd58d1d41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b88 expref: 10 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843603.142802:0:7448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007999880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7448:1875738134466176:192.168.203.33@tcp:105: 00000100:00100000:1.0:1788843603.143900:0:7448:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10652b9c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788843603.143980:0:8901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047bf716a/0xa762dfcbd58d1d3a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b81 expref: 10 pid: 8421 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843603.144018:0:8901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd1054e1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8901:1875738134466048:192.168.203.33@tcp:104: 00010000:00010000:1.0:1788843603.144056:0:8901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008940daf1/0xa762dfcbd58d1d41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b88 expref: 9 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.144075:0:8901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fbea200, rc 0) 00000100:00100000:1.0:1788843603.144128:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1054e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+9:12356:x1875738116578432:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 8137us (22315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843603.144157:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 61 00000100:00100000:2.0:1788843603.160499:0:7448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007999880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7448:1875738134466176:192.168.203.33@tcp:105: 00010000:00010000:2.0:1788843603.160534:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843603.160626:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00799b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:2390:x1875738116578560:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 19528us (19802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843603.160640:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 87 00000100:00100000:1.0:1788843603.170259:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843603.170883:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116578688 00000100:00100000:3.0:1788843603.170897:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116578688 00002000:00100000:3.0:1788843603.170965:0:8427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9bd00799a680 x1875738116578688/t0(0) o4->f25f61b6-5faf-4e05-81a4-dea3dba05dc5@192.168.203.33@tcp:219/0 lens 504/0 e 0 to 0 dl 1788843614 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788843603.170977:0:8427:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd00799a680 with x1875738116578688 ext(0->8) 00002000:00010000:3.0:1788843603.170984:0:8427:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bd00799a680 00000100:00100000:3.0:1788843603.171024:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 4 00000100:00100000:3.0:1788843603.171037:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00799a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:2390:x1875738116578688:12345-192.168.203.33@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788843603.176126:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00799a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+10:2390:x1875738116578688:12345-192.168.203.33@tcp:4:lhsmtool_posix.0 Request processed in 5073us (5867us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788843603.176182:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 4 00002000:00100000:1.0:1788843603.176199:0:8427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9bd00799a680 x1875738116578688/t4294967315(0) o4->f25f61b6-5faf-4e05-81a4-dea3dba05dc5@192.168.203.33@tcp:219/0 lens 504/448 e 0 to 0 dl 1788843614 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788843603.176212:0:8427:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd00799a680 with x1875738116578688 ext(0->8) 00002000:00010000:1.0:1788843603.176221:0:8427:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bd00799a680 00000100:00100000:3.0:1788843603.184675:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843603.184903:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116578816 00000100:00100000:0.0:1788843603.184919:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116578816 00000100:00100000:0.0:1788843603.184997:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 198 00000100:00100000:0.0:1788843603.185010:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+24:12356:x1875738116578816:12345-192.168.203.33@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788843603.187203:0:6485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:0.0:1788843603.187244:0:6485:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:0.0:1788843603.187271:0:6485:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:0.0:1788843603.187294:0:6538:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1788843603.187305:0:6538:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788843603.187546:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134466304:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788843603.187650:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843603.187727:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134466304 00000100:00100000:3.0:1788843603.187737:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134466304 00000100:00100000:3.0:1788843603.187798:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788843603.187808:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134466304:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788843603.187977:0:8424:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788843603.187981:0:8424:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788843602 00002000:00010000:3.0:1788843603.187984:0:8424:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788843603.187986:0:8424:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788843602 -> 1788843602 00002000:00010000:3.0:1788843603.187989:0:8424:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788843603.188033:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3631:x1875738134466304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 227us (382us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788843603.188041:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1788843603.188063:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788843603.188109:0:3631:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd10fe21c00/2, rc 0, transno 4294967316 00000100:00100000:3.0:1788843603.188116:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134466304:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788843603.188484:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+20:12356:x1875738116578816:12345-192.168.203.33@tcp:44:lhsmtool_posix.0 Request processed in 3473us (3821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843603.188494:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 198 00000100:00100000:3.0:1788843603.190863:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843603.190998:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116578944 00000100:00100000:0.0:1788843603.191012:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116578944 00000100:00100000:0.0:1788843603.191079:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 63 00000100:00100000:0.0:1788843603.191091:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007240a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+10:2390:x1875738116578944:12345-192.168.203.33@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1788843603.192730:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1d1e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.192751:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1d1e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.192761:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1d1e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.192784:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be2400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843603.192790:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1d1e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.192799:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1d1e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.192822:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:1.0:1788843603.192825:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788843603.192892:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1d1e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.192900:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1d1e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788843603.198037:0:9500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:0.0:1788843603.198070:0:9500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1788843603.198550:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007240a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2390:x1875738116578944:12345-192.168.203.33@tcp:16:lhsmtool_posix.0 Request processed in 7453us (7693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843603.198563:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 63 00000100:00100000:0.0:1788843603.209776:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843603.209825:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116579200 00000100:00100000:0.0:1788843603.211771:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116579200 00000100:00100000:0.0:1788843603.211881:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 199 00000100:00100000:0.0:1788843603.211894:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+19:12356:x1875738116579200:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788843603.211978:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843603.212018:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1d33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b7a expref: 19 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.212043:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:0.0:1788843603.212050:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788843603.212090:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1d48 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.212108:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1d48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.212119:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1d48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788843603.212333:0:6508:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b7d0f01 reply state 00000000ec83d024 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1d48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.212348:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1d48 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.212355:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:0.0:1788843603.212358:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788843603.212362:0:6508:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788843603.212496:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+20:12356:x1875738116579200:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 Request processed in 604us (2733us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1788843603.212504:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 199 00000100:00100000:3.0:1788843603.219039:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843603.219533:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116579328 00000100:00100000:0.0:1788843603.219547:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116579328 00000100:00100000:0.0:1788843603.219619:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 64 00000100:00100000:0.0:1788843603.219663:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2389:x1875738116579328:12345-192.168.203.33@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788843603.220015:0:8424:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788843603.220019:0:8424:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788843602 -> 1788843601 00002000:00010000:0.0:1788843603.220023:0:8424:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788843599 00002000:00010000:0.0:1788843603.220025:0:8424:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788843602 -> 1788843601 00002000:00010000:0.0:1788843603.220027:0:8424:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788843603.220119:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:2389:x1875738116579328:12345-192.168.203.33@tcp:2:lhsmtool_posix.0 Request processed in 459us (1096us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788843603.220128:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 64 00000100:00100000:0.0:1788843603.230485:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843603.230571:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116579584 00000100:00100000:3.0:1788843603.230586:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116579584 00000100:00100000:3.0:1788843603.230725:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 200 00000100:00100000:3.0:1788843603.230740:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd006755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+20:12356:x1875738116579584:12345-192.168.203.33@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788843603.230904:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1d4f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.230937:0:9517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1d17 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b6c expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.230949:0:9517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1d4f lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.230997:0:9517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1d17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b6c expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.231013:0:9517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1d17 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b6c expref: 20 pid: 6506 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843603.231032:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007768000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9517:1875738134466432:192.168.203.33@tcp:104: 00000100:00100000:3.0:1788843603.231211:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00789c240 going to sleep for 11 seconds 00000100:00100000:1.0:1788843603.239999:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843603.240047:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116579712 00000100:00100000:1.0:1788843603.240058:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116579712 00010000:00010000:1.0:1788843603.240111:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1d17 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b6c expref: 21 pid: 6506 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843603.240192:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 88 00000100:00100000:1.0:1788843603.240204:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd133329450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+21:2390:x1875738116579712:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843603.240224:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843603.240231:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1d17 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b6c expref: 21 pid: 6506 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.240248:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1d17 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b6c expref: 21 pid: 6506 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.240295:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:1.0:1788843603.240301:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1d4f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.240312:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1d4f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.241020:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1d17 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b6c expref: 21 pid: 6506 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843603.241044:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007768000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9517:1875738134466432:192.168.203.33@tcp:104: 00010000:00010000:1.0:1788843603.241097:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1d4f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.241411:0:9517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1d4f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.241763:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843603.241866:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd133329450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+20:2390:x1875738116579712:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 1659us (1879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843603.241879:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 88 00010000:00010000:0.0:1788843603.246204:0:9517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1d4f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.246230:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1d4f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.246294:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1d4f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.246303:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1d4f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.246349:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1d4f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.246356:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be3c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843603.246361:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1d4f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.246369:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1d4f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.246395:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:0.0:1788843603.246399:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788843603.246405:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1d4f lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.246411:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1d4f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843603.246530:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd006755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+19:12356:x1875738116579584:12345-192.168.203.33@tcp:55:lhsmtool_posix.0 Request processed in 15786us (16050us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788843603.246542:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 200 00000100:00100000:1.0:1788843603.255775:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843603.255854:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116579840 00000100:00100000:3.0:1788843603.255868:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116579840 00000100:00100000:3.0:1788843603.255942:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 65 00000100:00100000:3.0:1788843603.255954:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00799b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:2390:x1875738116579840:12345-192.168.203.33@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788843603.256021:0:8901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000064461fa2/0xa762dfcbd58d1d56 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.256047:0:8901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008940daf1/0xa762dfcbd58d1d41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b88 expref: 8 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.256057:0:8901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843603.256063:0:8901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788843603.256085:0:8901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064461fa2/0xa762dfcbd58d1d56 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.256132:0:8901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008940daf1/0xa762dfcbd58d1d41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b88 expref: 8 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.256184:0:8901:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008940daf1/0xa762dfcbd58d1d41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b88 expref: 8 pid: 8901 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843603.256204:0:8901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8901:1875738134466560:192.168.203.33@tcp:104: 00000100:00100000:3.0:1788843603.256340:0:8901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00789c780 going to sleep for 11 seconds 00000100:00100000:3.0:1788843603.263033:0:8901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8901:1875738134466560:192.168.203.33@tcp:104: 00010000:00010000:3.0:1788843603.263075:0:8901:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000064461fa2/0xa762dfcbd58d1d56 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843603.263450:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843603.263665:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116579968 00000100:00100000:0.0:1788843603.263675:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116579968 00010000:00010000:0.0:1788843603.263721:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008940daf1/0xa762dfcbd58d1d41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b88 expref: 9 pid: 8901 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843603.263766:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 89 00000100:00100000:0.0:1788843603.263777:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007998700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+9:2389:x1875738116579968:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843603.263815:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843603.263853:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008940daf1/0xa762dfcbd58d1d41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b88 expref: 9 pid: 8901 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.263867:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008940daf1/0xa762dfcbd58d1d41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b88 expref: 9 pid: 8901 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.263895:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008940daf1/0xa762dfcbd58d1d41 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b88 expref: 9 pid: 8901 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.263914:0:6493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788843603.263919:0:6493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788843603.263926:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000064461fa2/0xa762dfcbd58d1d56 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.263938:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064461fa2/0xa762dfcbd58d1d56 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.263968:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843603.264036:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007998700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:2389:x1875738116579968:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 259us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843603.264044:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 89 00010000:00010000:3.0:1788843603.265362:0:8901:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000064461fa2/0xa762dfcbd58d1d56 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.265505:0:8901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064461fa2/0xa762dfcbd58d1d56 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.265542:0:8901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000064461fa2/0xa762dfcbd58d1d56 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.265550:0:8901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064461fa2/0xa762dfcbd58d1d56 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.265571:0:8901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064461fa2/0xa762dfcbd58d1d56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.265580:0:8901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be3000 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:3.0:1788843603.265585:0:8901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064461fa2/0xa762dfcbd58d1d56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.265595:0:8901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064461fa2/0xa762dfcbd58d1d56 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.265615:0:8901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064461fa2/0xa762dfcbd58d1d56 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.265624:0:8901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064461fa2/0xa762dfcbd58d1d56 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843603.265738:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00799b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2390:x1875738116579840:12345-192.168.203.33@tcp:1:lhsmtool_posix.0 Request processed in 9781us (9972us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843603.265749:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 65 00000100:00100000:1.0:1788843603.268577:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843603.268680:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116580224 00000100:00100000:3.0:1788843603.268696:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116580224 00000100:00100000:3.0:1788843603.268770:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 201 00000100:00100000:3.0:1788843603.268782:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+19:12356:x1875738116580224:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788843603.268912:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d1d5d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.268939:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1ba4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b11 expref: 19 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.268949:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d1d5d lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.268996:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1ba4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b11 expref: 19 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.269013:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1ba4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b11 expref: 19 pid: 11996 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843603.269030:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6507:1875738134466688:192.168.203.33@tcp:104: 00000100:00100000:3.0:1788843603.269135:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00789c780 going to sleep for 11 seconds 00000100:00100000:3.0:1788843603.272502:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6507:1875738134466688:192.168.203.33@tcp:104: 00010000:00010000:3.0:1788843603.272543:0:6507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d1d5d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843603.274096:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843603.274345:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116580352 00000100:00100000:2.0:1788843603.274359:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116580352 00010000:00010000:2.0:1788843603.274414:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1ba4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b11 expref: 20 pid: 11996 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843603.274475:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 90 00000100:00100000:2.0:1788843603.274486:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007999880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+20:2389:x1875738116580352:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843603.274512:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843603.274521:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1ba4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b11 expref: 20 pid: 11996 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.274535:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1ba4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b11 expref: 20 pid: 11996 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.274564:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1ba4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b11 expref: 20 pid: 11996 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.274580:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:2.0:1788843603.274587:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d1d5d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.274597:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d1d5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.274606:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d1d5d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.274635:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843603.274700:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007999880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+19:2389:x1875738116580352:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 216us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843603.274709:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 90 00010000:00010000:3.0:1788843603.275092:0:6507:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d1d5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.275103:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d1d5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.275368:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3200/0xa762dfcbd58d1d64 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.275385:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1d25 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b73 expref: 19 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.275401:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3200/0xa762dfcbd58d1d64 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.275437:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1d25 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b73 expref: 19 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.275453:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1d25 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b73 expref: 19 pid: 11996 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843603.275471:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6507:1875738134466816:192.168.203.33@tcp:104: 00000100:00100000:3.0:1788843603.275566:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00789ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788843603.279608:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6507:1875738134466816:192.168.203.33@tcp:104: 00010000:00010000:3.0:1788843603.279659:0:6507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3200/0xa762dfcbd58d1d64 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843603.285383:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843603.285602:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116580480 00000100:00100000:1.0:1788843603.285619:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116580480 00010000:00010000:1.0:1788843603.285682:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1d25 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b73 expref: 20 pid: 11996 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843603.285738:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 91 00000100:00100000:1.0:1788843603.285751:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+20:2389:x1875738116580480:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843603.285772:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843603.285780:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1d25 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b73 expref: 20 pid: 11996 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.285805:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1d25 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b73 expref: 20 pid: 11996 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.285850:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1d25 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b73 expref: 20 pid: 11996 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.285873:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:1.0:1788843603.285882:0:6493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3200/0xa762dfcbd58d1d64 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.285893:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3200/0xa762dfcbd58d1d64 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.285904:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3200/0xa762dfcbd58d1d64 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.285940:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843603.286017:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+19:2389:x1875738116580480:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 268us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843603.286025:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 91 00010000:00010000:3.0:1788843603.286647:0:6507:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3200/0xa762dfcbd58d1d64 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.286658:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3200/0xa762dfcbd58d1d64 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788843603.286808:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1788843603.286986:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1788843603.287027:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1788843603.287123:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6507:1875738134466944:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788843603.287237:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843603.287283:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00789ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843603.288233:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134466944 00000100:00100000:2.0:1788843603.288248:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134466944 00000100:00100000:2.0:1788843603.288327:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788843603.288339:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6507:x1875738134466944:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788843603.288524:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6507:x1875738134466944:12345-0@lo:1000:mdt00_001.0 Request processed in 186us (1286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843603.288533:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788843603.288722:0:6507:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:1.0:1788843603.288731:0:6507:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd10fe21c00, transno 4294967316 00000100:00100000:1.0:1788843603.288756:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6507:1875738134466944:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1788843603.288957:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:1.0:1788843603.289046:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6507:1875738134467072:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788843603.289097:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843603.289123:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893300 going to sleep for 11 seconds 00000100:00100000:0.0:1788843603.289183:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134467072 00000100:00100000:0.0:1788843603.289189:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134467072 00000100:00100000:0.0:1788843603.289231:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788843603.289240:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1331e7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6507:x1875738134467072:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788843603.289435:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1331e7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6507:x1875738134467072:12345-0@lo:1000:mdt00_001.0 Request processed in 195us (336us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788843603.289442:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788843603.289555:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6507:1875738134467072:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788843603.289609:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3200/0xa762dfcbd58d1d64 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.289620:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3200/0xa762dfcbd58d1d64 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.289627:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3200/0xa762dfcbd58d1d64 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.289633:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be3200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843603.289638:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3200/0xa762dfcbd58d1d64 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.289648:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3200/0xa762dfcbd58d1d64 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.289668:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:1.0:1788843603.289671:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788843603.289677:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3200/0xa762dfcbd58d1d64 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.289683:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3200/0xa762dfcbd58d1d64 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.289712:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1c99 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.289718:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1c99 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.289723:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1c99 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.289734:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843603.289736:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1c99 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.289742:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1c99 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.289750:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:1.0:1788843603.289752:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788843603.289754:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1c99 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.289759:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1c99 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.289786:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1d6b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.289801:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1cb5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b57 expref: 22 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.289810:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1d6b lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.289907:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1cb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b57 expref: 22 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.289924:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1cb5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b57 expref: 22 pid: 11996 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843603.289949:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6507:1875738134467200:192.168.203.33@tcp:104: 00000100:00100000:1.0:1788843603.290032:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893300 going to sleep for 11 seconds 00000100:00100000:1.0:1788843603.293910:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6507:1875738134467200:192.168.203.33@tcp:104: 00010000:00010000:1.0:1788843603.293949:0:6507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1d6b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843603.298948:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843603.299049:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116580608 00000100:00100000:2.0:1788843603.299080:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116580608 00010000:00010000:2.0:1788843603.299133:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1cb5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b57 expref: 23 pid: 11996 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843603.299214:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 92 00000100:00100000:2.0:1788843603.299226:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+23:2389:x1875738116580608:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843603.299249:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843603.299257:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1cb5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b57 expref: 23 pid: 11996 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.299273:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1cb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b57 expref: 23 pid: 11996 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.299303:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1cb5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b57 expref: 23 pid: 11996 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.299331:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:2.0:1788843603.299338:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1d6b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.299351:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1d6b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.299359:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1d6b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.299410:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843603.299481:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+22:2389:x1875738116580608:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 256us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843603.299489:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 92 00010000:00010000:3.0:1788843603.300915:0:6507:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1d6b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.300935:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1d6b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.300953:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1d6b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.300961:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1d6b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.300968:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1d6b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.300975:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbea600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1788843603.300979:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1d6b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.300988:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1d6b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.301007:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:3.0:1788843603.301010:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843603.301015:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1d6b lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.301020:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1d6b lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.301037:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d1d5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.301043:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d1d5d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.301069:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d1d5d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.301074:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be2200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1788843603.301076:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d1d5d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.301082:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d1d5d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.301089:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd00658be00) 00010000:00010000:3.0:1788843603.301091:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788843603.301093:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d1d5d lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.301098:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d1d5d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843603.301394:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+21:12356:x1875738116580224:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 Request processed in 32608us (32829us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1788843603.301406:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 201 00000020:00080000:3.0:1788843603.301414:0:6507:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788843603.301868:0:13785:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788843603.301876:0:13785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788843603.302384:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1788843603.302397:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788843603.306248:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843603.306424:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116580864 00000100:00100000:2.0:1788843603.306438:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116580864 00000100:00100000:2.0:1788843603.306511:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 50 00000100:00100000:2.0:1788843603.306524:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e1e4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+21:12356:x1875738116580864:12345-192.168.203.33@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788843603.310548:0:6510:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788843603.310654:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:3.0:1788843603.310741:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1d72 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.310766:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1d72 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.310798:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1d72 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.310808:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1d72 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.310816:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1d72 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.310823:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1d72 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.310853:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788843603.311124:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e1e4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+23:12356:x1875738116580864:12345-192.168.203.33@tcp:35:lhsmtool_posix.0 Request processed in 4595us (4884us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788843603.311137:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 50 00000020:00080000:3.0:1788843603.311174:0:6510:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788843603.311789:0:6495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843603.311799:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1d72 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.311809:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be3000 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843603.311813:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1d72 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.311822:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1d72 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.311849:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:2.0:1788843603.311852:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788843603.311857:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1d72 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.311864:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1d72 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.311881:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843603.311883:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843603.311892:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788843603.572542:0:14649:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788843603.572556:0:14649:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788843603.572587:0:14649:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788843603.572594:0:14649:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788843603.725435:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843603.725738:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116581120 00000100:00100000:3.0:1788843603.725751:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116581120 00000100:00100000:3.0:1788843603.725849:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 202 00000100:00100000:3.0:1788843603.725861:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+23:12366:x1875738116581120:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1788843603.725900:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843603.725926:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d1d79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490b8f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.726062:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2800/0xa762dfcbd58d1d80 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.726078:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2800/0xa762dfcbd58d1d80 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.726111:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2800/0xa762dfcbd58d1d80 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843603.726125:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788843603.726326:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d1d79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b8f expref: 26 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.726351:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2800/0xa762dfcbd58d1d80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b8f expref: 25 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.726361:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bd007450c00) 00010000:00010000:3.0:1788843603.726365:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788843603.726368:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be2800, rc 0) 00000100:00100000:3.0:1788843603.726449:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+25:12366:x1875738116581120:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 589us (1134us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788843603.726456:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 202 00000100:00100000:2.0:1788843603.731129:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843603.731281:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116581248 00000100:00100000:3.0:1788843603.731294:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116581248 00000100:00100000:3.0:1788843603.732486:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 203 00000100:00100000:3.0:1788843603.732505:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+25:12366:x1875738116581248:12345-192.168.203.33@tcp:34:lfs.0 00010000:00010000:3.0:1788843603.732607:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1d8e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.732640:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1d8e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.732657:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1d8e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.732692:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1d95 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.732702:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1d95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.732710:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1d95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.732840:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3800/0xa762dfcbd58d1d9c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.732849:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3800/0xa762dfcbd58d1d9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.732856:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3800/0xa762dfcbd58d1d9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788843603.732919:0:9517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3800/0xa762dfcbd58d1d9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.732935:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1d8e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.732944:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1d8e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.732952:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1d8e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.732960:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be2c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1788843603.732966:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1d8e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.732989:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1d8e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.733006:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bd007450c00) 00010000:00010000:3.0:1788843603.733010:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843603.733016:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1d8e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.733024:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1d8e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.733038:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1d95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.733045:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1d95 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.733051:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1d95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.733057:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be2a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1788843603.733061:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1d95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.733067:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1d95 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.733075:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bd007450500) 00010000:00010000:3.0:1788843603.733078:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843603.733081:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1d95 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.733098:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1d95 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.733117:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3800/0xa762dfcbd58d1d9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.733123:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3800/0xa762dfcbd58d1d9c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.733130:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3800/0xa762dfcbd58d1d9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.733136:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be3800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1788843603.733183:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3800/0xa762dfcbd58d1d9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.733190:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3800/0xa762dfcbd58d1d9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.733200:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd007450100) 00010000:00010000:3.0:1788843603.733202:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843603.733205:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3800/0xa762dfcbd58d1d9c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.733210:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3800/0xa762dfcbd58d1d9c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843603.733328:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+25:12366:x1875738116581248:12345-192.168.203.33@tcp:34:lfs.0 Request processed in 827us (2211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843603.733337:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 203 00000100:00100000:3.0:1788843603.825179:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843603.825570:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116581504 00000100:00100000:2.0:1788843603.825585:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116581504 00000100:00100000:2.0:1788843603.825740:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 204 00000100:00100000:2.0:1788843603.825754:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+25:12369:x1875738116581504:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1788843603.825786:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843603.825816:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1da3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490b96 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.826943:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1daa lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.826965:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1daa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.826980:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1daa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.826998:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1db1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.827005:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1db1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.827012:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1db1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.827194:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1db8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.827228:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1db8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.827236:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1db8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843603.827249:0:6507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788843603.827731:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1daa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.827741:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1daa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.827748:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1daa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.827755:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843603.827760:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1daa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.827769:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1daa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.827786:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bd007450c00) 00010000:00010000:2.0:1788843603.827790:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843603.827796:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1daa lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.827803:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1daa lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.827816:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1db1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.827903:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1db1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.827909:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1db1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.827913:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843603.827916:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1db1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.827922:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1db1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.827931:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bd13dfda900) 00010000:00010000:2.0:1788843603.827934:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843603.827937:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1db1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.827944:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1db1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.828009:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1da3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b96 expref: 28 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.828029:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1db8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b96 expref: 27 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.828036:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd13dfdac00) 00010000:00010000:2.0:1788843603.828039:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843603.828048:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007946e00, rc 0) 00000100:00100000:2.0:1788843603.828429:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+27:12369:x1875738116581504:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2675us (3297us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1788843603.828441:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 204 00000100:00100000:3.0:1788843603.831716:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843603.831807:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116581632 00000100:00100000:2.0:1788843603.831820:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116581632 00000100:00100000:2.0:1788843603.831910:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 205 00000100:00100000:2.0:1788843603.831923:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+27:12369:x1875738116581632:12345-192.168.203.33@tcp:54:lfs.0 00010000:00010000:2.0:1788843603.832022:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1dc6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.832046:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.832060:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.832109:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.832117:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1dc6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.832125:0:11996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1dc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.832132:0:11996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843603.832180:0:11996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1dc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.832190:0:11996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1dc6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.832223:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd13dfdac00) 00010000:00010000:2.0:1788843603.832226:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788843603.832232:0:11996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1dc6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.832238:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1dc6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843603.832330:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+27:12369:x1875738116581632:12345-192.168.203.33@tcp:54:lfs.0 Request processed in 410us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843603.832339:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 205 00000100:00100000:3.0:1788843603.836233:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843603.836302:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116581888 00000100:00100000:0.0:1788843603.836316:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116581888 00000100:00100000:0.0:1788843603.836391:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 51 00000100:00100000:0.0:1788843603.836404:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+27:12369:x1875738116581888:12345-192.168.203.33@tcp:35:lfs.0 00000100:00100000:0.0:1788843603.836695:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+28:12369:x1875738116581888:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 292us (475us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1788843603.836712:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 51 00000100:00100000:0.0:1788843603.863279:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843603.863352:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116582144 00000100:00100000:3.0:1788843603.863368:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116582144 00000100:00100000:2.0:1788843603.863549:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 206 00000100:00100000:2.0:1788843603.863562:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd006757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+28:11900:x1875738116582144:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:2.0:1788843603.863593:0:9517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843603.863620:0:9517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1dcd lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490b9d expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.863767:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1dd4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.863785:0:9517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1db8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b96 expref: 29 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.863794:0:9517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1dd4 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.864181:0:9517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1db8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b96 expref: 29 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.864222:0:9517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1db8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b96 expref: 29 pid: 6507 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843603.864239:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9517:1875738134467328:192.168.203.33@tcp:104: 00000100:00100000:2.0:1788843603.864487:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007475540 going to sleep for 11 seconds 00000100:00100000:3.0:1788843603.866960:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843603.866965:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9517:1875738134467328:192.168.203.33@tcp:104: 00010000:00010000:0.0:1788843603.867003:0:9517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1dd4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843603.867094:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116582272 00000100:00100000:1.0:1788843603.867104:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116582272 00010000:00010000:1.0:1788843603.867191:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1db8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b96 expref: 30 pid: 6507 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843603.867245:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 93 00000100:00100000:1.0:1788843603.867258:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+30:2389:x1875738116582272:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843603.867279:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843603.867287:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1db8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b96 expref: 30 pid: 6507 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.867302:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1db8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b96 expref: 30 pid: 6507 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.867330:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1db8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b96 expref: 30 pid: 6507 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.867360:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd13dfdac00) 00010000:00010000:1.0:1788843603.867366:0:6493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1dd4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.867376:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1dd4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.867385:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1dd4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843603.867412:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843603.867475:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+29:2389:x1875738116582272:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 220us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843603.867483:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 93 00010000:00010000:0.0:1788843603.867549:0:9517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1dd4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.867558:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1dd4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843603.867580:0:9517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788843603.867738:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1dcd lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b9d expref: 30 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.867767:0:9517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1dd4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b9d expref: 29 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.867776:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd13dfdac00) 00010000:00010000:0.0:1788843603.867779:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788843603.867781:0:9517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007946a00, rc 0) 00000100:00100000:0.0:1788843603.867808:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd006757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+29:11900:x1875738116582144:12345-192.168.203.33@tcp:101:bash.0 Request processed in 4249us (4544us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1788843603.867815:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 206 00000100:00100000:3.0:1788843603.871903:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843603.872422:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116582400 00000100:00100000:0.0:1788843603.872437:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116582400 00000100:00100000:0.0:1788843603.872801:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 207 00000100:00100000:0.0:1788843603.872815:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+29:11900:x1875738116582400:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:0.0:1788843603.872848:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843603.872876:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1de2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490ba4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.872923:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1de9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.872940:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1de9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.872953:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1de9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.873108:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1de2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ba4 expref: 31 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.873202:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1de9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ba4 expref: 30 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.873213:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd13dfdac00) 00010000:00010000:0.0:1788843603.873216:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788843603.873221:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3d200, rc 0) 00000100:00100000:0.0:1788843603.873770:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+30:11900:x1875738116582400:12345-192.168.203.33@tcp:101:bash.0 Request processed in 954us (1879us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843603.873780:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 207 00000100:00100000:3.0:1788843603.877098:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843603.877246:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116582656 00000100:00100000:2.0:1788843603.877259:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116582656 00000100:00100000:2.0:1788843603.877330:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 208 00000100:00100000:2.0:1788843603.877342:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+30:11900:x1875738116582656:12345-192.168.203.33@tcp:36:bash.0 00010000:00010000:2.0:1788843603.877678:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1df0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.877701:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1df0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.877714:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1df0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788843603.877765:0:6508:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:2.0:1788843603.877794:0:6508:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000024649a2d reply state 000000002677c34b transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1df0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.877808:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1df0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843603.877815:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd13dfdac00) 00010000:00010000:2.0:1788843603.877819:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788843603.877823:0:6508:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788843603.877888:0:6508:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:2.0:1788843603.878021:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+34:11900:x1875738116582656:12345-192.168.203.33@tcp:36:bash.0 Request processed in 678us (935us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1788843603.878029:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 208 00000020:00080000:2.0:1788843603.878034:0:6508:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788843603.886104:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843603.886249:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116582784 00000100:00100000:0.0:1788843603.886264:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116582784 00000100:00100000:0.0:1788843603.886344:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 209 00000100:00100000:0.0:1788843603.886356:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+34:11900:x1875738116582784:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:0.0:1788843603.886389:0:9517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843603.886417:0:9517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1df7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490bab expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.886508:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1df7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bab expref: 35 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.886526:0:9517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1df7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bab expref: 35 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.886547:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd13dfdac00) 00010000:00010000:0.0:1788843603.886551:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788843603.886575:0:9517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3dc00, rc 0) 00000100:00100000:0.0:1788843603.886657:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+35:11900:x1875738116582784:12345-192.168.203.33@tcp:101:bash.0 Request processed in 303us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843603.886665:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 209 00000100:00100000:0.0:1788843603.890313:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843603.890454:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116582912 00000100:00100000:3.0:1788843603.890468:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116582912 00000100:00100000:3.0:1788843603.890556:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 66 00000100:00100000:3.0:1788843603.890568:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd006754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:11900:x1875738116582912:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:3.0:1788843603.890591:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843603.890620:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0acc4a0/0xa762dfcbd58d1dfe lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490bb2 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788843603.890653:0:8424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f9651, atime: 0x6a9f964f, ctime: 0x6a9f9651, blocks: 0x8 00010000:00010000:3.0:1788843603.890684:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=381s v=(0 0) 00010000:00010000:3.0:1788843603.890689:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843603.890700:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0acc4a0/0xa762dfcbd58d1dfe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bb2 expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.890719:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b0acc4a0/0xa762dfcbd58d1dfe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bb2 expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843603.890735:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be3800, rc 0) 00000100:00100000:3.0:1788843603.890831:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd006754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:11900:x1875738116582912:12345-192.168.203.33@tcp:101:bash.0 Request processed in 264us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843603.890838:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 66 00000100:00100000:3.0:1788843603.898723:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843603.898855:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116583040 00000100:00100000:0.0:1788843603.898869:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116583040 00002000:00010000:0.0:1788843603.898924:0:8428:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:0.0:1788843603.898929:0:8428:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd00799aa00 with x1875738116583040 ext(0->18446744073709551615) 00002000:00010000:0.0:1788843603.898946:0:8428:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bd00799aa00. 00000100:00100000:0.0:1788843603.898990:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 5 00000100:00100000:0.0:1788843603.899003:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00799aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:2389:x1875738116583040:12345-192.168.203.33@tcp:10:bash.0 00002000:00010000:1.0:1788843603.899530:0:8428:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788843603.899536:0:8428:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788843601 -> 1788843603 00002000:00010000:1.0:1788843603.899540:0:8428:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1788843599 -> 1788843599 00002000:00010000:1.0:1788843603.899542:0:8428:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788843601 -> 1788843603 00002000:00010000:1.0:1788843603.899544:0:8428:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1788843603.899629:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00799aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+9:2389:x1875738116583040:12345-192.168.203.33@tcp:10:bash.0 Request processed in 626us (918us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1788843603.899638:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 5 00002000:00010000:1.0:1788843603.899642:0:8428:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:1.0:1788843603.899645:0:8428:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd00799aa00 with x1875738116583040 ext(0->18446744073709551615) 00002000:00010000:1.0:1788843603.899650:0:8428:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bd00799aa00. 00000100:00100000:2.0:1788843603.997291:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843603.997481:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116583168 00000100:00100000:0.0:1788843603.997496:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116583168 00000100:00100000:0.0:1788843603.997582:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 210 00000100:00100000:0.0:1788843603.997595:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+35:12383:x1875738116583168:12345-192.168.203.33@tcp:34:lfs.0 00010000:00010000:0.0:1788843603.997695:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1e05 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.997720:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1e05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.997736:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1e05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.997755:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1e0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.997763:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1e0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.997788:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1e0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.997898:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1e13 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.997909:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1e13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.997916:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1e13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788843603.997975:0:6507:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1e13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.997988:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1e05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.997995:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1e05 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.998001:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1e05 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.998008:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3c800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843603.998013:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1e05 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.998022:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1e05 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.998037:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bd007450c00) 00010000:00010000:0.0:1788843603.998047:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843603.998053:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1e05 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.998059:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1e05 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.998076:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1e0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.998082:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1e0c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.998088:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1e0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.998092:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843603.998095:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1e0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.998101:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1e0c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.998109:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bd00658b900) 00010000:00010000:0.0:1788843603.998111:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843603.998114:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1e0c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.998119:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1e0c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.998134:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1e13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.998220:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1e13 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.998226:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1e13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.998232:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3da00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843603.998235:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1e13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.998242:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1e13 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.998250:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd13dfdac00) 00010000:00010000:0.0:1788843603.998253:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843603.998257:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1e13 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843603.998263:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1e13 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843604.000178:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+35:12383:x1875738116583168:12345-192.168.203.33@tcp:34:lfs.0 Request processed in 2537us (2856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843604.000195:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 210 00000100:00100000:0.0:1788843604.072915:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843604.073050:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116583424 00000100:00100000:3.0:1788843604.073063:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116583424 00000100:00100000:2.0:1788843604.073217:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 211 00000100:00100000:2.0:1788843604.073235:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd006756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+35:12386:x1875738116583424:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1788843604.073261:0:9517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843604.073289:0:9517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947800/0xa762dfcbd58d1e1a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490bb9 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788843604.073332:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788843604.073391:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1e21 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.073413:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1e21 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.073429:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1e21 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.073447:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1e28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.073455:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1e28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.073462:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1e28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.074812:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1e2f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.074856:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1e2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.074867:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1e2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843604.074882:0:9517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788843604.074994:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1e21 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.075003:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1e21 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.075009:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1e21 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.075015:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843604.075020:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1e21 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.075029:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1e21 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.075044:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bd007450c00) 00010000:00010000:2.0:1788843604.075048:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843604.075054:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1e21 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.075060:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1e21 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.075077:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1e28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.075090:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1e28 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.075096:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1e28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.075102:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843604.075105:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1e28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.075112:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1e28 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.075121:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bd13dfda900) 00010000:00010000:2.0:1788843604.075124:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843604.075127:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1e28 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.075133:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1e28 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.075247:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947800/0xa762dfcbd58d1e1a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bb9 expref: 38 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.075264:0:9517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1e2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bb9 expref: 37 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.075272:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd13dfdac00) 00010000:00010000:2.0:1788843604.075275:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788843604.075285:0:9517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007947000, rc 0) 00000100:00100000:2.0:1788843604.075372:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd006756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+37:12386:x1875738116583424:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 2141us (2486us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1788843604.075383:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 211 00000100:00100000:1.0:1788843604.081007:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843604.081439:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116583552 00000100:00100000:2.0:1788843604.081454:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116583552 00000100:00100000:2.0:1788843604.081613:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 212 00000100:00100000:2.0:1788843604.081628:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+37:12386:x1875738116583552:12345-192.168.203.33@tcp:54:lfs.0 00010000:00010000:2.0:1788843604.081745:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1e3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.081769:0:11996:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1dd4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b9d expref: 37 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.081782:0:11996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1e3d lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.081828:0:11996:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1dd4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b9d expref: 37 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.081845:0:11996:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1dd4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b9d expref: 37 pid: 9517 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843604.081864:0:11996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079a4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11996:1875738134467456:192.168.203.33@tcp:104: 00000100:00100000:2.0:1788843604.082018:0:11996:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007475540 going to sleep for 11 seconds 00000100:00100000:3.0:1788843604.091974:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843604.092045:0:11996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079a4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11996:1875738134467456:192.168.203.33@tcp:104: 00010000:00010000:2.0:1788843604.092085:0:11996:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1e3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843604.094768:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116583808 00000100:00100000:0.0:1788843604.094791:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116583808 00000100:00100000:0.0:1788843604.095038:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 52 00000100:00100000:0.0:1788843604.095052:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+38:6161:x1875738116583808:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788843604.095494:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+39:6161:x1875738116583808:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 443us (3600us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1788843604.095504:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 52 00000100:00100000:0.0:1788843604.099191:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843604.099310:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116583936 00000100:00100000:3.0:1788843604.099324:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116583936 00010000:00010000:3.0:1788843604.099378:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1dd4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b9d expref: 39 pid: 9517 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843604.099429:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 94 00000100:00100000:3.0:1788843604.099441:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e878000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+39:2390:x1875738116583936:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843604.099470:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843604.099478:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1dd4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b9d expref: 39 pid: 9517 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.099494:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1dd4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b9d expref: 39 pid: 9517 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.099524:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d1dd4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b9d expref: 39 pid: 9517 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.099544:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd13dfdac00) 00010000:00010000:3.0:1788843604.099551:0:6492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1e3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.099586:0:6492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1e3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.099594:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1e3d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.099645:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788843604.101456:0:11996:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1e3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.101499:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1e3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.101557:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1e3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.101565:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1e3d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.101573:0:11996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1e3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.101580:0:11996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843604.101585:0:11996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1e3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.101593:0:11996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1e3d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.101613:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd13dfdac00) 00010000:00010000:1.0:1788843604.101616:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788843604.101621:0:11996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1e3d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.101626:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1e3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843604.102231:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e878000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+38:2390:x1875738116583936:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 2780us (3081us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843604.102244:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 94 00000100:00100000:1.0:1788843604.104429:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+37:12386:x1875738116583552:12345-192.168.203.33@tcp:54:lfs.0 Request processed in 22787us (23421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843604.104448:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 212 00000100:00100000:0.0:1788843604.110840:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843604.110987:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116584192 00000100:00100000:1.0:1788843604.111000:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116584192 00000100:00100000:1.0:1788843604.111075:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 53 00000100:00100000:1.0:1788843604.111087:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+37:12386:x1875738116584192:12345-192.168.203.33@tcp:35:lfs.0 00000100:00100000:1.0:1788843604.111426:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+38:12386:x1875738116584192:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 339us (611us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1788843604.111436:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 53 00010000:00010000:2.0:1788843604.122630:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843604.211247:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843604.211364:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116584448 00000100:00100000:0.0:1788843604.211376:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116584448 00000100:00100000:0.0:1788843604.211463:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 213 00000100:00100000:0.0:1788843604.211474:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+38:12397:x1875738116584448:12345-192.168.203.33@tcp:101:cat.0 00010000:00010000:0.0:1788843604.211504:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843604.211531:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1e44 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490bc0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.211623:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1e4b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.211641:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1e4b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.211655:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1e4b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.211671:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1e52 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.211677:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1e52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.211683:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1e52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.211850:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1e59 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.211860:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1e59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.211866:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1e59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843604.211877:0:6507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:0.0:1788843604.211977:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1e4b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.211985:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1e4b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.211992:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1e4b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.211998:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3c800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843604.212003:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1e4b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.212012:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1e4b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.212026:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bd007450c00) 00010000:00010000:0.0:1788843604.212029:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843604.212034:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1e4b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.212051:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1e4b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.212069:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1e52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.212074:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1e52 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.212081:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1e52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.212085:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3da00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843604.212088:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1e52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.212095:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1e52 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.212103:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bd00658b900) 00010000:00010000:0.0:1788843604.212106:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843604.212108:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1e52 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.212114:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1e52 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.212248:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1e44 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bc0 expref: 41 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.212265:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1e59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bc0 expref: 40 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.212278:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd13dfdac00) 00010000:00010000:0.0:1788843604.212280:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788843604.212283:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3d800, rc 0) 00000100:00100000:0.0:1788843604.212365:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+40:12397:x1875738116584448:12345-192.168.203.33@tcp:101:cat.0 Request processed in 892us (1132us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1788843604.212375:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 213 00000100:00100000:2.0:1788843604.217721:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843604.217842:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116584704 00000100:00100000:1.0:1788843604.217858:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116584704 00000100:00100000:1.0:1788843604.217948:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 54 00000100:00100000:1.0:1788843604.217963:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+40:12397:x1875738116584704:12345-192.168.203.33@tcp:35:cat.0 00000100:00100000:1.0:1788843604.218818:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+41:12397:x1875738116584704:12345-192.168.203.33@tcp:35:cat.0 Request processed in 850us (1103us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1788843604.218830:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 54 00000100:00100000:2.0:1788843604.240818:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843604.241017:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116584960 00000100:00100000:0.0:1788843604.241031:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116584960 00000100:00100000:0.0:1788843604.241126:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 214 00000100:00100000:0.0:1788843604.241166:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+41:12398:x1875738116584960:12345-192.168.203.33@tcp:36:rm.0 00010000:00010000:0.0:1788843604.241253:0:9517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1788843604.241290:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d1df7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bab expref: 41 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.241315:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d1e59 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bc0 expref: 40 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.241339:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1e2f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bb9 expref: 39 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.241354:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d1de9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ba4 expref: 38 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.241365:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd13dfdac00) 00010000:00010000:0.0:1788843604.241371:0:9517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788843604.241418:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1e67 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.241436:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1e67 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.241458:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1e67 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.241476:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1e6e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.241483:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1e6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.241490:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1e6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.241590:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1e75 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.241599:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1e75 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.241605:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1e75 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788843604.242089:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1788843604.242101:0:9517:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 382294959702ns, next at 383294956336ns, rc = 0 00010000:00010000:0.0:1788843604.242207:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1e7c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.242218:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1e7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.242239:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1e7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.242247:0:9517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1e7c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.242254:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1e7c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.242260:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1e7c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.242289:0:9517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843604.242313:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1e75 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.242320:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1e75 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.242541:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1e75 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.242548:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3c800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843604.242554:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1e75 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.242561:0:10329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843604.242562:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1e75 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.242574:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd13dfdac00) 00010000:00010000:0.0:1788843604.242578:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788843604.242594:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1e75 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.242600:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d1e75 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.242623:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1e67 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.242629:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1e67 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.242635:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1e67 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.242641:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843604.242643:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1e67 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.242650:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1e67 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.242657:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bd007450c00) 00010000:00010000:0.0:1788843604.242660:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843604.242662:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1e67 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.242668:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d1e67 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788843604.242678:0:9517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007dcc4170 reply state 00000000a2e6cf6c transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1e6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.242703:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1e6e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.242710:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bd00658b900) 00010000:00010000:0.0:1788843604.242712:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788843604.242715:0:9517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788843604.242964:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1e7c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.242972:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3ce00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843604.242975:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1e7c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.242982:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1e7c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.242992:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd13dfdac00) 00010000:00010000:1.0:1788843604.242994:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788843604.242998:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1e7c lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.243014:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1e7c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.243027:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843604.243028:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843604.243030:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843604.243650:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+39:12398:x1875738116584960:12345-192.168.203.33@tcp:36:rm.0 Request processed in 2501us (2836us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1788843604.243663:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 214 00000100:00100000:1.0:1788843604.311546:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843604.311708:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116585216 00000100:00100000:2.0:1788843604.311723:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116585216 00000100:00100000:2.0:1788843604.311812:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 215 00000100:00100000:2.0:1788843604.311826:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+39:12404:x1875738116585216:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:2.0:1788843604.311935:0:11996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843604.311970:0:11996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1e83 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490bc7 expref: -99 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.312244:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1e8a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.312267:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1e8a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.312281:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1e8a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.312295:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1e91 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.312303:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1e91 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.312310:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1e91 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788843604.315237:0:11996:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788843604.315953:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1e98 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.315976:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1e98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.315990:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1e98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.316037:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1e8a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.316045:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1e8a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.316053:0:11996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1e8a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.316060:0:11996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843604.316066:0:11996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1e8a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.316075:0:11996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1e8a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.316093:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bd007450c00) 00010000:00010000:2.0:1788843604.316096:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843604.316101:0:11996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1e8a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.316130:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1e8a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788843604.316177:0:11996:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ded2be14 reply state 00000000d3f533b8 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1e91 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.316197:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1e91 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.316203:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bd00658b900) 00010000:00010000:2.0:1788843604.316206:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788843604.316210:0:11996:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788843604.316260:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1e83 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bc7 expref: 42 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.316277:0:11996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1e98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bc7 expref: 41 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.316285:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd13dfda900) 00010000:00010000:2.0:1788843604.316287:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843604.316290:0:11996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007946e00, rc 0) 00000100:00100000:2.0:1788843604.316405:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+42:12404:x1875738116585216:12345-192.168.203.33@tcp:101:bash.0 Request processed in 4581us (4874us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1788843604.316416:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 215 00000100:00100000:2.0:1788843604.326920:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843604.327394:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116585344 00000100:00100000:0.0:1788843604.327407:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116585344 00000100:00100000:0.0:1788843604.327525:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 67 00000100:00100000:0.0:1788843604.327538:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2390:x1875738116585344:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:0.0:1788843604.327565:0:8423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843604.327595:0:8423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e06d8f1d/0xa762dfcbd58d1ea6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490bce expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788843604.327628:0:8423:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843604.327657:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=382s v=(0 0) 00010000:00010000:0.0:1788843604.327662:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843604.327674:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e06d8f1d/0xa762dfcbd58d1ea6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bce expref: 8 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.327697:0:8423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e06d8f1d/0xa762dfcbd58d1ea6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bce expref: 8 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.327741:0:8423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3c800, rc 0) 00000100:00080000:3.0:1788843604.327909:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843604.328204:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:2390:x1875738116585344:12345-192.168.203.33@tcp:101:bash.0 Request processed in 666us (1296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843604.328212:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 67 00000100:00100000:0.0:1788843604.341897:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843604.342098:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116585472 00000100:00100000:3.0:1788843604.342111:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116585472 00000100:00100000:3.0:1788843604.342223:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 68 00000100:00100000:3.0:1788843604.342236:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e87b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:12404:x1875738116585472:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:3.0:1788843604.342261:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843604.342288:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db0a7cef/0xa762dfcbd58d1ead lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490bd5 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.342344:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e06d8f1d/0xa762dfcbd58d1ea6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bce expref: 9 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.342355:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843604.342360:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843604.342366:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db0a7cef/0xa762dfcbd58d1ead lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bd5 expref: 9 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.342450:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e06d8f1d/0xa762dfcbd58d1ea6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bce expref: 9 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.342468:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e06d8f1d/0xa762dfcbd58d1ea6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bce expref: 9 pid: 8423 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843604.342488:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8424:1875738134467584:192.168.203.33@tcp:104: 00000100:00100000:3.0:1788843604.342651:0:8424:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00789cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788843604.351626:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843604.352010:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116585600 00000100:00100000:0.0:1788843604.352023:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116585600 00010000:00010000:0.0:1788843604.352091:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e06d8f1d/0xa762dfcbd58d1ea6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bce expref: 10 pid: 8423 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843604.352191:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 95 00000100:00100000:0.0:1788843604.352204:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13332b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+10:2390:x1875738116585600:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843604.352224:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843604.352254:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e06d8f1d/0xa762dfcbd58d1ea6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bce expref: 10 pid: 8423 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.352271:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e06d8f1d/0xa762dfcbd58d1ea6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bce expref: 10 pid: 8423 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.352304:0:7448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843604.352310:0:7448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843604.354005:0:7448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db0a7cef/0xa762dfcbd58d1ead lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bd5 expref: 10 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.354202:0:7448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db0a7cef/0xa762dfcbd58d1ead lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bd5 expref: 10 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.355215:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e06d8f1d/0xa762dfcbd58d1ea6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bce expref: 10 pid: 8423 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843604.355240:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8424:1875738134467584:192.168.203.33@tcp:104: 00010000:00010000:3.0:1788843604.355277:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db0a7cef/0xa762dfcbd58d1ead lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bd5 expref: 9 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.355295:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be2a00, rc 0) 00000100:00100000:3.0:1788843604.355387:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e87b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+9:12404:x1875738116585472:12345-192.168.203.33@tcp:101:bash.0 Request processed in 13152us (13504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843604.355397:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 68 00010000:00010000:1.0:1788843604.357789:0:7448:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000db0a7cef/0xa762dfcbd58d1ead lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bd5 expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843604.357824:0:7448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7448:1875738134467712:192.168.203.33@tcp:105: 00000100:00100000:1.0:1788843604.358023:0:7448:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0078933c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843604.361583:0:7448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7448:1875738134467712:192.168.203.33@tcp:105: 00010000:00010000:1.0:1788843604.361991:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843604.362073:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13332b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:2390:x1875738116585600:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 9870us (10461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843604.362087:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 95 00000100:00100000:2.0:1788843604.362782:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843604.363130:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116585856 00000100:00100000:3.0:1788843604.363170:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116585856 00000100:00100000:3.0:1788843604.363236:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 55 00000100:00100000:3.0:1788843604.363249:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+42:12404:x1875738116585856:12345-192.168.203.33@tcp:35:bash.0 00000100:00100000:3.0:1788843604.363779:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+43:12404:x1875738116585856:12345-192.168.203.33@tcp:35:bash.0 Request processed in 530us (1000us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1788843604.363788:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 55 00000100:00100000:2.0:1788843604.526093:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843604.527730:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116585984 00000100:00100000:3.0:1788843604.527749:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116585984 00000100:00100000:3.0:1788843604.527865:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 216 00000100:00100000:3.0:1788843604.527879:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+43:12420:x1875738116585984:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1788843604.527916:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843604.527945:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1eb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490bdc expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.528033:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d1ebb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.528053:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d1ebb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.528066:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d1ebb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843604.528120:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788843604.528124:0:6506:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788843604.528206:0:6506:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d1ebb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.528237:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1eb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bdc expref: 45 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.528262:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d1ebb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bdc expref: 44 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.528289:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bd007450c00) 00010000:00010000:3.0:1788843604.528293:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788843604.528297:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be2200, rc 0) 00000100:00100000:3.0:1788843604.528382:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+44:12420:x1875738116585984:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 505us (2303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843604.528391:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 216 00000100:00100000:0.0:1788843604.534210:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843604.534396:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116586240 00000100:00100000:2.0:1788843604.534410:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116586240 00000100:00100000:2.0:1788843604.534484:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 217 00000100:00100000:2.0:1788843604.534497:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+44:12420:x1875738116586240:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1788843604.534524:0:9517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843604.534551:0:9517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947800/0xa762dfcbd58d1ec2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490be3 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.534708:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1ec9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.534725:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1ec9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.534738:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1ec9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843604.534751:0:9517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788843604.535055:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947800/0xa762dfcbd58d1ec2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490be3 expref: 47 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.535078:0:9517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1ec9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490be3 expref: 46 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.535088:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd13dfda900) 00010000:00010000:2.0:1788843604.535092:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843604.535096:0:9517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007946c00, rc 0) 00000100:00100000:2.0:1788843604.535215:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+46:12420:x1875738116586240:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 720us (1021us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1788843604.535243:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 217 00000100:00100000:2.0:1788843604.539730:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843604.539792:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843604.539941:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116586496 00000100:00100000:1.0:1788843604.539955:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116586496 00000100:00100000:1.0:1788843604.540037:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 218 00000100:00100000:1.0:1788843604.540051:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+46:12420:x1875738116586496:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1788843604.540085:0:11996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843604.540113:0:11996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb400/0xa762dfcbd58d1ed7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490bea expref: -99 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.540303:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebe00/0xa762dfcbd58d1ede lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.540345:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebe00/0xa762dfcbd58d1ede lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.540360:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebe00/0xa762dfcbd58d1ede lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843604.540377:0:11996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788843604.540521:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb400/0xa762dfcbd58d1ed7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bea expref: 49 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.540544:0:11996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebe00/0xa762dfcbd58d1ede lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bea expref: 48 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.540555:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd13dfda900) 00010000:00010000:1.0:1788843604.540559:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788843604.540563:0:11996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fbebe00, rc 0) 00000100:00100000:1.0:1788843604.540648:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+48:12420:x1875738116586496:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 599us (932us total) trans 4294967487 rc 0/0 00000100:00100000:1.0:1788843604.540657:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 218 00000100:00100000:3.0:1788843604.540985:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116586624 00000100:00100000:3.0:1788843604.540993:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116586624 00000100:00100000:3.0:1788843604.541044:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 16 00000100:00100000:3.0:1788843604.541053:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+48:2387:x1875738116586624:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843604.541066:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843604.541086:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1ec9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490be3 expref: 48 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.541101:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd13dfda900) 00010000:00010000:3.0:1788843604.541105:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843604.541186:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+47:2387:x1875738116586624:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 134us (1393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843604.541193:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 16 00000100:00100000:2.0:1788843604.550452:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843604.550586:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116586752 00000100:00100000:1.0:1788843604.550601:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116586752 00000100:00100000:1.0:1788843604.550683:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 69 00000100:00100000:1.0:1788843604.550695:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:2390:x1875738116586752:12345-192.168.203.33@tcp:1:lfs.0 00010000:00010000:1.0:1788843604.550756:0:8901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c434ee5b/0xa762dfcbd58d1eec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.550783:0:8901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db0a7cef/0xa762dfcbd58d1ead lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bd5 expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.550813:0:8901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843604.550829:0:8901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788843604.550836:0:8901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c434ee5b/0xa762dfcbd58d1eec lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.550885:0:8901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000db0a7cef/0xa762dfcbd58d1ead lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bd5 expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.550903:0:8901:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000db0a7cef/0xa762dfcbd58d1ead lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bd5 expref: 8 pid: 8424 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843604.550923:0:8901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8901:1875738134467840:192.168.203.33@tcp:104: 00000100:00100000:1.0:1788843604.551050:0:8901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788843604.556767:0:8901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8901:1875738134467840:192.168.203.33@tcp:104: 00010000:00010000:1.0:1788843604.556809:0:8901:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c434ee5b/0xa762dfcbd58d1eec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843604.558128:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843604.558327:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116586880 00000100:00100000:1.0:1788843604.558341:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116586880 00002000:00100000:1.0:1788843604.558413:0:8427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9bd007241c00 x1875738116586880/t0(0) o4->f25f61b6-5faf-4e05-81a4-dea3dba05dc5@192.168.203.33@tcp:220/0 lens 504/0 e 0 to 0 dl 1788843615 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788843604.558427:0:8427:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd007241c00 with x1875738116586880 ext(0->8) 00010000:00010000:1.0:1788843604.558438:0:8427:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000db0a7cef/0xa762dfcbd58d1ead lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bd5 expref: 9 pid: 8424 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.558480:0:8427:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000db0a7cef/0xa762dfcbd58d1ead lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bd5 expref: 9 pid: 8424 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788843604.558489:0:8427:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bd007241c00 00000100:00100000:1.0:1788843604.558531:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 3 00000100:00100000:1.0:1788843604.558543:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+9:2388:x1875738116586880:12345-192.168.203.33@tcp:4:lfs.0 00000100:00100000:1.0:1788843604.559935:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+11:2388:x1875738116586880:12345-192.168.203.33@tcp:4:lfs.0 Request processed in 1382us (1807us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788843604.559950:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 3 00002000:00100000:1.0:1788843604.559964:0:8427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9bd007241c00 x1875738116586880/t4294967309(0) o4->f25f61b6-5faf-4e05-81a4-dea3dba05dc5@192.168.203.33@tcp:220/0 lens 504/448 e 0 to 0 dl 1788843615 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788843604.559978:0:8427:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd007241c00 with x1875738116586880 ext(0->8) 00010000:00010000:1.0:1788843604.559988:0:8427:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000db0a7cef/0xa762dfcbd58d1ead lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bd5 expref: 11 pid: 8424 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.560009:0:8427:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000db0a7cef/0xa762dfcbd58d1ead lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bd5 expref: 11 pid: 8424 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788843604.560017:0:8427:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bd007241c00 00000100:00100000:0.0:1788843604.562296:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843604.562406:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116587008 00000100:00100000:1.0:1788843604.562418:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116587008 00010000:00010000:1.0:1788843604.562484:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000db0a7cef/0xa762dfcbd58d1ead lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bd5 expref: 11 pid: 8424 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843604.562567:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 96 00000100:00100000:1.0:1788843604.562579:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+11:2387:x1875738116587008:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843604.562601:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788843604.562697:0:6493:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788843604.562702:0:6493:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788843603 00002000:00010000:1.0:1788843604.562704:0:6493:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788843603 00002000:00010000:1.0:1788843604.562707:0:6493:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788843603 00002000:00010000:1.0:1788843604.562709:0:6493:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788843604.562718:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000db0a7cef/0xa762dfcbd58d1ead lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bd5 expref: 11 pid: 8424 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.562734:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000db0a7cef/0xa762dfcbd58d1ead lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bd5 expref: 11 pid: 8424 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.562764:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db0a7cef/0xa762dfcbd58d1ead lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bd5 expref: 11 pid: 8424 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.562785:0:6493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788843604.562790:0:6493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788843604.562798:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c434ee5b/0xa762dfcbd58d1eec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.562809:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c434ee5b/0xa762dfcbd58d1eec lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.562938:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788843604.563095:0:8901:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c434ee5b/0xa762dfcbd58d1eec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.563106:0:8901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c434ee5b/0xa762dfcbd58d1eec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.563129:0:8901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c434ee5b/0xa762dfcbd58d1eec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.563138:0:8901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c434ee5b/0xa762dfcbd58d1eec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.563182:0:8901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c434ee5b/0xa762dfcbd58d1eec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.563190:0:8901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbeb400 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843604.563195:0:8901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c434ee5b/0xa762dfcbd58d1eec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.563206:0:8901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c434ee5b/0xa762dfcbd58d1eec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.563232:0:8901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c434ee5b/0xa762dfcbd58d1eec lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.563239:0:8901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c434ee5b/0xa762dfcbd58d1eec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843604.563409:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+10:2387:x1875738116587008:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 829us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843604.563419:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 96 00000100:00100000:2.0:1788843604.563831:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+9:2390:x1875738116586752:12345-192.168.203.33@tcp:1:lfs.0 Request processed in 13130us (13387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843604.563840:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 69 00000100:00100000:2.0:1788843604.567048:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843604.567246:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116587264 00000100:00100000:3.0:1788843604.567261:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116587264 00000100:00100000:3.0:1788843604.567369:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 56 00000100:00100000:3.0:1788843604.567381:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e1e6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+47:12420:x1875738116587264:12345-192.168.203.33@tcp:35:lfs.0 00000004:00010000:3.0:1788843604.567578:0:6510:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebe00/0xa762dfcbd58d1ede lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bea expref: 47 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788843604.567989:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:3.0:1788843604.568032:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1788843604.569125:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:2.0:1788843604.569396:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1ef3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.569420:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1e98 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bc7 expref: 51 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.569431:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1ef3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.569729:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1e98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bc7 expref: 51 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.569751:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1e98 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bc7 expref: 51 pid: 11996 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843604.569770:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007240700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6510:1875738134467968:192.168.203.33@tcp:104: 00000100:00100000:2.0:1788843604.570055:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12e08c480 going to sleep for 11 seconds 00000100:00100000:0.0:1788843604.574068:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843604.574427:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007240700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6510:1875738134467968:192.168.203.33@tcp:104: 00010000:00010000:2.0:1788843604.574532:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1ef3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843604.574603:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116587392 00000100:00100000:3.0:1788843604.574613:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116587392 00010000:00010000:3.0:1788843604.574749:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1e98 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bc7 expref: 52 pid: 11996 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843604.574921:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 97 00000100:00100000:3.0:1788843604.574936:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+52:2390:x1875738116587392:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843604.574961:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843604.574971:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1e98 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bc7 expref: 52 pid: 11996 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.574987:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1e98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bc7 expref: 52 pid: 11996 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.575017:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1e98 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bc7 expref: 52 pid: 11996 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.575038:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd13dfda900) 00010000:00010000:3.0:1788843604.575045:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1ef3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.575058:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1ef3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.575067:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1ef3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.575124:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843604.575229:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+51:2390:x1875738116587392:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 295us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843604.575237:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 97 00010000:00010000:2.0:1788843604.575311:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1ef3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.575330:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1ef3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788843604.575487:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:2.0:1788843604.575637:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1788843604.575744:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007240700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6510:1875738134468096:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788843604.578479:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843604.578534:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12e08c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843604.578591:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134468096 00000100:00100000:1.0:1788843604.578605:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134468096 00000100:00100000:1.0:1788843604.578774:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788843604.578785:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6510:x1875738134468096:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788843604.579056:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6510:x1875738134468096:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 272us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843604.579063:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00080000:3.0:1788843604.579420:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788843604.580017:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007240700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6510:1875738134468096:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788843604.580226:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1788843604.580303:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6510:1875738134468224:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788843604.580358:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843604.580394:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12e08c780 going to sleep for 11 seconds 00000100:00100000:3.0:1788843604.582264:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134468224 00000100:00100000:3.0:1788843604.582277:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134468224 00000100:00100000:3.0:1788843604.582353:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788843604.582364:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6510:x1875738134468224:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788843604.582563:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6510:x1875738134468224:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 202us (2204us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788843604.582572:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788843604.582684:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6510:1875738134468224:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788843604.582748:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:0.0:1788843604.582805:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1ef3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.582815:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1ef3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.582822:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1ef3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.582828:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843604.582832:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1ef3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.582840:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1ef3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.582865:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd13dfda900) 00010000:00010000:0.0:1788843604.582868:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788843604.582872:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1ef3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.582903:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1ef3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788843604.583015:0:6510:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788843604.583073:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1788843604.583084:0:6510:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 382635942307ns, next at 383635940275ns, rc = 0 00000001:00080000:0.0:1788843604.583090:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:0.0:1788843604.583113:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd13dfda900) 00010000:00010000:0.0:1788843604.583117:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788843604.583124:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebe00/0xa762dfcbd58d1ede lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bea expref: 55 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843604.583267:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e1e6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+54:12420:x1875738116587264:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 15888us (16235us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1788843604.583276:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 56 00000020:00080000:0.0:1788843604.583280:0:6510:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788843604.589104:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843604.589331:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116587520 00000100:00100000:3.0:1788843604.589342:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116587520 00000100:00100000:3.0:1788843604.589396:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 219 00000100:00100000:3.0:1788843604.589408:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+54:12420:x1875738116587520:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1788843604.589430:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843604.589453:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2e00/0xa762dfcbd58d1efa lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490bf1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.589510:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2e00/0xa762dfcbd58d1efa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bf1 expref: 55 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.589526:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2e00/0xa762dfcbd58d1efa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bf1 expref: 55 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.589565:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd007450300) 00010000:00010000:3.0:1788843604.589569:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788843604.589573:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be2e00, rc 0) 00000100:00100000:3.0:1788843604.589632:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+55:12420:x1875738116587520:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 226us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843604.589639:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 219 00000100:00100000:3.0:1788843604.596306:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843604.599259:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116587776 00000100:00100000:1.0:1788843604.599276:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116587776 00000100:00100000:1.0:1788843604.599356:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 57 00000100:00100000:1.0:1788843604.599367:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+55:12420:x1875738116587776:12345-192.168.203.33@tcp:35:lfs.0 00000100:00100000:1.0:1788843604.599608:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+56:12420:x1875738116587776:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 241us (3316us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788843604.599615:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 57 00000100:00100000:0.0:1788843604.713091:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843604.713228:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116587904 00000100:00100000:3.0:1788843604.713246:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116587904 00000100:00100000:3.0:1788843604.713335:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 220 00000100:00100000:3.0:1788843604.713348:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+56:12430:x1875738116587904:12345-192.168.203.33@tcp:34:lfs.0 00010000:00010000:3.0:1788843604.713470:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1f01 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.713493:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1f01 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.713507:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1f01 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.713521:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1f08 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.713530:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1f08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.713537:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1f08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.713675:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1f0f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.713684:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1f0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.713691:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1f0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788843604.713755:0:6507:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1f0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.713771:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1f01 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.713779:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1f01 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.713787:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1f01 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.713792:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be2c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1788843604.713797:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1f01 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.713806:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1f01 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.713834:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bd007450c00) 00010000:00010000:3.0:1788843604.713839:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843604.713844:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1f01 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.713858:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1f01 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.715008:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1f08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.715023:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1f08 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.715031:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1f08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.715037:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be2a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1788843604.715041:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1f08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.715049:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1f08 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.715064:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bd00658b900) 00010000:00010000:3.0:1788843604.715067:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843604.715071:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1f08 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.715078:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1f08 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.715091:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1f0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.715097:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1f0f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.715115:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1f0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.715121:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be3000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1788843604.715124:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1f0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.715131:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1f0f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.715354:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd007450300) 00010000:00010000:3.0:1788843604.715358:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843604.715362:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1f0f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.715378:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1f0f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843604.715523:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+56:12430:x1875738116587904:12345-192.168.203.33@tcp:34:lfs.0 Request processed in 2171us (2433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843604.715535:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 220 00000100:00100000:2.0:1788843604.766870:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843604.769775:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116588160 00000100:00100000:3.0:1788843604.769799:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116588160 00000100:00100000:3.0:1788843604.769994:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 221 00000100:00100000:3.0:1788843604.770010:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+56:12433:x1875738116588160:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1788843604.770040:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843604.770070:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1f16 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490bf8 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.770234:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1f1d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.770265:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1f1d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.770280:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1f1d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.770292:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1f24 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.770300:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1f24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.770306:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1f24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.770445:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3200/0xa762dfcbd58d1f2b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.770469:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3200/0xa762dfcbd58d1f2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.770478:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3200/0xa762dfcbd58d1f2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843604.770489:0:6508:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788843604.770588:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1f1d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.770596:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1f1d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.770612:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1f1d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.770618:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be2a00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1788843604.770624:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1f1d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.770642:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1f1d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.770657:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bd007450c00) 00010000:00010000:3.0:1788843604.770661:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843604.770666:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1f1d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.770674:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1f1d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.770690:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1f24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.770697:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1f24 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.770704:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1f24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.770709:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be2c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1788843604.770712:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1f24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.770729:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1f24 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.770739:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bd00658b900) 00010000:00010000:3.0:1788843604.770741:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843604.770745:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1f24 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.770750:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1f24 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.770790:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1f16 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bf8 expref: 59 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.770807:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3200/0xa762dfcbd58d1f2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bf8 expref: 58 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.770815:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd007450300) 00010000:00010000:3.0:1788843604.770818:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788843604.770820:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be3200, rc 0) 00000100:00100000:3.0:1788843604.770921:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+58:12433:x1875738116588160:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 915us (4066us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788843604.770930:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 221 00000100:00100000:0.0:1788843604.774349:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843604.774447:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116588288 00000100:00100000:3.0:1788843604.774461:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116588288 00000100:00100000:3.0:1788843604.774539:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 222 00000100:00100000:3.0:1788843604.774552:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+58:12433:x1875738116588288:12345-192.168.203.33@tcp:54:lfs.0 00010000:00010000:3.0:1788843604.774677:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1f39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.774699:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1f39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.774713:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1f39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.774763:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1f39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.774771:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1f39 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.774778:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1f39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.774784:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be3c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1788843604.774789:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1f39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.774797:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1f39 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.774812:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd007450300) 00010000:00010000:3.0:1788843604.774815:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788843604.774822:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1f39 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.774829:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1f39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843604.774938:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+58:12433:x1875738116588288:12345-192.168.203.33@tcp:54:lfs.0 Request processed in 389us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843604.774947:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 222 00000100:00100000:0.0:1788843604.777406:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843604.777513:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116588544 00000100:00100000:1.0:1788843604.777526:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116588544 00000100:00100000:1.0:1788843604.777597:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 58 00000100:00100000:1.0:1788843604.777609:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141bfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+58:12433:x1875738116588544:12345-192.168.203.33@tcp:35:lfs.0 00000100:00100000:1.0:1788843604.777944:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141bfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+59:12433:x1875738116588544:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 337us (553us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1788843604.777977:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 58 00000100:00100000:0.0:1788843604.860895:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843604.861063:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116588800 00000100:00100000:3.0:1788843604.861078:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116588800 00000100:00100000:3.0:1788843604.861217:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 223 00000100:00100000:3.0:1788843604.861230:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+59:12443:x1875738116588800:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:3.0:1788843604.861264:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843604.861268:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788843604.861310:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d1ebb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bdc expref: 59 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.861336:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bd007450c00) 00010000:00010000:3.0:1788843604.861342:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788843604.861360:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1f40 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490bff expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.861522:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1f47 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.861540:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3200/0xa762dfcbd58d1f2b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bf8 expref: 59 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.861550:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1f47 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.861594:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3200/0xa762dfcbd58d1f2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bf8 expref: 59 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.861643:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3200/0xa762dfcbd58d1f2b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bf8 expref: 59 pid: 6508 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843604.861662:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6507:1875738134468352:192.168.203.33@tcp:104: 00000100:00100000:3.0:1788843604.861796:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00789cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788843604.866784:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843604.866983:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6507:1875738134468352:192.168.203.33@tcp:104: 00010000:00010000:0.0:1788843604.867020:0:6507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1f47 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843604.867102:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116588928 00000100:00100000:1.0:1788843604.867111:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116588928 00010000:00010000:1.0:1788843604.867206:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3200/0xa762dfcbd58d1f2b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bf8 expref: 60 pid: 6508 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843604.867244:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 98 00000100:00100000:1.0:1788843604.867255:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1060d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+60:2390:x1875738116588928:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843604.867275:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843604.867283:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3200/0xa762dfcbd58d1f2b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bf8 expref: 60 pid: 6508 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.867297:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3200/0xa762dfcbd58d1f2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bf8 expref: 60 pid: 6508 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.867326:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3200/0xa762dfcbd58d1f2b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bf8 expref: 60 pid: 6508 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.867346:0:7448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd007450300) 00010000:00010000:1.0:1788843604.867352:0:7448:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1f47 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.867363:0:7448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1f47 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.867372:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1f47 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.867427:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843604.867504:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1060d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+59:2390:x1875738116588928:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 250us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843604.867513:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 98 00010000:00010000:3.0:1788843604.868197:0:6507:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1f47 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.868207:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1f47 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843604.868234:0:6507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788843604.868408:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1f40 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bff expref: 60 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.868428:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1f47 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bff expref: 59 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.868437:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd007450300) 00010000:00010000:3.0:1788843604.868440:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788843604.868443:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be3c00, rc 0) 00000100:00100000:3.0:1788843604.868502:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+59:12443:x1875738116588800:12345-192.168.203.33@tcp:101:bash.0 Request processed in 7274us (7625us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788843604.868510:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 223 00000100:00100000:3.0:1788843604.872012:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843604.872933:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116589056 00000100:00100000:2.0:1788843604.872951:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116589056 00000100:00100000:2.0:1788843604.873038:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 224 00000100:00100000:2.0:1788843604.873051:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0085ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+59:12443:x1875738116589056:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:2.0:1788843604.873082:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843604.873120:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1f55 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490c06 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.873192:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947800/0xa762dfcbd58d1f5c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.873210:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947800/0xa762dfcbd58d1f5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.873223:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947800/0xa762dfcbd58d1f5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.873363:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1f55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c06 expref: 61 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.873386:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947800/0xa762dfcbd58d1f5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c06 expref: 60 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843604.873396:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd007450300) 00010000:00010000:2.0:1788843604.873399:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788843604.873402:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007947800, rc 0) 00000100:00100000:2.0:1788843604.873593:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0085ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+60:12443:x1875738116589056:12345-192.168.203.33@tcp:101:bash.0 Request processed in 544us (1595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843604.873601:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 224 00000100:00100000:0.0:1788843604.877942:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843604.878067:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116589312 00000100:00100000:1.0:1788843604.878080:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116589312 00000100:00100000:1.0:1788843604.878276:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 225 00000100:00100000:1.0:1788843604.878291:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+60:12443:x1875738116589312:12345-192.168.203.33@tcp:36:bash.0 00010000:00010000:1.0:1788843604.878610:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d1f63 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.878704:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d1f63 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.878719:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d1f63 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788843604.878776:0:11996:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:1.0:1788843604.878801:0:11996:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0b432fd reply state 000000008e4b842f transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d1f63 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.878815:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d1f63 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.878891:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd007450300) 00010000:00010000:1.0:1788843604.878895:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788843604.878900:0:11996:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788843604.879062:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+63:12443:x1875738116589312:12345-192.168.203.33@tcp:36:bash.0 Request processed in 772us (1132us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1788843604.879092:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 225 00000020:00080000:1.0:1788843604.879099:0:11996:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788843604.881804:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843604.881951:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116589440 00000100:00100000:3.0:1788843604.881961:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116589440 00000100:00100000:3.0:1788843604.882046:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 226 00000100:00100000:3.0:1788843604.882055:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+63:12443:x1875738116589440:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:3.0:1788843604.882081:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843604.882109:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d1f6a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490c0d expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.882335:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1f71 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.882354:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1f47 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bff expref: 64 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.882366:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1f71 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.882415:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1f47 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bff expref: 64 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.882430:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1f47 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bff expref: 64 pid: 6507 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843604.882448:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008625880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6507:1875738134468480:192.168.203.33@tcp:104: 00000100:00100000:3.0:1788843604.882554:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00789ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788843604.885237:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843604.885377:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008625880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6507:1875738134468480:192.168.203.33@tcp:104: 00010000:00010000:0.0:1788843604.885415:0:6507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1f71 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843604.885585:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116589568 00000100:00100000:1.0:1788843604.885595:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116589568 00010000:00010000:1.0:1788843604.885661:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1f47 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bff expref: 65 pid: 6507 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843604.885705:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 99 00000100:00100000:1.0:1788843604.885716:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008624000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+65:2390:x1875738116589568:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843604.885734:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843604.885742:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1f47 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bff expref: 65 pid: 6507 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.885755:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1f47 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bff expref: 65 pid: 6507 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.885783:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d1f47 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bff expref: 65 pid: 6507 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.885805:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd007450300) 00010000:00010000:1.0:1788843604.885810:0:6492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1f71 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.886038:0:6492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1f71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.886049:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1f71 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.886190:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843604.886260:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008624000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+64:2390:x1875738116589568:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 544us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843604.886270:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 99 00010000:00010000:0.0:1788843604.887942:0:6507:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1f71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.887965:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1f71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843604.888046:0:6507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788843604.888051:0:6507:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788843604.888079:0:6507:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1f71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.888133:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2200/0xa762dfcbd58d1f6a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c0d expref: 64 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.888243:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1f71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c0d expref: 63 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843604.888254:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd007450300) 00010000:00010000:0.0:1788843604.888257:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788843604.888262:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be2400, rc 0) 00000100:00100000:0.0:1788843604.888350:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+63:12443:x1875738116589440:12345-192.168.203.33@tcp:101:bash.0 Request processed in 6294us (6557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843604.888360:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 226 00000100:00100000:3.0:1788843604.892104:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843604.892782:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116589824 00000100:00100000:0.0:1788843604.892798:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116589824 00000100:00100000:0.0:1788843604.893017:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 59 00000100:00100000:0.0:1788843604.893057:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+63:12443:x1875738116589824:12345-192.168.203.33@tcp:35:bash.0 00000100:00100000:0.0:1788843604.893448:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+64:12443:x1875738116589824:12345-192.168.203.33@tcp:35:bash.0 Request processed in 391us (1358us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1788843604.893459:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 59 00000100:00100000:2.0:1788843604.965628:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843604.965816:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116589952 00000100:00100000:3.0:1788843604.965861:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116589952 00000100:00100000:3.0:1788843604.965960:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 227 00000100:00100000:3.0:1788843604.965978:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e2a0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+64:12449:x1875738116589952:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1788843604.966019:0:9517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843604.966056:0:9517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1f78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490c14 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.966196:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1f7f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.966217:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1f7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.966237:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1f7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843604.966305:0:9517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788843604.966314:0:9517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788843604.966346:0:9517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1f7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.966379:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1f78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c14 expref: 66 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.966403:0:9517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1f7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c14 expref: 65 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.966414:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bd007450c00) 00010000:00010000:3.0:1788843604.966418:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788843604.966422:0:9517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be2c00, rc 0) 00000100:00100000:3.0:1788843604.966509:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e2a0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+65:12449:x1875738116589952:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 537us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843604.966517:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 227 00000100:00100000:3.0:1788843604.978318:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843604.978498:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116590080 00000100:00100000:1.0:1788843604.978511:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116590080 00000100:00100000:1.0:1788843604.978886:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 228 00000100:00100000:1.0:1788843604.978901:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+65:12449:x1875738116590080:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1788843604.978930:0:11996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843604.978958:0:11996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d1f86 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490c1b expref: -99 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.979038:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb000/0xa762dfcbd58d1f8d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.979057:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb000/0xa762dfcbd58d1f8d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.979070:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb000/0xa762dfcbd58d1f8d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.979082:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1f94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.979089:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1f94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.979096:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1f94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.979258:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea000/0xa762dfcbd58d1f9b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.979268:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea000/0xa762dfcbd58d1f9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.979275:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea000/0xa762dfcbd58d1f9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843604.979328:0:11996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788843604.979333:0:11996:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788843604.979356:0:11996:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea000/0xa762dfcbd58d1f9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.979370:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea000/0xa762dfcbd58d1f9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.979621:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb000/0xa762dfcbd58d1f8d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.979629:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb000/0xa762dfcbd58d1f8d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.979637:0:11996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb000/0xa762dfcbd58d1f8d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.979643:0:11996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbeb000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843604.979648:0:11996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb000/0xa762dfcbd58d1f8d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.979656:0:11996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb000/0xa762dfcbd58d1f8d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.979679:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bd007450c00) 00010000:00010000:1.0:1788843604.979682:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843604.979688:0:11996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb000/0xa762dfcbd58d1f8d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.979694:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb000/0xa762dfcbd58d1f8d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.979710:0:11996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1f94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.979717:0:11996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1f94 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.979722:0:11996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1f94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.979727:0:11996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbea600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843604.979730:0:11996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1f94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.979735:0:11996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1f94 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.979742:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bd00658b900) 00010000:00010000:1.0:1788843604.979744:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843604.979747:0:11996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1f94 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.979753:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d1f94 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.979908:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d1f86 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c1b expref: 67 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.979925:0:11996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea000/0xa762dfcbd58d1f9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c1b expref: 66 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.979933:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd007450300) 00010000:00010000:1.0:1788843604.979935:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788843604.979938:0:11996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fbea000, rc 0) 00000100:00100000:1.0:1788843604.980080:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+66:12449:x1875738116590080:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1182us (1776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843604.980089:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 228 00000100:00100000:0.0:1788843604.992796:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843604.993012:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116590336 00000100:00100000:3.0:1788843604.993026:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116590336 00000100:00100000:3.0:1788843604.993103:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 229 00000100:00100000:3.0:1788843604.993116:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+66:12449:x1875738116590336:12345-192.168.203.33@tcp:101:lfs.0 00000100:00100000:0.0:1788843604.993426:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843604.993493:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116590464 00000100:00100000:1.0:1788843604.993498:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116590464 00000100:00100000:1.0:1788843604.993548:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 17 00000100:00100000:1.0:1788843604.993556:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+67:2387:x1875738116590464:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843604.993577:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843604.993609:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea000/0xa762dfcbd58d1f9b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c1b expref: 67 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843604.993636:0:7448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd007450300) 00010000:00010000:1.0:1788843604.993642:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843604.993715:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+66:2387:x1875738116590464:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 158us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843604.993723:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 17 00010000:00010000:3.0:1788843604.994902:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843604.994939:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1fa2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490c22 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.995088:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1fa9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.995110:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1f71 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c0d expref: 66 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.995121:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1fa9 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.996994:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1f71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c0d expref: 66 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843604.997022:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1f71 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c0d expref: 66 pid: 6507 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843604.997042:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008626d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6507:1875738134468608:192.168.203.33@tcp:104: 00000100:00100000:3.0:1788843604.997500:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00789c600 going to sleep for 11 seconds 00000100:00100000:0.0:1788843605.009209:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843605.010632:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116590592 00000100:00100000:1.0:1788843605.010658:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116590592 00010000:00010000:1.0:1788843605.010719:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1f71 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c0d expref: 67 pid: 6507 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843605.010779:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 100 00000100:00100000:1.0:1788843605.010790:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13332bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+67:2389:x1875738116590592:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843605.010812:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843605.010829:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1f71 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c0d expref: 67 pid: 6507 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843605.010846:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1f71 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c0d expref: 67 pid: 6507 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843605.010877:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd007450300) 00010000:00010000:1.0:1788843605.010884:0:6492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1fa9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843605.010895:0:6492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1fa9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843605.010903:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1fa9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843605.010925:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843605.011008:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13332bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+67:2389:x1875738116590592:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 220us (1816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843605.011015:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 100 00010000:00010000:3.0:1788843605.011975:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d1f71 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c0d expref: 66 pid: 6507 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843605.012004:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008626d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6507:1875738134468608:192.168.203.33@tcp:104: 00010000:00010000:3.0:1788843605.012033:0:6507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1fa9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.012044:0:6507:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1fa9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.012050:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1fa9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843605.012077:0:6507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788843605.012469:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d1fa2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c22 expref: 67 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.012491:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1fa9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c22 expref: 66 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.012500:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd007450300) 00010000:00010000:3.0:1788843605.012503:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788843605.012506:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be2a00, rc 0) 00000100:00100000:3.0:1788843605.012595:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+66:12449:x1875738116590336:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 19473us (19806us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1788843605.012604:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 229 00000100:00100000:0.0:1788843605.017393:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843605.017507:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116590848 00000100:00100000:1.0:1788843605.017539:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116590848 00000100:00100000:1.0:1788843605.017670:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 18 00000100:00100000:1.0:1788843605.017683:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+66:12449:x1875738116590848:12345-192.168.203.33@tcp:103:lfs.0 00010000:00010000:1.0:1788843605.017703:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843605.017737:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2e00/0xa762dfcbd58d1efa lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bf1 expref: 66 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843605.017760:0:7448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd007450300) 00010000:00010000:1.0:1788843605.017767:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843605.018005:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+65:12449:x1875738116590848:12345-192.168.203.33@tcp:103:lfs.0 Request processed in 324us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843605.018014:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 18 00000100:00100000:0.0:1788843605.022401:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843605.022567:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116590976 00000100:00100000:2.0:1788843605.022580:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116590976 00000100:00100000:2.0:1788843605.022741:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 230 00000100:00100000:2.0:1788843605.022755:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+65:12449:x1875738116590976:12345-192.168.203.33@tcp:58:lfs.0 00010000:00010000:2.0:1788843605.022930:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1fb7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.022951:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1fb7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.022963:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1fb7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788843605.023110:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1788843605.023348:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+65:12449:x1875738116590976:12345-192.168.203.33@tcp:58:lfs.0 Request processed in 595us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843605.023356:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 230 00000100:00100000:2.0:1788843605.028699:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843605.028804:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116591104 00000100:00100000:1.0:1788843605.028817:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116591104 00000100:00100000:1.0:1788843605.028898:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 231 00000100:00100000:1.0:1788843605.028910:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+65:12449:x1875738116591104:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1788843605.028938:0:11996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843605.028966:0:11996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea000/0xa762dfcbd58d1fbe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490c29 expref: -99 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843605.029036:0:11996:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1fb7 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843605.029049:0:11996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea000/0xa762dfcbd58d1fbe lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c29 expref: 66 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843605.029073:0:11996:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1fb7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843605.029112:0:11996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea000/0xa762dfcbd58d1fbe lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c29 expref: 66 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843605.029130:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd007450300) 00010000:00010000:1.0:1788843605.029134:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788843605.029137:0:11996:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea000/0xa762dfcbd58d1fbe lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c29 expref: 66 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843605.029198:0:11996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fbea000, rc 0) 00000100:00100000:1.0:1788843605.029265:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+66:12449:x1875738116591104:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 357us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843605.029273:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 231 00010000:00010000:0.0:1788843605.149400:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788843605.339720:0:13785:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788843605.339733:0:13785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788843605.339795:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1788843605.339822:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788843605.339991:0:13785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13785:1875738134468736:192.168.203.33@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788843605.340130:0:13785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788843605.343862:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843605.344004:0:13785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13785:1875738134468736:192.168.203.33@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788843605.350675:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116591232 00000100:00100000:3.0:1788843605.350721:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116591232 00000100:00100000:3.0:1788843605.351014:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 232 00000100:00100000:3.0:1788843605.351038:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+66:12450:x1875738116591232:12345-192.168.203.33@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788843605.351088:0:6507:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788843605.351646:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+66:12450:x1875738116591232:12345-192.168.203.33@tcp:53:lhsmtool_posix.0 Request processed in 619us (7797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843605.351657:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 232 00000100:00100000:0.0:1788843605.360917:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843605.361036:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116591360 00000100:00100000:2.0:1788843605.361048:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116591360 00000100:00100000:2.0:1788843605.361123:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 233 00000100:00100000:2.0:1788843605.361134:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+66:12450:x1875738116591360:12345-192.168.203.33@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788843605.361276:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1fc5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.361309:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1fc5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.361322:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1fc5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.361340:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1fcc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.361370:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1fcc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.361377:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1fcc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.361407:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1fd3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.361416:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.361422:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843605.361484:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788843605.361489:0:6506:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788843605.361506:0:6506:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.361518:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1fc5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.361526:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1fc5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.361534:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1fc5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.361540:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843605.361545:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1fc5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.361574:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1fc5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.361588:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd00746cd00) 00010000:00010000:2.0:1788843605.361591:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843605.361597:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1fc5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.361603:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d1fc5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.361623:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1fcc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.361628:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1fcc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.361633:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1fcc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.361637:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843605.361640:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1fcc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.361655:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1fcc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.361662:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9bd13dfda400) 00010000:00010000:2.0:1788843605.361664:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843605.361666:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1fcc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.361680:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1fcc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.361697:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.361702:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1fd3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.361707:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1fd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.361712:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843605.361715:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1fd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.361721:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1fd3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.361728:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd007450300) 00010000:00010000:2.0:1788843605.361730:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843605.361734:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1fd3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.361739:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1fd3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843605.361845:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+66:12450:x1875738116591360:12345-192.168.203.33@tcp:34:lhsmtool_posix.0 Request processed in 711us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843605.361858:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 233 00000100:00100000:0.0:1788843605.370101:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843605.370326:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116591616 00000100:00100000:2.0:1788843605.370340:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116591616 00000100:00100000:2.0:1788843605.370411:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 234 00000100:00100000:2.0:1788843605.370423:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+66:12450:x1875738116591616:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788843605.370450:0:9517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843605.370477:0:9517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1fda lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490c30 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.370625:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1fe1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.370824:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.370840:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843605.370853:0:9517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788843605.370956:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.370965:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1fe1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.370972:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1fe1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.370977:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843605.370982:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1fe1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.370991:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1fe1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.371023:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd007450300) 00010000:00010000:2.0:1788843605.371026:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788843605.371031:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1fe1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.371038:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d1fe1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.371091:0:9517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1fda lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c30 expref: 68 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.371103:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd00746cd00) 00010000:00010000:2.0:1788843605.371105:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788843605.371108:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947200/0xa762dfcbd58d1fda lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c30 expref: 68 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.371118:0:9517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007947200, rc 0) 00000100:00100000:2.0:1788843605.371428:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+67:12450:x1875738116591616:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 1005us (1340us total) trans 4294967505 rc 301/301 00000100:00100000:2.0:1788843605.371437:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 234 00000100:00100000:0.0:1788843605.375662:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843605.375809:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116591744 00000100:00100000:2.0:1788843605.375823:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116591744 00000100:00100000:2.0:1788843605.375902:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 235 00000100:00100000:2.0:1788843605.375915:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+67:12450:x1875738116591744:12345-192.168.203.33@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788843605.375963:0:6508:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788843605.376110:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+67:12450:x1875738116591744:12345-192.168.203.33@tcp:53:lhsmtool_posix.0 Request processed in 196us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843605.376185:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 235 00000100:00100000:0.0:1788843605.383297:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843605.385244:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116592000 00000100:00100000:1.0:1788843605.385267:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116592000 00000100:00100000:1.0:1788843605.385392:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 236 00000100:00100000:1.0:1788843605.385405:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+67:12450:x1875738116592000:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788843605.385433:0:11996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843605.385437:0:11996:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788843605.385491:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d1f7f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c14 expref: 67 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843605.385514:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bd007450c00) 00010000:00010000:1.0:1788843605.385520:0:11996:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788843605.385537:0:11996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d1fef lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490c37 expref: -99 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788843605.386042:0:11996:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:0.0:1788843605.387375:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1ff6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.387400:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.387412:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.387491:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea400/0xa762dfcbd58d1fef lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c37 expref: 69 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.387512:0:11996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1ff6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c37 expref: 68 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.387542:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9bd00658ba00) 00010000:00010000:0.0:1788843605.387545:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788843605.387549:0:11996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3ce00, rc 0) 00000100:00100000:0.0:1788843605.387773:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+68:12450:x1875738116592000:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 2369us (4490us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788843605.387784:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 236 00000100:00100000:0.0:1788843605.399341:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843605.399454:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116592256 00000100:00100000:2.0:1788843605.399468:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116592256 00000100:00100000:2.0:1788843605.399544:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 237 00000100:00100000:2.0:1788843605.399556:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+68:12450:x1875738116592256:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788843605.399632:0:9517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843605.399669:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d1ff6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c37 expref: 68 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.399697:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9bd00658ba00) 00010000:00010000:2.0:1788843605.399710:0:9517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788843605.399740:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d2004 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.399756:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d2004 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.399768:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d2004 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.399786:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d200b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xfa0a2d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.399794:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d200b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xfa0a2d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.399801:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d200b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xfa0a2d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.399888:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d2004 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.399897:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d2004 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.399904:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d2004 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.399911:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843605.399917:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d2004 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.399926:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d2004 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.399934:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bd007450c00) 00010000:00010000:2.0:1788843605.399938:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843605.399942:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d2004 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.399948:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946e00/0xa762dfcbd58d2004 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.399959:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d200b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xfa0a2d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.399965:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d200b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xfa0a2d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.399972:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d200b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xfa0a2d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.399984:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843605.399987:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d200b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xfa0a2d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.399993:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d200b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xfa0a2d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.400002:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xfa0a2d5 (ffff9bd13dfda400) 00010000:00010000:2.0:1788843605.400005:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843605.400008:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d200b lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xfa0a2d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.400013:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d200b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xfa0a2d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843605.400324:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+67:12450:x1875738116592256:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 Request processed in 768us (997us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788843605.400334:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 237 00000100:00100000:2.0:1788843605.403018:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788843605.403052:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008626d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134468864:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788843605.403181:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843605.403295:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134468864 00000100:00100000:3.0:1788843605.403306:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134468864 00000100:00100000:3.0:1788843605.403388:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788843605.403401:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134468864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788843605.403434:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843605.403495:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134468864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843605.403502:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788843605.403562:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008626d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134468864:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788843605.403690:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843605.407239:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843605.407293:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116592384 00000100:00100000:0.0:1788843605.407308:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116592384 00000100:00100000:0.0:1788843605.407388:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 238 00000100:00100000:0.0:1788843605.407403:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008626d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+67:12450:x1875738116592384:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788843605.407433:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843605.407467:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d2012 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490c3e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.407515:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d2019 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.407533:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d2019 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.407547:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d2019 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.407689:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d2012 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c3e expref: 69 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.407724:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d2019 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c3e expref: 68 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.407734:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9bd00658b200) 00010000:00010000:0.0:1788843605.407738:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788843605.407741:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3c800, rc 0) 00000100:00100000:0.0:1788843605.408067:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008626d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+68:12450:x1875738116592384:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 665us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843605.408076:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 238 00000100:00100000:3.0:1788843605.410330:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134469120:0@lo:400:kworker.0 00000100:00100000:3.0:1788843605.410431:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843605.410483:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134469632:0@lo:400:kworker.0 00000100:00100000:3.0:1788843605.410511:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843605.410532:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134470144:0@lo:400:kworker.0 00000100:00100000:3.0:1788843605.410555:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843605.410583:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788843605.410590:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134469248:0@lo:400:kworker.0 00000100:00100000:3.0:1788843605.410638:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843605.410659:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134469760:0@lo:400:kworker.0 00000100:00100000:3.0:1788843605.410681:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843605.410696:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134470272:0@lo:400:kworker.0 00000100:00100000:3.0:1788843605.410721:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843605.410767:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134469248 00000100:00100000:3.0:1788843605.410774:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134469248 00000100:00100000:3.0:1788843605.410828:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788843605.410839:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008625c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134469248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843605.410900:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008625c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134469248:12345-0@lo:400:kworker.0 Request processed in 62us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843605.410908:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788843605.410935:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134470272 00000100:00100000:3.0:1788843605.410938:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134470272 00000100:00100000:3.0:1788843605.410977:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788843605.410985:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008625f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134470272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843605.411017:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008625f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134470272:12345-0@lo:400:kworker.0 Request processed in 33us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843605.411024:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788843605.411044:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134468992:0@lo:400:kworker.0 00000100:00100000:3.0:1788843605.411077:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843605.411100:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134469504:0@lo:400:kworker.0 00000100:00100000:3.0:1788843605.411124:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843605.411396:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134469376:0@lo:400:kworker.0 00000100:00100000:0.0:1788843605.411433:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843605.411460:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134469888:0@lo:400:kworker.0 00000100:00100000:0.0:1788843605.411483:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843605.411500:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134470400:0@lo:400:kworker.0 00000100:00100000:0.0:1788843605.411522:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843605.411555:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134469888 00000100:00100000:0.0:1788843605.411559:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134469888 00000100:00100000:0.0:1788843605.411586:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134470400 00000100:00100000:0.0:1788843605.411590:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134470400 00000100:00100000:0.0:1788843605.411606:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788843605.411612:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3632:x1875738134469888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843605.411651:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3632:x1875738134469888:12345-0@lo:400:kworker.0 Request processed in 38us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843605.411658:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788843605.411671:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788843605.411688:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3632:x1875738134470400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843605.411717:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3632:x1875738134470400:12345-0@lo:400:kworker.0 Request processed in 31us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843605.411724:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788843605.411769:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134469888:0@lo:400:kworker.0 00000100:00100000:0.0:1788843605.411781:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134470400:0@lo:400:kworker.0 00000100:00100000:0.0:1788843605.411811:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134469120 00000100:00100000:0.0:1788843605.411814:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134469120 00000100:00100000:0.0:1788843605.411834:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134469632 00000100:00100000:0.0:1788843605.411836:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134469632 00000100:00100000:0.0:1788843605.411850:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134470144 00000100:00100000:0.0:1788843605.411853:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134470144 00000100:00100000:0.0:1788843605.411865:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134469760 00000100:00100000:0.0:1788843605.411868:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134469760 00000100:00100000:0.0:1788843605.411879:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134469376 00000100:00100000:0.0:1788843605.411882:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134469376 00000100:00100000:0.0:1788843605.411896:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788843605.411902:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008624700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134469120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843605.411937:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008624700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134469120:12345-0@lo:400:kworker.0 Request processed in 35us (1508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843605.411944:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788843605.411956:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1788843605.411962:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134469632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843605.411992:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134469632:12345-0@lo:400:kworker.0 Request processed in 30us (1481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843605.411999:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1788843605.412010:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1788843605.412024:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008626a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134470144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843605.412056:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008626a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134470144:12345-0@lo:400:kworker.0 Request processed in 33us (1500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843605.412063:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1788843605.412076:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1788843605.412082:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008624380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134469760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843605.412110:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008624380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134469760:12345-0@lo:400:kworker.0 Request processed in 29us (1429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843605.412116:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1788843605.412127:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788843605.412133:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134469376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843605.412270:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1875738134470016:0@lo:400:kworker.0 00000100:00100000:3.0:1788843605.412299:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843605.412341:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134469504 00000100:00100000:3.0:1788843605.412345:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134469504 00000100:00100000:3.0:1788843605.412377:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788843605.412384:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008627b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134469504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843605.412423:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008627b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134469504:12345-0@lo:400:kworker.0 Request processed in 39us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843605.412429:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788843605.412465:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134469248:0@lo:400:kworker.0 00010000:00080000:3.0:1788843605.412485:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141b9c000 x1875738134469760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843605.412497:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134469760:0@lo:400:kworker.0 00000100:00100000:3.0:1788843605.412509:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134470272:0@lo:400:kworker.0 00000100:00100000:3.0:1788843605.412521:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134469120:0@lo:400:kworker.0 00000100:00100000:3.0:1788843605.412531:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134469632:0@lo:400:kworker.0 00010000:00080000:3.0:1788843605.412542:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141b9c380 x1875738134470144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843605.412551:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134470144:0@lo:400:kworker.0 00000100:00100000:3.0:1788843605.412607:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134469504:0@lo:400:kworker.0 00000100:00100000:3.0:1788843605.412639:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134470016 00000100:00100000:3.0:1788843605.412642:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134470016 00000100:00100000:3.0:1788843605.412665:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1788843605.412672:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875738134470016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843605.412709:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875738134470016:12345-0@lo:400:kworker.0 Request processed in 37us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843605.412722:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1788843605.412750:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1875738134470016:0@lo:400:kworker.0 00000100:00080000:3.0:1788843605.412799:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788843605.412805:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788843605.412808:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788843605.412832:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134468992 00000100:00100000:3.0:1788843605.412836:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134468992 00000100:00100000:3.0:1788843605.412863:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1788843605.412871:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3633:x1875738134468992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843605.412908:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3633:x1875738134468992:12345-0@lo:400:kworker.0 Request processed in 38us (1831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843605.412915:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1788843605.412951:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134468992:0@lo:400:kworker.0 00000100:00100000:0.0:1788843605.413190:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134469376:12345-0@lo:400:kworker.0 Request processed in 1056us (1756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843605.413197:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1788843605.415752:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134469376:0@lo:400:kworker.0 00000100:00100000:0.0:1788843605.421682:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843605.421832:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116592640 00000100:00100000:3.0:1788843605.421846:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116592640 00000100:00100000:3.0:1788843605.421925:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 239 00000100:00100000:3.0:1788843605.421938:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+68:12450:x1875738116592640:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788843605.422054:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d2020 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.422079:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d2020 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.422094:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d2020 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788843605.422529:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:3.0:1788843605.422558:0:6506:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 383475416137ns, next at 384475396941ns, rc = 0 00000004:00010000:3.0:1788843605.422619:0:6506:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000066d91030 reply state 00000000168288df transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d2020 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.422635:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d2020 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.422643:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9bd00658b200) 00010000:00010000:3.0:1788843605.422646:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788843605.422650:0:6506:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788843605.422780:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+70:12450:x1875738116592640:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 Request processed in 842us (1112us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1788843605.422789:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 239 00000100:00100000:1.0:1788843605.429014:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843605.429233:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116592768 00000100:00100000:3.0:1788843605.429247:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116592768 00000100:00100000:3.0:1788843605.429328:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 240 00000100:00100000:3.0:1788843605.429395:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+70:12450:x1875738116592768:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788843605.429430:0:9517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843605.429458:0:9517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d2027 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490c45 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.429534:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d2027 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c45 expref: 71 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.429553:0:9517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d2027 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c45 expref: 71 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.429601:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9bd00658b200) 00010000:00010000:3.0:1788843605.429605:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788843605.429610:0:9517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be2400, rc 0) 00000100:00100000:3.0:1788843605.430030:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+71:12450:x1875738116592768:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 516us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843605.437004:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843605.438941:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116592896 00000100:00100000:2.0:1788843605.438963:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116592896 00000100:00100000:2.0:1788843605.439086:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 70 00000100:00100000:2.0:1788843605.439099:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+9:2389:x1875738116592896:12345-192.168.203.33@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788843605.439455:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+10:2389:x1875738116592896:12345-192.168.203.33@tcp:2:lhsmtool_posix.0 Request processed in 357us (2465us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788843605.439484:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 70 00000100:00080000:2.0:1788843605.439509:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788843605.444378:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 240 00000100:00100000:1.0:1788843605.445251:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843605.445593:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116593152 00000100:00100000:2.0:1788843605.445607:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116593152 00000100:00100000:2.0:1788843605.445676:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 60 00000100:00100000:2.0:1788843605.445688:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+71:12450:x1875738116593152:12345-192.168.203.33@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788843605.445980:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+72:12450:x1875738116593152:12345-192.168.203.33@tcp:35:lhsmtool_posix.0 Request processed in 293us (734us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1788843605.445988:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 60 00000100:00100000:1.0:1788843605.448435:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843605.448551:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116593408 00000100:00100000:0.0:1788843605.448564:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116593408 00000100:00100000:0.0:1788843605.448645:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 241 00000100:00100000:0.0:1788843605.448659:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+72:12450:x1875738116593408:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788843605.448803:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+72:12450:x1875738116593408:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 Request processed in 146us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843605.448812:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 241 00000100:00100000:1.0:1788843605.451455:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843605.451995:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116593536 00000100:00100000:3.0:1788843605.452009:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116593536 00000100:00100000:3.0:1788843605.452110:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 242 00000100:00100000:3.0:1788843605.452124:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+72:12450:x1875738116593536:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788843605.452208:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843605.452241:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d202e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490c4c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.452457:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d2035 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.452478:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d2035 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.452492:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d2035 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843605.452553:0:6506:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788843605.452578:0:6506:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d2035 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.452613:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d202e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c4c expref: 74 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.452636:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d2035 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c4c expref: 73 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.452672:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9bd00658b200) 00010000:00010000:2.0:1788843605.452675:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788843605.452680:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007946c00, rc 0) 00000100:00100000:2.0:1788843605.452823:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+73:12450:x1875738116593536:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 700us (1384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843605.452831:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 242 00000100:00100000:1.0:1788843605.462543:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843605.462647:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116593664 00000100:00100000:3.0:1788843605.462660:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116593664 00000100:00100000:3.0:1788843605.462737:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 71 00000100:00100000:3.0:1788843605.462751:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fdaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+10:2390:x1875738116593664:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788843605.462774:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843605.462804:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffc5647f/0xa762dfcbd58d203c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490c53 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788843605.462835:0:8424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f9654, blocks: 0x0 00010000:00010000:3.0:1788843605.462866:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=383s v=(0 0) 00010000:00010000:3.0:1788843605.462871:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843605.462903:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffc5647f/0xa762dfcbd58d203c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c53 expref: 11 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.462928:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ffc5647f/0xa762dfcbd58d203c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c53 expref: 11 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.462945:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be3a00, rc 0) 00000100:00100000:3.0:1788843605.463029:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fdaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+11:2390:x1875738116593664:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 280us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843605.463037:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 71 00000100:00100000:1.0:1788843605.469878:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843605.469974:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116593920 00000100:00100000:3.0:1788843605.469987:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116593920 00000100:00100000:3.0:1788843605.470063:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 243 00000100:00100000:3.0:1788843605.470077:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+73:12450:x1875738116593920:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788843605.470532:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+73:12450:x1875738116593920:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 Request processed in 455us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843605.470542:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 243 00000100:00100000:1.0:1788843605.475194:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843605.475296:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116594048 00000100:00100000:2.0:1788843605.475310:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116594048 00000100:00100000:2.0:1788843605.475385:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 72 00000100:00100000:2.0:1788843605.475399:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+11:12450:x1875738116594048:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788843605.475423:0:8421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843605.475449:0:8421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d6e2f2d/0xa762dfcbd58d2043 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490c5a expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.475493:0:8421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ffc5647f/0xa762dfcbd58d203c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c53 expref: 12 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.475503:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843605.475508:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843605.475514:0:8421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d6e2f2d/0xa762dfcbd58d2043 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c5a expref: 12 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.475597:0:8421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ffc5647f/0xa762dfcbd58d203c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c53 expref: 12 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.475613:0:8421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ffc5647f/0xa762dfcbd58d203c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c53 expref: 12 pid: 8424 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843605.475642:0:8421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007243b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8421:1875738134470528:192.168.203.33@tcp:104: 00000100:00100000:2.0:1788843605.475785:0:8421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12e08cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788843605.479797:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843605.479925:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116594176 00000100:00100000:3.0:1788843605.479998:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116594176 00000100:00100000:2.0:1788843605.480056:0:8421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007243b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8421:1875738134470528:192.168.203.33@tcp:104: 00010000:00010000:2.0:1788843605.480096:0:8421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008d6e2f2d/0xa762dfcbd58d2043 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c5a expref: 13 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.480124:0:8421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007946e00, rc 0) 00000100:00100000:2.0:1788843605.480260:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+13:12450:x1875738116594048:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 4864us (5079us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843605.480272:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 72 00010000:00010000:0.0:1788843605.483606:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ffc5647f/0xa762dfcbd58d203c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c53 expref: 12 pid: 8424 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843605.483717:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 101 00000100:00100000:0.0:1788843605.483734:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+12:2389:x1875738116594176:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843605.483757:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843605.483787:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ffc5647f/0xa762dfcbd58d203c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c53 expref: 12 pid: 8424 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.483804:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ffc5647f/0xa762dfcbd58d203c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c53 expref: 12 pid: 8424 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.483836:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffc5647f/0xa762dfcbd58d203c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c53 expref: 12 pid: 8424 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.483858:0:6492:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843605.483863:0:6492:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843605.483874:0:6492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008d6e2f2d/0xa762dfcbd58d2043 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c5a expref: 11 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.483887:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d6e2f2d/0xa762dfcbd58d2043 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c5a expref: 11 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.483946:0:6492:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008d6e2f2d/0xa762dfcbd58d2043 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c5a expref: 11 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843605.483967:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079ba300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6492:1875738134470656:192.168.203.33@tcp:105: 00000100:00100000:0.0:1788843605.484113:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00749bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788843605.489749:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079ba300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6492:1875738134470656:192.168.203.33@tcp:105: 00010000:00010000:0.0:1788843605.489787:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843605.489853:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+11:2389:x1875738116594176:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 6125us (10075us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843605.489866:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 101 00000100:00100000:3.0:1788843605.490118:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843605.490887:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116594304 00000100:00100000:2.0:1788843605.490901:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116594304 00002000:00100000:2.0:1788843605.490966:0:8428:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9bd008625180 x1875738116594304/t0(0) o4->f25f61b6-5faf-4e05-81a4-dea3dba05dc5@192.168.203.33@tcp:221/0 lens 504/0 e 0 to 0 dl 1788843616 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788843605.490979:0:8428:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd008625180 with x1875738116594304 ext(0->12) 00002000:00010000:2.0:1788843605.490987:0:8428:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bd008625180 00000100:00100000:2.0:1788843605.491069:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 6 00000100:00100000:2.0:1788843605.491099:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008625180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+11:2390:x1875738116594304:12345-192.168.203.33@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788843605.495492:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008625180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+13:2390:x1875738116594304:12345-192.168.203.33@tcp:4:lhsmtool_posix.0 Request processed in 4376us (5357us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1788843605.495510:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 6 00002000:00100000:2.0:1788843605.495528:0:8428:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9bd008625180 x1875738116594304/t4294967321(0) o4->f25f61b6-5faf-4e05-81a4-dea3dba05dc5@192.168.203.33@tcp:221/0 lens 504/448 e 0 to 0 dl 1788843616 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788843605.495541:0:8428:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd008625180 with x1875738116594304 ext(0->12) 00002000:00010000:2.0:1788843605.495550:0:8428:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bd008625180 00000100:00100000:3.0:1788843605.499584:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843605.500593:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116594432 00000100:00100000:0.0:1788843605.500612:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116594432 00000100:00100000:0.0:1788843605.500714:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 244 00000100:00100000:0.0:1788843605.500728:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008624e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+73:12450:x1875738116594432:12345-192.168.203.33@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788843605.507338:0:6485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:1.0:1788843605.507367:0:6485:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:1.0:1788843605.507438:0:6485:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788843605.507467:0:6485:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bd12e08c0c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788843605.507472:0:6485:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd10f7f3e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bd12e08cb40 00000020:00080000:1.0:1788843605.507476:0:6485:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd10f7f3900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bd1092cda00 00000004:00080000:1.0:1788843605.507509:0:6485:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:1.0:1788843605.507540:0:6485:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bd1331cc0c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788843605.507543:0:6485:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd007a88200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bd10652b9c0 00000020:00080000:1.0:1788843605.507567:0:6485:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd007a88900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bd00792e800 00000100:00100000:3.0:1788843605.508492:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788843605.508521:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008625500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134470784:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788843605.508608:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843605.508668:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008626680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134470912:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788843605.508691:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843605.508727:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134470784 00000100:00100000:3.0:1788843605.508734:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134470784 00000100:00100000:3.0:1788843605.508785:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134470912 00000100:00100000:3.0:1788843605.508788:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134470912 00000100:00100000:3.0:1788843605.508823:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788843605.508831:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008624a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3632:x1875738134470784:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788843605.508863:0:8424:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:3.0:1788843605.508899:0:8424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000008b6bf6/0xa762dfcbd58d204a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.508927:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0acc4a0/0xa762dfcbd58d1dfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bb2 expref: 12 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.508937:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788843605.508941:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788843605.508946:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000008b6bf6/0xa762dfcbd58d204a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.508979:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b0acc4a0/0xa762dfcbd58d1dfe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bb2 expref: 12 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.508996:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b0acc4a0/0xa762dfcbd58d1dfe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bb2 expref: 12 pid: 8424 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843605.509009:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008624000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8424:1875738134471040:192.168.203.33@tcp:104: 00000100:00100000:3.0:1788843605.509079:0:8424:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00789c540 going to sleep for 11 seconds 00000020:00080000:0.0:1788843605.510924:0:6538:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1788843605.511014:0:6538:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788843605.511032:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788843605.511053:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134471168:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788843605.511129:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843605.511202:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134471168 00000100:00100000:0.0:1788843605.511211:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134471168 00000100:00100000:0.0:1788843605.511257:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788843605.511269:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008625f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3630:x1875738134470912:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788843605.511405:0:8423:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788843605.511409:0:8423:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788843604 00002000:00010000:0.0:1788843605.511412:0:8423:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788843605.511414:0:8423:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788843604 -> 1788843604 00002000:00010000:0.0:1788843605.511417:0:8423:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788843605.511468:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008625f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3630:x1875738134470912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 201us (2775us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1788843605.511496:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788843605.511522:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788843605.511529:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3630:x1875738134471168:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788843605.511546:0:8423:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:0.0:1788843605.511578:0:8423:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f9653, atime: 0x6a9f9653, ctime: 0x6a9f9653, blocks: 0x8 00010000:00010000:0.0:1788843605.511586:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c35e77b/0xa762dfcbd58d2051 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.511604:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=383s v=(0 0) 00010000:00010000:0.0:1788843605.511608:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843605.511615:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c35e77b/0xa762dfcbd58d2051 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.511633:0:8423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c35e77b/0xa762dfcbd58d2051 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.511644:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c35e77b/0xa762dfcbd58d2051 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.511652:0:8423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c35e77b/0xa762dfcbd58d2051 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.511675:0:8423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1788843605.512357:0:3630:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd008626680/2, rc 0, transno 4294967322 00000100:00100000:1.0:1788843605.512371:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008626680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134470912:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788843605.512519:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008624e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+27:12450:x1875738116594432:12345-192.168.203.33@tcp:44:lhsmtool_posix.0 Request processed in 11790us (12947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843605.512528:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 244 00000100:00100000:0.0:1788843605.512842:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3630:x1875738134471168:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1313us (1712us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788843605.512851:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:0.0:1788843605.512886:0:6495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843605.512895:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c35e77b/0xa762dfcbd58d2051 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.512906:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d200 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843605.512911:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c35e77b/0xa762dfcbd58d2051 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.512923:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c35e77b/0xa762dfcbd58d2051 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.512946:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c35e77b/0xa762dfcbd58d2051 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.512954:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c35e77b/0xa762dfcbd58d2051 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.512981:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843605.512983:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843605.512985:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843605.518368:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843605.518480:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008624000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8424:1875738134471040:192.168.203.33@tcp:104: 00010000:00010000:3.0:1788843605.518515:0:8424:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000008b6bf6/0xa762dfcbd58d204a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843605.518763:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116594560 00000100:00100000:0.0:1788843605.518773:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116594560 00000100:00100000:0.0:1788843605.518840:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 76 00000100:00100000:0.0:1788843605.518852:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+13:2389:x1875738116594560:12345-192.168.203.33@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1788843605.519432:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1d48 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519446:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1d48 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519456:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1d48 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519463:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3cc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843605.519468:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1d48 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519479:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1d48 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519501:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9bd13dfda700) 00010000:00010000:2.0:1788843605.519505:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843605.519511:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1d48 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519531:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d1d48 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519572:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1df0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519579:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1df0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519586:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1df0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519591:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843605.519594:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1df0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519601:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1df0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519610:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9bd13dfdac00) 00010000:00010000:2.0:1788843605.519612:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843605.519616:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1df0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519622:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d1df0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519640:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1e6e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519647:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1e6e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519660:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1e6e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519666:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3da00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843605.519669:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1e6e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519677:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1e6e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519686:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bd00658b900) 00010000:00010000:2.0:1788843605.519688:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843605.519692:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1e6e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519711:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3da00/0xa762dfcbd58d1e6e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519728:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1e91 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519735:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1e91 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519741:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1e91 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519747:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843605.519750:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1e91 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519769:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1e91 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519779:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bd00658b900) 00010000:00010000:2.0:1788843605.519782:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843605.519785:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1e91 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519791:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d1e91 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519811:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d1f63 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519818:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d1f63 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519824:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d1f63 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519829:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbebc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843605.519831:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d1f63 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519836:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d1f63 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519843:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd007450300) 00010000:00010000:2.0:1788843605.519845:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843605.519847:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d1f63 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519859:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbebc00/0xa762dfcbd58d1f63 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519872:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d2020 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519878:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d2020 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519884:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d2020 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519889:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be3000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843605.519892:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d2020 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519899:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d2020 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519909:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9bd00658b200) 00010000:00010000:2.0:1788843605.519912:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788843605.519915:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d2020 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.519922:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3000/0xa762dfcbd58d2020 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843605.520724:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843605.521064:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116594688 00000100:00100000:0.0:1788843605.521078:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116594688 00010000:00010000:0.0:1788843605.521124:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b0acc4a0/0xa762dfcbd58d1dfe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bb2 expref: 14 pid: 8424 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843605.521224:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 102 00000100:00100000:0.0:1788843605.521236:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008624000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+14:2389:x1875738116594688:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843605.521259:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843605.521266:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b0acc4a0/0xa762dfcbd58d1dfe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bb2 expref: 14 pid: 8424 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.521282:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b0acc4a0/0xa762dfcbd58d1dfe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bb2 expref: 14 pid: 8424 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.521311:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0acc4a0/0xa762dfcbd58d1dfe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490bb2 expref: 14 pid: 8424 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.521328:0:6493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788843605.521333:0:6493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788843605.521341:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000008b6bf6/0xa762dfcbd58d204a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.521352:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000008b6bf6/0xa762dfcbd58d204a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.521383:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843605.521452:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008624000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+13:2389:x1875738116594688:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 217us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843605.521459:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 102 00010000:00010000:0.0:1788843605.521505:0:8424:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000008b6bf6/0xa762dfcbd58d204a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.521516:0:8424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000008b6bf6/0xa762dfcbd58d204a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.521527:0:8424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000008b6bf6/0xa762dfcbd58d204a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.521536:0:8424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000008b6bf6/0xa762dfcbd58d204a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.521553:0:8424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788843605.521776:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008624a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3632:x1875738134470784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12944us (13167us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788843605.521786:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000004:00080000:0.0:1788843605.521846:0:3632:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd008625500/2, rc 0, transno 4294967323 00000100:00100000:0.0:1788843605.521853:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008625500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134470784:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788843605.522077:0:10328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843605.522086:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000008b6bf6/0xa762dfcbd58d204a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.522107:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be3600 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843605.522112:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000008b6bf6/0xa762dfcbd58d204a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.522121:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000008b6bf6/0xa762dfcbd58d204a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.522135:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000008b6bf6/0xa762dfcbd58d204a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.522171:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000008b6bf6/0xa762dfcbd58d204a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.522192:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843605.522194:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843605.522196:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788843605.522792:0:3630:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd0079ba300/2, rc 0, transno 4294967311 00000100:00100000:1.0:1788843605.522804:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134471168:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1788843605.525598:0:9500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:2.0:1788843605.525618:0:9500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:0.0:1788843605.525846:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2389:x1875738116594560:12345-192.168.203.33@tcp:16:lhsmtool_posix.0 Request processed in 6987us (7483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843605.525861:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 76 00000100:00100000:3.0:1788843605.533547:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843605.533639:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116594944 00000100:00100000:2.0:1788843605.533651:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116594944 00000100:00100000:2.0:1788843605.533729:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 245 00000100:00100000:2.0:1788843605.533740:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+21:12450:x1875738116594944:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788843605.533809:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843605.533841:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d2035 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c4c expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.533890:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9bd00658b200) 00010000:00010000:2.0:1788843605.533896:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788843605.533938:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d2058 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.533954:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d2058 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.533966:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d2058 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788843605.534129:0:6506:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe4dc8e2 reply state 000000004972a8d6 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d2058 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.534216:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d2058 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.534223:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9bd00658b200) 00010000:00010000:2.0:1788843605.534226:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788843605.534229:0:6506:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788843605.534362:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+22:12450:x1875738116594944:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 Request processed in 623us (828us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1788843605.534370:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 245 00000100:00100000:3.0:1788843605.536952:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843605.542483:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116595072 00000100:00100000:0.0:1788843605.542506:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116595072 00000100:00100000:0.0:1788843605.542614:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 77 00000100:00100000:0.0:1788843605.542628:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2390:x1875738116595072:12345-192.168.203.33@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788843605.542851:0:8423:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788843605.542875:0:8423:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1788843604 -> 1788843604 00002000:00010000:0.0:1788843605.542878:0:8423:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788843603 00002000:00010000:0.0:1788843605.542880:0:8423:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788843604 -> 1788843604 00002000:00010000:0.0:1788843605.542882:0:8423:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788843605.542982:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:2390:x1875738116595072:12345-192.168.203.33@tcp:2:lhsmtool_posix.0 Request processed in 357us (6046us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788843605.542993:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 77 00000100:00100000:1.0:1788843605.545629:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843605.545744:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116595328 00000100:00100000:2.0:1788843605.545757:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116595328 00000100:00100000:2.0:1788843605.545838:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 246 00000100:00100000:2.0:1788843605.545850:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+22:12450:x1875738116595328:12345-192.168.203.33@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788843605.545953:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d205f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.545994:0:9517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d2019 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c3e expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.546006:0:9517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d205f lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.546058:0:9517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d2019 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c3e expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.546074:0:9517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d2019 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c3e expref: 22 pid: 6508 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843605.546097:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007243b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9517:1875738134471296:192.168.203.33@tcp:104: 00000100:00100000:2.0:1788843605.546258:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12e08c480 going to sleep for 11 seconds 00000100:00100000:2.0:1788843605.552233:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843605.553553:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116595456 00000100:00100000:3.0:1788843605.553571:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116595456 00010000:00010000:3.0:1788843605.553651:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d2019 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c3e expref: 23 pid: 6508 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843605.553711:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 103 00000100:00100000:3.0:1788843605.553725:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007240e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+23:2390:x1875738116595456:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843605.553745:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843605.553752:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d2019 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c3e expref: 23 pid: 6508 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.553768:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d2019 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c3e expref: 23 pid: 6508 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.553796:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9bd00658b200) 00010000:00010000:3.0:1788843605.553802:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d205f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.553825:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d205f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.553835:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d205f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.553885:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843605.554070:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007240e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+23:2390:x1875738116595456:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 347us (1851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843605.554079:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 103 00010000:00010000:0.0:1788843605.558080:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d2019 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c3e expref: 22 pid: 6508 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843605.558116:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007243b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9517:1875738134471296:192.168.203.33@tcp:104: 00010000:00010000:0.0:1788843605.558188:0:9517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d205f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.558201:0:9517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d205f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.558208:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d205f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.558267:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d205f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.558275:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d205f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.558284:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d205f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.558291:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843605.558323:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d205f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.558333:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d205f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.558363:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9bd00658b200) 00010000:00010000:0.0:1788843605.558366:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788843605.558373:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d205f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.558379:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d205f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843605.558484:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+21:12450:x1875738116595328:12345-192.168.203.33@tcp:55:lhsmtool_posix.0 Request processed in 12635us (12876us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788843605.558496:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 246 00000100:00100000:2.0:1788843605.566136:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843605.566523:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116595584 00000100:00100000:0.0:1788843605.566537:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116595584 00000100:00100000:0.0:1788843605.566617:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 78 00000100:00100000:0.0:1788843605.566634:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:2390:x1875738116595584:12345-192.168.203.33@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788843605.566696:0:8424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000078838d6f/0xa762dfcbd58d2066 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.566723:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008d6e2f2d/0xa762dfcbd58d2043 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c5a expref: 8 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.566732:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843605.566737:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788843605.566760:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078838d6f/0xa762dfcbd58d2066 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.566809:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008d6e2f2d/0xa762dfcbd58d2043 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c5a expref: 8 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.566825:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008d6e2f2d/0xa762dfcbd58d2043 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c5a expref: 8 pid: 8421 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843605.566844:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8424:1875738134471424:192.168.203.33@tcp:104: 00000100:00100000:0.0:1788843605.567083:0:8424:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00749bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788843605.571274:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8424:1875738134471424:192.168.203.33@tcp:104: 00010000:00010000:0.0:1788843605.571321:0:8424:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000078838d6f/0xa762dfcbd58d2066 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843605.572437:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843605.573218:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116595712 00000100:00100000:0.0:1788843605.573233:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116595712 00010000:00010000:0.0:1788843605.573285:0:6493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008d6e2f2d/0xa762dfcbd58d2043 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c5a expref: 9 pid: 8421 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843605.573394:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 104 00000100:00100000:0.0:1788843605.573408:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007241180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+9:2390:x1875738116595712:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843605.573431:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843605.573461:0:6493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008d6e2f2d/0xa762dfcbd58d2043 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c5a expref: 9 pid: 8421 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.573501:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008d6e2f2d/0xa762dfcbd58d2043 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c5a expref: 9 pid: 8421 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.573531:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d6e2f2d/0xa762dfcbd58d2043 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c5a expref: 9 pid: 8421 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.573553:0:6493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788843605.573559:0:6493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788843605.573566:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000078838d6f/0xa762dfcbd58d2066 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.573578:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078838d6f/0xa762dfcbd58d2066 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.573630:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843605.573717:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007241180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:2390:x1875738116595712:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 311us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843605.573727:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 104 00010000:00010000:3.0:1788843605.573796:0:8424:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000078838d6f/0xa762dfcbd58d2066 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.573807:0:8424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078838d6f/0xa762dfcbd58d2066 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.573850:0:8424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000078838d6f/0xa762dfcbd58d2066 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.573859:0:8424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078838d6f/0xa762dfcbd58d2066 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.573868:0:8424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078838d6f/0xa762dfcbd58d2066 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.573876:0:8424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3dc00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:3.0:1788843605.573881:0:8424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078838d6f/0xa762dfcbd58d2066 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.573891:0:8424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078838d6f/0xa762dfcbd58d2066 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.573919:0:8424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078838d6f/0xa762dfcbd58d2066 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.573927:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078838d6f/0xa762dfcbd58d2066 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843605.573987:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2390:x1875738116595584:12345-192.168.203.33@tcp:1:lhsmtool_posix.0 Request processed in 7360us (7866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843605.573997:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 78 00000100:00100000:1.0:1788843605.583697:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843605.583802:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116595968 00000100:00100000:0.0:1788843605.583834:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116595968 00000100:00100000:0.0:1788843605.583917:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 247 00000100:00100000:0.0:1788843605.583930:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+21:12450:x1875738116595968:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788843605.584036:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d206d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.584058:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947800/0xa762dfcbd58d1f5c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c06 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.584088:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d206d lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.584184:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947800/0xa762dfcbd58d1f5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c06 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.584204:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947800/0xa762dfcbd58d1f5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c06 expref: 21 pid: 6508 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843605.584222:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079baa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6507:1875738134471552:192.168.203.33@tcp:104: 00000100:00100000:0.0:1788843605.584328:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00749bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788843605.588267:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843605.588403:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079baa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6507:1875738134471552:192.168.203.33@tcp:104: 00010000:00010000:0.0:1788843605.588443:0:6507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d206d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843605.588566:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116596096 00000100:00100000:3.0:1788843605.588575:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116596096 00010000:00010000:3.0:1788843605.588632:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947800/0xa762dfcbd58d1f5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c06 expref: 22 pid: 6508 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843605.588680:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 105 00000100:00100000:3.0:1788843605.588692:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007242300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+22:2390:x1875738116596096:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843605.588715:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843605.588723:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947800/0xa762dfcbd58d1f5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c06 expref: 22 pid: 6508 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.588738:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947800/0xa762dfcbd58d1f5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c06 expref: 22 pid: 6508 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.588767:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947800/0xa762dfcbd58d1f5c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c06 expref: 22 pid: 6508 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.588975:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd007450300) 00010000:00010000:3.0:1788843605.588984:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea000/0xa762dfcbd58d1fbe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c29 expref: 21 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.588996:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d206d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.589005:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d206d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.589014:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d206d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.589048:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788843605.589221:0:6507:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d206d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.589229:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d206d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.589450:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d2074 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.589477:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d2027 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c45 expref: 22 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.589485:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d2074 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.589534:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d2027 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c45 expref: 22 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.589550:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d2027 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c45 expref: 22 pid: 9517 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843605.589565:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079baa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6507:1875738134471680:192.168.203.33@tcp:104: 00000100:00100000:3.0:1788843605.589887:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007242300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+22:2390:x1875738116596096:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 1194us (1633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843605.589898:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 105 00000100:00100000:1.0:1788843605.590842:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd10652be40 going to sleep for 11 seconds 00000100:00100000:1.0:1788843605.597347:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843605.597515:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079baa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6507:1875738134471680:192.168.203.33@tcp:104: 00010000:00010000:2.0:1788843605.597552:0:6507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d2074 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843605.597758:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116596224 00000100:00100000:0.0:1788843605.597768:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116596224 00010000:00010000:0.0:1788843605.597936:0:7448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d2027 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c45 expref: 22 pid: 9517 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843605.598028:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 106 00000100:00100000:0.0:1788843605.598040:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13332ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+22:2390:x1875738116596224:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843605.598061:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843605.598069:0:7448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d2027 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c45 expref: 22 pid: 9517 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.598083:0:7448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d2027 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c45 expref: 22 pid: 9517 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.598112:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2400/0xa762dfcbd58d2027 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c45 expref: 22 pid: 9517 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.598130:0:7448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9bd00658b200) 00010000:00010000:0.0:1788843605.598136:0:7448:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d2074 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.598217:0:7448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d2074 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.598226:0:7448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d2074 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.598264:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843605.598336:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13332ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+21:2390:x1875738116596224:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 297us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843605.598344:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 106 00010000:00010000:3.0:1788843605.598546:0:6507:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d2074 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.598556:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d2074 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788843605.598714:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:3.0:1788843605.598879:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:3.0:1788843605.598920:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:3.0:1788843605.599017:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6507:1875738134471808:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788843605.599082:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843605.599176:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd00789cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788843605.599390:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134471808 00000100:00100000:2.0:1788843605.599398:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134471808 00000100:00100000:2.0:1788843605.599449:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788843605.599459:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6507:x1875738134471808:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788843605.599558:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6507:x1875738134471808:12345-0@lo:1000:mdt00_001.0 Request processed in 101us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843605.599573:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788843605.599628:0:6507:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1788843605.599635:0:6507:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:2.0:1788843605.599655:0:6507:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd008626680, transno 4294967322 00000100:00100000:2.0:1788843605.599669:0:6507:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9bd008625500 x1875738134470784/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788843621 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843605.599681:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6507:1875738134471808:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788843605.599818:0:6507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1788843605.599878:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007241880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6507:1875738134471936:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788843605.599910:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843605.599926:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12e08c540 going to sleep for 11 seconds 00000100:00100000:3.0:1788843605.600199:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134471936 00000100:00100000:3.0:1788843605.600205:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134471936 00000100:00100000:3.0:1788843605.600235:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788843605.600244:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6507:x1875738134471936:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788843605.600370:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6507:x1875738134471936:12345-0@lo:1000:mdt00_001.0 Request processed in 127us (459us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788843605.600377:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788843605.600549:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007241880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6507:1875738134471936:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788843605.600595:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d2074 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.600606:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d2074 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.600683:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d2074 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.600692:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3ca00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843605.600697:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d2074 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.600707:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d2074 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.600743:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9bd00658b200) 00010000:00010000:2.0:1788843605.600747:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788843605.600753:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d2074 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.600760:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d2074 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.600791:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1fb7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.600798:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1fb7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.600804:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1fb7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.600913:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843605.600919:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1fb7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.600927:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1fb7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.600936:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd007450300) 00010000:00010000:2.0:1788843605.600939:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788843605.600947:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea000/0xa762dfcbd58d1fbe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c29 expref: 24 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.600959:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea000/0xa762dfcbd58d1fbe lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c29 expref: 24 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.600978:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea000/0xa762dfcbd58d1fbe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c29 expref: 24 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.601014:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea000/0xa762dfcbd58d1fbe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c29 expref: 24 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843605.601029:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007241500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6507:1875738134472064:192.168.203.33@tcp:105: 00000100:00100000:2.0:1788843605.601105:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12e08c540 going to sleep for 11 seconds 00000100:00100000:2.0:1788843605.605577:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843605.605656:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116596352 00000100:00100000:3.0:1788843605.605669:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116596352 00000100:00100000:3.0:1788843605.605746:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 61 00000100:00100000:3.0:1788843605.605759:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+25:12449:x1875738116596352:12345-192.168.203.33@tcp:49:lfs.0 00000100:00100000:3.0:1788843605.606042:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+25:12449:x1875738116596352:12345-192.168.203.33@tcp:49:lfs.0 Request processed in 285us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843605.606051:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 61 00000100:00100000:0.0:1788843605.608080:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007241500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6507:1875738134472064:192.168.203.33@tcp:105: 00010000:00010000:0.0:1788843605.608124:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1fb7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.608137:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947000/0xa762dfcbd58d1fb7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.608317:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d207b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.608334:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d207b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.608346:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d207b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.608358:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d207b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.608365:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d207b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.608391:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d207b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.608398:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3dc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843605.608402:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d207b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.608410:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d207b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.608426:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd007450300) 00010000:00010000:0.0:1788843605.608429:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843605.608433:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d207b lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.608439:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d207b lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.608451:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d206d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.608456:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d206d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.608461:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d206d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.608466:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3c800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843605.608468:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d206d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.608488:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d206d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.608498:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd007450300) 00010000:00010000:0.0:1788843605.608500:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788843605.608503:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d206d lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.608509:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d206d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843605.608906:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+24:12450:x1875738116595968:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 Request processed in 24976us (25220us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1788843605.608919:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 247 00000020:00080000:0.0:1788843605.608927:0:6507:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788843605.610531:0:13785:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788843605.610543:0:13785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788843605.611047:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788843605.611060:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788843605.612378:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843605.612475:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116596608 00000100:00100000:3.0:1788843605.612489:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116596608 00000100:00100000:3.0:1788843605.612562:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 248 00000100:00100000:3.0:1788843605.612574:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+24:12449:x1875738116596608:12345-192.168.203.33@tcp:58:lfs.0 00000040:00080000:3.0:1788843605.612808:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1788843605.612909:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+24:12449:x1875738116596608:12345-192.168.203.33@tcp:58:lfs.0 Request processed in 337us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843605.612918:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 248 00000100:00100000:2.0:1788843605.615266:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843605.615353:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116596864 00000100:00100000:3.0:1788843605.615367:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116596864 00000100:00100000:3.0:1788843605.615430:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 62 00000100:00100000:3.0:1788843605.615441:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e1e5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+24:12450:x1875738116596864:12345-192.168.203.33@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788843605.615840:0:6510:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788843605.615884:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:3.0:1788843605.615924:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d2082 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.615945:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d2082 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.615958:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d2082 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.615969:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d2082 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.615975:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d2082 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.615982:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d2082 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843605.616130:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788843605.616282:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e1e5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+26:12450:x1875738116596864:12345-192.168.203.33@tcp:35:lhsmtool_posix.0 Request processed in 841us (1028us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1788843605.616293:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 62 00000020:00080000:3.0:1788843605.616300:0:6510:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788843605.620074:0:10329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843605.620095:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d2082 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.620109:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be3a00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843605.620115:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d2082 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.620125:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d2082 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.620178:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9bd00658b200) 00010000:00010000:2.0:1788843605.620183:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788843605.620190:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d2082 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.620195:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3a00/0xa762dfcbd58d2082 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.620237:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843605.620239:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843605.620241:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843605.648546:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843605.648743:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116596992 00000100:00100000:0.0:1788843605.648756:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116596992 00000100:00100000:0.0:1788843605.648843:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 249 00000100:00100000:0.0:1788843605.648855:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+26:12452:x1875738116596992:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1788843605.648886:0:9517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843605.648915:0:9517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d2089 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490c61 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.649004:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d2090 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.649022:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d2090 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.649057:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d2090 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.649074:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d2097 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.649082:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d2097 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843605.649087:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d2097 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843605.649780:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d209e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843605.649800:0:9517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1fa9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c22 expref: 27 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843605.649858:0:9517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d209e lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843605.649907:0:9517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1fa9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c22 expref: 27 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843605.649935:0:9517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1fa9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c22 expref: 27 pid: 6507 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843605.649954:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9517:1875738134472192:192.168.203.33@tcp:104: 00000100:00100000:1.0:1788843605.650111:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893000 going to sleep for 11 seconds 00000100:00100000:1.0:1788843605.653960:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843605.654097:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116597248 00000100:00100000:0.0:1788843605.654109:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116597248 00000100:00100000:0.0:1788843605.654213:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 63 00000100:00100000:0.0:1788843605.654226:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+28:6161:x1875738116597248:12345-192.168.203.33@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788843605.654666:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+29:6161:x1875738116597248:12345-192.168.203.33@tcp:35:ldlm_bl.0 Request processed in 441us (719us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1788843605.654676:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 63 00000100:00100000:3.0:1788843605.656759:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843605.656985:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116597376 00000100:00100000:1.0:1788843605.656997:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116597376 00010000:00010000:1.0:1788843605.657047:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1fa9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c22 expref: 29 pid: 6507 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843605.657093:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 107 00000100:00100000:1.0:1788843605.657104:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+29:2390:x1875738116597376:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843605.657123:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843605.657131:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1fa9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c22 expref: 29 pid: 6507 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843605.657199:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1fa9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c22 expref: 29 pid: 6507 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843605.657229:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd007450300) 00010000:00010000:1.0:1788843605.657235:0:6492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d209e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843605.657245:0:6492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d209e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843605.657274:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d209e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843605.657297:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843605.657358:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+29:2390:x1875738116597376:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 255us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843605.657366:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 107 00010000:00010000:2.0:1788843605.659043:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2a00/0xa762dfcbd58d1fa9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c22 expref: 28 pid: 6507 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843605.659075:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9517:1875738134472192:192.168.203.33@tcp:104: 00010000:00010000:2.0:1788843605.659111:0:9517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d209e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.659122:0:9517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d209e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.659129:0:9517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d209e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843605.659304:0:9517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788843605.659312:0:9517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788843605.659342:0:9517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d209e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.659363:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d209e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.659376:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d2090 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.659384:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d2090 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.659393:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d2090 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.659424:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3dc00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843605.659430:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d2090 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.659439:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d2090 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.659473:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bd007450c00) 00010000:00010000:2.0:1788843605.659478:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843605.659483:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d2090 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.659489:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d2090 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.659504:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d2097 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.659511:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d2097 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.659518:0:9517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d2097 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.659523:0:9517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843605.659526:0:9517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d2097 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.659532:0:9517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d2097 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.659552:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9bd00658b500) 00010000:00010000:2.0:1788843605.659555:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843605.659558:0:9517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d2097 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.659564:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d200/0xa762dfcbd58d2097 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.659615:0:9517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d2089 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c61 expref: 28 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.659704:0:9517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d209e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c61 expref: 27 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843605.659712:0:9517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd007450300) 00010000:00010000:2.0:1788843605.659715:0:9517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843605.659718:0:9517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fbea600, rc 0) 00000100:00100000:2.0:1788843605.659871:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+27:12452:x1875738116596992:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 11017us (11339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843605.659881:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 249 00000100:00100000:1.0:1788843605.914333:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788843605.914367:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134472320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843605.914454:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843605.914521:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134472320 00000100:00100000:0.0:1788843605.914532:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134472320 00000100:00100000:0.0:1788843605.914599:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788843605.914612:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3633:x1875738134472320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788843605.914643:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788843605.915054:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3633:x1875738134472320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 441us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843605.915063:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788843605.917884:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134472320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843605.917931:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134472448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788843605.918013:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843605.918061:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134472448 00000100:00100000:1.0:1788843605.918069:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134472448 00000100:00100000:1.0:1788843605.918122:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788843605.918131:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3633:x1875738134472448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788843605.918186:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:1.0:1788843605.918231:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3633:x1875738134472448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843605.918238:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788843605.918315:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134472448:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1788843605.924363:0:8417:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:1.0:1788843605.924388:0:8417:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:3.0:1788843605.924446:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134472576:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788843605.926998:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843605.928008:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134472576 00000100:00100000:0.0:1788843605.928026:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134472576 00000100:00100000:0.0:1788843605.928092:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788843605.928104:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134472576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788843605.928138:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:0.0:1788843605.928273:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134472576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 171us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843605.928281:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788843605.928985:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134472576:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788843605.935262:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843605.935332:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843605.935359:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843605.935384:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843605.935408:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843605.935445:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116597632 00000100:00100000:1.0:1788843605.935457:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116597632 00000100:00100000:1.0:1788843605.935541:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116597888 00000100:00100000:1.0:1788843605.935546:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116597888 00000100:00100000:1.0:1788843605.935698:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116598016 00000100:00100000:1.0:1788843605.935702:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116598016 00000100:00100000:1.0:1788843605.935722:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 338 00000100:00100000:1.0:1788843605.935734:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116597632:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1788843605.935937:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 339 00000100:00100000:0.0:1788843605.935949:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2388:x1875738116597888:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1788843605.936040:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2388:x1875738116597888:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 94us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843605.936048:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 339 00000100:00100000:0.0:1788843605.936071:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 340 00000100:00100000:0.0:1788843605.936079:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2388:x1875738116598016:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1788843605.936105:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2388:x1875738116598016:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 27us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843605.936111:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 340 00000100:00100000:1.0:1788843605.936338:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116597632:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 604us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843605.936346:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 338 00000100:00080000:1.0:1788843605.936367:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788843605.936372:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788843605.936724:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116597504 00000100:00100000:3.0:1788843605.936732:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116597504 00000100:00100000:3.0:1788843605.936981:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 393 00000100:00100000:3.0:1788843605.936991:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+13:2387:x1875738116597504:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843605.937099:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+13:2387:x1875738116597504:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 109us (1852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843605.937106:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 393 00000100:00100000:3.0:1788843605.937180:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116597760 00000100:00100000:3.0:1788843605.937184:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116597760 00000100:00100000:3.0:1788843605.937218:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 146 00000100:00100000:3.0:1788843605.937225:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2388:x1875738116597760:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843605.941176:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2388:x1875738116597760:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 3915us (5755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843605.941192:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 146 00010000:00010000:0.0:1788843606.172520:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788843606.462877:0:14701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788843606.462892:0:14701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788843606.462933:0:14701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788843606.462942:0:14701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788843606.618424:0:13785:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788843606.618437:0:13785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788843606.618478:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788843606.618488:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788843606.619111:0:13785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ba0a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13785:1875738134472704:192.168.203.33@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788843606.619371:0:13785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd102d36000 going to sleep for 11 seconds 00000100:00100000:1.0:1788843606.630365:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843606.630416:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116598144 00000100:00100000:1.0:1788843606.630429:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116598144 00000100:00100000:1.0:1788843606.630512:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 250 00000100:00100000:1.0:1788843606.630526:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+28:12465:x1875738116598144:12345-192.168.203.33@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788843606.630585:0:6507:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788843606.631410:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+28:12465:x1875738116598144:12345-192.168.203.33@tcp:53:lhsmtool_posix.0 Request processed in 882us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843606.631422:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 250 00000100:00080000:1.0:1788843606.631460:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843606.637931:0:13785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ba0a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13785:1875738134472704:192.168.203.33@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788843606.638580:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843606.638930:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116598400 00000100:00100000:3.0:1788843606.638941:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116598400 00000100:00100000:3.0:1788843606.639020:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 251 00000100:00100000:3.0:1788843606.639032:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+27:12465:x1875738116598400:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788843606.639061:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843606.639091:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3400/0xa762dfcbd58d20a5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490c68 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843606.639267:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d20ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843606.639317:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d20ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843606.639332:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d20ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843606.639567:0:6506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788843606.644978:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3400/0xa762dfcbd58d20a5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c68 expref: 30 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843606.645013:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d20ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c68 expref: 29 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843606.645040:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd007450300) 00010000:00010000:2.0:1788843606.645043:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843606.645049:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be2000, rc 0) 00000100:00100000:2.0:1788843606.645787:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+29:12465:x1875738116598400:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 6749us (7202us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788843606.645799:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 251 00000100:00100000:3.0:1788843606.666645:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843606.666705:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843606.667678:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116598656 00000100:00100000:2.0:1788843606.667697:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116598656 00000100:00100000:2.0:1788843606.667779:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 252 00000100:00100000:2.0:1788843606.667792:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+29:12465:x1875738116598656:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788843606.667906:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d20ba lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843606.667931:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d20ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843606.667944:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d20ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843606.668173:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d20ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843606.668181:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d20ba lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843606.668188:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d20ba lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843606.668210:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843606.668215:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d20ba lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843606.668224:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d20ba lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843606.668239:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd007450300) 00010000:00010000:2.0:1788843606.668243:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788843606.668248:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d20ba lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843606.668253:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946c00/0xa762dfcbd58d20ba lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843606.668411:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+30:12465:x1875738116598656:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 Request processed in 619us (1963us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1788843606.668420:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 252 00000100:00100000:3.0:1788843606.670864:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843606.671045:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116599040 00000100:00100000:2.0:1788843606.671057:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116599040 00000100:00100000:2.0:1788843606.671166:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 64 00000100:00100000:2.0:1788843606.671182:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+30:12465:x1875738116599040:12345-192.168.203.33@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788843606.671490:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+31:12465:x1875738116599040:12345-192.168.203.33@tcp:35:lhsmtool_posix.0 Request processed in 311us (639us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788843606.671499:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 64 00000100:00100000:1.0:1788843606.675448:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116598784 00000100:00100000:1.0:1788843606.675468:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116598784 00000100:00100000:1.0:1788843606.675565:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 19 00000100:00100000:1.0:1788843606.675578:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+31:2390:x1875738116598784:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843606.675601:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843606.675634:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2000/0xa762dfcbd58d20ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c68 expref: 31 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843606.675660:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd007450300) 00010000:00010000:1.0:1788843606.675666:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843606.675732:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+30:2390:x1875738116598784:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 156us (9025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843606.675740:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 19 00000040:00080000:1.0:1788843606.675862:0:13785:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788843606.675869:0:13785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788843606.676398:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788843606.676409:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788843606.938977:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843606.939014:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134472832:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788843606.939116:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843606.939367:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134472832 00000100:00100000:0.0:1788843606.939379:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134472832 00000100:00100000:0.0:1788843606.939451:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788843606.939482:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134472832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788843606.939531:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788843606.939588:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134472832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843606.939596:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788843606.940317:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134472832:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788843606.941721:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134472960:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788843606.941827:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843606.941995:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134472960 00000100:00100000:2.0:1788843606.942018:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134472960 00000100:00100000:2.0:1788843606.942095:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788843606.942106:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134472960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788843606.942188:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788843606.942266:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134472960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 162us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843606.942273:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788843606.943470:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134472960:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788843607.196900:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843608.224857:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788843608.519813:0:14752:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788843608.519826:0:14752:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788843608.519863:0:14752:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788843608.519873:0:14752:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788843608.754467:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843608.754534:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116599296 00000100:00100000:3.0:1788843608.754549:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116599296 00000100:00080000:0.0:1788843608.754612:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843608.754660:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 253 00000100:00100000:3.0:1788843608.754674:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+30:12485:x1875738116599296:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:3.0:1788843608.754705:0:11996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843608.754730:0:11996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d20c1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490c6f expref: -99 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843608.754869:0:11996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2e00/0xa762dfcbd58d20c8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843608.754887:0:11996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2e00/0xa762dfcbd58d20c8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843608.754908:0:11996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2e00/0xa762dfcbd58d20c8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843608.754922:0:11996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788843608.755063:0:11996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d20c1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c6f expref: 33 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843608.755097:0:11996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2e00/0xa762dfcbd58d20c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c6f expref: 32 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843608.755107:0:11996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd007450300) 00010000:00010000:3.0:1788843608.755111:0:11996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788843608.755115:0:11996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be2e00, rc 0) 00000100:00100000:3.0:1788843608.755228:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+32:12485:x1875738116599296:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 557us (775us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788843608.755235:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 253 00000100:00100000:2.0:1788843608.757904:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843608.757991:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116599424 00000100:00100000:3.0:1788843608.758004:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116599424 00000100:00100000:3.0:1788843608.758078:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 254 00000100:00100000:3.0:1788843608.758091:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+32:12485:x1875738116599424:12345-192.168.203.33@tcp:54:lfs.0 00010000:00010000:3.0:1788843608.758207:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d20d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843608.758227:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d20d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843608.758240:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d20d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843608.758283:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d20d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843608.758290:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d20d6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843608.758310:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d20d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843608.758317:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be3c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:3.0:1788843608.758323:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d20d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843608.758331:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d20d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843608.758345:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd007450300) 00010000:00010000:3.0:1788843608.758349:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788843608.758356:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d20d6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843608.758363:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d20d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843608.758520:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+32:12485:x1875738116599424:12345-192.168.203.33@tcp:54:lfs.0 Request processed in 368us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843608.758529:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 254 00000100:00100000:2.0:1788843608.879632:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843608.879732:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116599552 00000100:00100000:1.0:1788843608.879745:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116599552 00000100:00100000:1.0:1788843608.879843:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 79 00000100:00100000:1.0:1788843608.879858:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007240380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2388:x1875738116599552:12345-192.168.203.33@tcp:101:cat.0 00010000:00010000:1.0:1788843608.879882:0:8901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843608.879910:0:8901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007830bb91/0xa762dfcbd58d20dd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490c76 expref: -99 pid: 8901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788843608.879945:0:8901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9f9654, atime: 0x6a9f9653, ctime: 0x6a9f9654, blocks: 0x8 00010000:00010000:1.0:1788843608.879970:0:8901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=386s v=(0 0) 00010000:00010000:1.0:1788843608.879975:0:8901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843608.879987:0:8901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007830bb91/0xa762dfcbd58d20dd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c76 expref: 8 pid: 8901 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843608.880009:0:8901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007830bb91/0xa762dfcbd58d20dd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c76 expref: 8 pid: 8901 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843608.880026:0:8901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fbebc00, rc 0) 00000100:00100000:1.0:1788843608.880097:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007240380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:2388:x1875738116599552:12345-192.168.203.33@tcp:101:cat.0 Request processed in 243us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843608.880106:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 79 00000100:00080000:2.0:1788843608.880285:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788843608.888896:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843608.889192:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116599680 00000100:00100000:1.0:1788843608.889225:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116599680 00002000:00100000:1.0:1788843608.889290:0:8427:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9bd0079ba680 x1875738116599680/t0(0) o3->f25f61b6-5faf-4e05-81a4-dea3dba05dc5@192.168.203.33@tcp:224/0 lens 488/0 e 0 to 0 dl 1788843619 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788843608.889302:0:8427:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd0079ba680 with x1875738116599680 ext(0->4095) 00002000:00010000:1.0:1788843608.889309:0:8427:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bd0079ba680 00000100:00100000:3.0:1788843608.889378:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7 00000100:00100000:3.0:1788843608.889394:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:2387:x1875738116599680:12345-192.168.203.33@tcp:3:cat.0 00000100:00100000:3.0:1788843608.889642:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+8:2387:x1875738116599680:12345-192.168.203.33@tcp:3:cat.0 Request processed in 251us (760us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788843608.889650:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7 00002000:00100000:3.0:1788843608.889658:0:8429:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9bd0079ba680 x1875738116599680/t0(0) o3->f25f61b6-5faf-4e05-81a4-dea3dba05dc5@192.168.203.33@tcp:224/0 lens 488/4536 e 0 to 0 dl 1788843619 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788843608.889681:0:8429:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd0079ba680 with x1875738116599680 ext(0->4095) 00002000:00010000:3.0:1788843608.889685:0:8429:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bd0079ba680 00010000:00010000:2.0:1788843609.242681:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788843609.436002:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788843609.754521:0:13785:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788843609.754535:0:13785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788843609.754562:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788843609.754573:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788843610.266375:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843610.522974:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134473088:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788843610.523078:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843610.523342:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134473088 00000100:00100000:3.0:1788843610.523354:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134473088 00000100:00100000:2.0:1788843610.523387:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134473600:0@lo:400:kworker.0 00000100:00100000:2.0:1788843610.523428:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843610.523456:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134474112:0@lo:400:kworker.0 00000100:00080000:1.0:1788843610.523481:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788843610.523487:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843610.523509:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134474624:0@lo:400:kworker.0 00000100:00100000:1.0:1788843610.523520:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134474112 00000100:00100000:1.0:1788843610.523526:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134474112 00000100:00100000:2.0:1788843610.523533:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843610.523562:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788843610.523568:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007240e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134473472:0@lo:400:kworker.0 00000100:00100000:2.0:1788843610.523594:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843610.523613:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007240a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1875738134473984:0@lo:400:kworker.0 00000100:00100000:2.0:1788843610.523636:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843610.523653:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141aeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134474496:0@lo:400:kworker.0 00000100:00100000:2.0:1788843610.523673:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843610.523726:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134473600 00000100:00100000:2.0:1788843610.523731:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134473600 00000100:00100000:2.0:1788843610.523774:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134473984 00000100:00100000:2.0:1788843610.523777:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134473984 00000100:00100000:2.0:1788843610.523812:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788843610.523821:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134473600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843610.523884:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134473600:12345-0@lo:400:kworker.0 Request processed in 63us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843610.523891:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788843610.523909:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1788843610.523915:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141aeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875738134473984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843610.523943:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141aeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875738134473984:12345-0@lo:400:kworker.0 Request processed in 28us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843610.523949:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1788843610.523958:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134474624 00000100:00100000:1.0:1788843610.523964:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134474624 00000100:00100000:1.0:1788843610.523987:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134474496 00000100:00100000:1.0:1788843610.523990:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134474496 00010000:00080000:2.0:1788843610.523994:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007240a80 x1875738134473984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843610.524011:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788843610.524013:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007240a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1875738134473984:0@lo:400:kworker.0 00000100:00100000:1.0:1788843610.524025:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141aead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134474112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843610.524031:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134473600:0@lo:400:kworker.0 00000100:00100000:1.0:1788843610.524079:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141aead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134474112:12345-0@lo:400:kworker.0 Request processed in 58us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843610.524088:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788843610.524096:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788843610.524106:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3633:x1875738134474624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843610.524108:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788843610.524134:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134474496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843610.524192:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3633:x1875738134474624:12345-0@lo:400:kworker.0 Request processed in 88us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843610.524198:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788843610.524225:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007241500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1875738134473344:0@lo:400:kworker.0 00000100:00100000:2.0:1788843610.524251:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843610.524280:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007243b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1875738134473856:0@lo:400:kworker.0 00000100:00100000:2.0:1788843610.524302:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843610.524318:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1875738134474368:0@lo:400:kworker.0 00000100:00100000:2.0:1788843610.524339:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843610.524358:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788843610.524365:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007242d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134473216:0@lo:400:kworker.0 00000100:00100000:2.0:1788843610.524393:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843610.524416:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134473728:0@lo:400:kworker.0 00000100:00100000:2.0:1788843610.524437:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843610.524453:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1875738134474240:0@lo:400:kworker.0 00000100:00100000:2.0:1788843610.524474:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843610.524498:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134473344 00000100:00100000:2.0:1788843610.524503:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134473344 00000100:00100000:3.0:1788843610.524515:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788843610.524527:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00799b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134473088:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788843610.524527:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134473856 00000100:00100000:2.0:1788843610.524532:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134473856 00000100:00100000:2.0:1788843610.524550:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134474368 00000100:00100000:2.0:1788843610.524552:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134474368 00000100:00100000:2.0:1788843610.524563:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134474240 00000100:00100000:2.0:1788843610.524565:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134474240 00000100:00100000:2.0:1788843610.524581:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1788843610.524587:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1875738134473344:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1788843610.524831:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843610.524876:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00799b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134473088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 353us (1799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843610.524882:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788843610.524905:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1788843610.524912:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1875738134473856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843610.524971:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134474496:12345-0@lo:400:kworker.0 Request processed in 840us (1296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843610.524977:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788843610.525000:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134473472 00000100:00100000:1.0:1788843610.525003:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134473472 00000100:00100000:1.0:1788843610.525026:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134473728 00000100:00100000:1.0:1788843610.525037:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134473728 00000100:00100000:1.0:1788843610.525051:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788843610.525056:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141aea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134473472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843610.525087:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141aea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134473472:12345-0@lo:400:kworker.0 Request processed in 31us (1492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843610.525093:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788843610.525102:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788843610.525107:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134473728:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788843610.525331:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788843610.525338:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788843610.525341:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788843610.525343:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843610.526028:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1788843610.526046:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1875738134474368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843610.526183:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1875738134473344:12345-0@lo:400:kworker.0 Request processed in 1593us (1928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843610.526191:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1788843610.526197:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1875738134473856:12345-0@lo:400:kworker.0 Request processed in 1282us (1890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843610.526206:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1788843610.526232:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1788843610.526240:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1875738134474240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843610.526278:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1875738134474240:12345-0@lo:400:kworker.0 Request processed in 40us (1803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843610.526285:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1788843610.526321:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134473216 00000100:00100000:3.0:1788843610.526341:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134473216 00000100:00100000:3.0:1788843610.526384:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1788843610.526392:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3631:x1875738134473216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843610.526428:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3631:x1875738134473216:12345-0@lo:400:kworker.0 Request processed in 37us (2034us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843610.526433:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1788843610.538952:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134473728:12345-0@lo:400:kworker.0 Request processed in 13827us (14496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843610.538973:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788843610.539727:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1875738134474368:12345-0@lo:400:kworker.0 Request processed in 13684us (15381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843610.539738:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1788843610.539823:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007240e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134473472:0@lo:400:kworker.0 00000100:00100000:0.0:1788843610.539839:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141aeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134474496:0@lo:400:kworker.0 00000100:00100000:0.0:1788843610.539851:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1788843610.539858:0:3633:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:0.0:1788843610.539909:0:3633:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd007935180, transno 4294967308 00000004:00080000:0.0:1788843610.539934:0:3633:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:0.0:1788843610.539967:0:3633:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd0079ba300, transno 4294967311 00000100:00100000:0.0:1788843610.539974:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134474112:0@lo:400:kworker.0 00000100:00100000:0.0:1788843610.539992:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134474624:0@lo:400:kworker.0 00000100:00100000:0.0:1788843610.540020:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134473088:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788843610.544759:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134473728:0@lo:400:kworker.0 00000100:00100000:2.0:1788843610.544788:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1875738134474240:0@lo:400:kworker.0 00000100:00100000:2.0:1788843610.544821:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007241500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1875738134473344:0@lo:400:kworker.0 00000100:00100000:2.0:1788843610.544838:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007243b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1875738134473856:0@lo:400:kworker.0 00010000:00080000:2.0:1788843610.544856:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141ae9180 x1875738134474368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843610.544868:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1875738134474368:0@lo:400:kworker.0 00000100:00100000:2.0:1788843610.544909:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007242d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134473216:0@lo:400:kworker.0 00000001:00080000:0.0:1788843610.548920:0:6485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1788843610.548982:0:6485:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bd12e08ca80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1788843610.548988:0:6485:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd13e883c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bd12e08c6c0 00000020:00080000:0.0:1788843610.548992:0:6485:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd13e883400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bd137bce800 00000020:00080000:0.0:1788843610.549019:0:6485:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1788843610.549039:0:6538:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1788843610.549175:0:6538:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1788843610.549315:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d2058 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843610.549331:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d2058 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843610.549341:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d2058 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843610.549348:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843610.549354:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d2058 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843610.549363:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d2058 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843610.549385:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9bd00658b200) 00010000:00010000:2.0:1788843610.549388:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843610.549394:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d2058 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843610.549400:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d2058 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843611.036469:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788843611.036500:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134474752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843611.036592:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843611.036942:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134474880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843611.036974:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843611.037052:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134474752 00000100:00100000:2.0:1788843611.037062:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134474752 00000100:00100000:2.0:1788843611.037127:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134474880 00000100:00100000:2.0:1788843611.037130:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134474880 00000100:00100000:2.0:1788843611.037209:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788843611.037220:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3631:x1875738134474752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788843611.037256:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788843611.037312:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3631:x1875738134474752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843611.037319:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788843611.037340:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788843611.037347:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134474880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788843611.037357:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788843611.037384:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134474880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843611.037390:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788843611.038446:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134474880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843611.038470:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134474752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843611.040012:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134475008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788843611.040117:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843611.040341:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134475008 00000100:00100000:2.0:1788843611.040353:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134475008 00000100:00100000:2.0:1788843611.040420:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788843611.040433:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134475008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788843611.040465:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788843611.040530:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134475008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843611.040538:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788843611.044296:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134475008:0@lo:13:osp-pre-1-1.0 00000001:00080000:2.0:1788843611.046446:0:9500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:2.0:1788843611.046470:0:9500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000100:00100000:2.0:1788843611.061228:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843611.061276:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843611.061340:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843611.061360:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843611.061398:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116599808 00000100:00100000:3.0:1788843611.061410:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116599808 00000100:00100000:3.0:1788843611.061467:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 395 00000100:00100000:3.0:1788843611.061488:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+13:2389:x1875738116599808:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843611.061567:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7928f422-fe0e-4906-b099-11067616e1bb+13:2389:x1875738116599808:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 82us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843611.061575:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 395 00000100:00100000:3.0:1788843611.063770:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116600320 00000100:00100000:3.0:1788843611.063799:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116600320 00000100:00100000:3.0:1788843611.063908:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 150 00000100:00100000:3.0:1788843611.063921:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2389:x1875738116600320:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843611.064027:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2389:x1875738116600320:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 108us (2685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843611.064035:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 150 00000100:00080000:3.0:1788843611.064060:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788843611.070416:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843611.074163:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116600064 00000100:00100000:1.0:1788843611.074184:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116600064 00000100:00100000:1.0:1788843611.074288:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116600576 00000100:00100000:1.0:1788843611.074292:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116600576 00000100:00100000:1.0:1788843611.074329:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 347 00000100:00100000:1.0:1788843611.074341:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141aebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2389:x1875738116600064:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843611.074453:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141aebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2389:x1875738116600064:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 114us (13176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843611.074461:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 347 00000100:00100000:1.0:1788843611.074482:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 348 00000100:00100000:1.0:1788843611.074489:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2389:x1875738116600576:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843611.074516:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2389:x1875738116600576:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 27us (13154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843611.074522:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 348 00000100:00080000:1.0:1788843611.074552:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788843611.075641:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843611.075681:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843611.075709:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116600192 00000100:00100000:2.0:1788843611.075717:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116600192 00000100:00100000:1.0:1788843611.076050:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116599936 00000100:00100000:1.0:1788843611.076056:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116599936 00000100:00100000:1.0:1788843611.076092:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116600448 00000100:00100000:1.0:1788843611.076096:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116600448 00000100:00100000:1.0:1788843611.076156:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 349 00000100:00100000:1.0:1788843611.076170:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+18:2389:x1875738116599936:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843611.076253:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+18:2389:x1875738116599936:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 87us (5853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843611.076261:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 349 00000100:00100000:1.0:1788843611.076281:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 350 00000100:00100000:1.0:1788843611.076288:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2389:x1875738116600448:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843611.076313:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2389:x1875738116600448:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 26us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843611.076320:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 350 00000100:00100000:2.0:1788843611.076690:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 151 00000100:00100000:2.0:1788843611.076705:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2389:x1875738116600192:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843611.076751:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2389:x1875738116600192:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 53us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843611.076758:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 151 00000100:00080000:2.0:1788843611.076793:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788843611.076799:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788843611.290435:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843612.058708:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007243b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134475136:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788843612.058807:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843612.059097:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134475136 00000100:00100000:2.0:1788843612.059117:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134475136 00000100:00100000:2.0:1788843612.059239:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788843612.059251:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134475136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788843612.059436:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788843612.059510:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134475136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 260us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843612.059518:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788843612.059769:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134475264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788843612.059808:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843612.059855:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134475264 00000100:00100000:0.0:1788843612.059861:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134475264 00000100:00100000:0.0:1788843612.059891:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788843612.059899:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134475264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788843612.059920:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788843612.059958:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134475264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843612.059965:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788843612.060497:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134475264:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788843612.060648:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007243b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134475136:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788843612.317293:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843613.340530:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843614.362338:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843614.422785:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843614.422839:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116600704 00000100:00100000:3.0:1788843614.422852:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116600704 00000100:00100000:3.0:1788843614.422945:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 255 00000100:00100000:3.0:1788843614.422960:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+18:12138:x1875738116600704:12345-192.168.203.33@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788843614.423107:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+18:12138:x1875738116600704:12345-192.168.203.33@tcp:60:lhsmtool_posix.0 Request processed in 151us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843614.423116:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 255 00000100:00080000:2.0:1788843614.424289:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843614.425350:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843614.425389:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116600832 00000100:00100000:3.0:1788843614.425398:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116600832 00000100:00100000:3.0:1788843614.425463:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 256 00000100:00100000:3.0:1788843614.425474:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:12138:x1875738116600832:12345-192.168.203.33@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788843614.425588:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:12138:x1875738116600832:12345-192.168.203.33@tcp:60:lhsmtool_posix.0 Request processed in 116us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843614.425597:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 256 00000100:00080000:3.0:1788843614.425619:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788843614.435248:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843614.443106:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116601088 00000100:00100000:3.0:1788843614.443129:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116601088 00000100:00100000:3.0:1788843614.443251:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 65 00000100:00100000:3.0:1788843614.443263:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+18:12138:x1875738116601088:12345-192.168.203.33@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788843614.443558:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+19:12138:x1875738116601088:12345-192.168.203.33@tcp:35:lhsmtool_posix.0 Request processed in 296us (8323us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1788843614.443566:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 65 00000100:00100000:3.0:1788843614.646825:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843614.647256:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116601216 00000100:00100000:2.0:1788843614.647291:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116601216 00000100:00100000:3.0:1788843614.647762:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 257 00000100:00100000:3.0:1788843614.647777:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:12942:x1875738116601216:12345-192.168.203.33@tcp:101:lsof.0 00010000:00010000:3.0:1788843614.647807:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843614.647838:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d20e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490c7d expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843614.647936:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d20eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843614.647957:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d20eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843614.647983:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d20eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843614.648057:0:6507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788843614.648062:0:6507:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788843614.648107:0:6507:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d20eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843614.648138:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3c00/0xa762dfcbd58d20e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c7d expref: 7 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843614.648221:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d20eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c7d expref: 6 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843614.648230:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd007450600) 00010000:00010000:3.0:1788843614.648233:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788843614.648238:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be2c00, rc 0) 00000100:00100000:3.0:1788843614.648335:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+6:12942:x1875738116601216:12345-192.168.203.33@tcp:101:lsof.0 Request processed in 561us (1526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843614.648343:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 257 00000100:00080000:2.0:1788843614.652802:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788843615.386942:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843615.643339:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134475392:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788843615.643467:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843615.643627:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134475392 00000100:00100000:3.0:1788843615.643638:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134475392 00000100:00100000:3.0:1788843615.643720:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788843615.643733:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134475392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788843615.643767:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843615.643820:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134475392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843615.643827:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:0.0:1788843615.643937:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843615.643996:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134475392:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788843615.644253:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134475520:0@lo:400:kworker.0 00000100:00100000:1.0:1788843615.644296:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843615.647274:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134475776:0@lo:400:kworker.0 00000100:00100000:0.0:1788843615.647396:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1875738134475904:0@lo:400:kworker.0 00000100:00100000:2.0:1788843615.647408:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843615.647433:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843615.647484:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134476288:0@lo:400:kworker.0 00000100:00100000:2.0:1788843615.647510:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843615.647534:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134476800:0@lo:400:kworker.0 00000100:00100000:2.0:1788843615.647557:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843615.647626:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134475904 00000100:00100000:2.0:1788843615.647636:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134475904 00000100:00100000:2.0:1788843615.647824:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134476288 00000100:00100000:0.0:1788843615.649059:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134476416:0@lo:400:kworker.0 00000100:00100000:0.0:1788843615.649164:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843615.649219:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134476928:0@lo:400:kworker.0 00000100:00100000:0.0:1788843615.649243:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843615.649253:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134476288 00000100:00100000:0.0:1788843615.649303:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134475776 00000100:00100000:0.0:1788843615.649307:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134475776 00000100:00100000:2.0:1788843615.649332:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1788843615.649343:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1875738134475904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843615.649350:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788843615.649358:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134475776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843615.649409:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1875738134475904:12345-0@lo:400:kworker.0 Request processed in 68us (1974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843615.649409:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134475776:12345-0@lo:400:kworker.0 Request processed in 52us (2001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843615.649417:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1788843615.649417:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788843615.649436:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788843615.649443:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134476288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843615.649443:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134476800 00000100:00100000:0.0:1788843615.649446:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134476800 00000100:00100000:2.0:1788843615.649472:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134476288:12345-0@lo:400:kworker.0 Request processed in 30us (1961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843615.649473:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134476416 00000100:00100000:0.0:1788843615.649475:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134476416 00000100:00100000:2.0:1788843615.649478:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788843615.649492:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134476928 00000100:00100000:0.0:1788843615.649494:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134476928 00000100:00100000:2.0:1788843615.649496:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788843615.649502:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134476800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843615.649507:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788843615.649512:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134476416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843615.649533:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134476800:12345-0@lo:400:kworker.0 Request processed in 31us (1974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843615.649536:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134476416:12345-0@lo:400:kworker.0 Request processed in 25us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843615.649558:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788843615.649712:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788843615.649727:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788843615.649733:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134476928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843615.649764:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134476928:12345-0@lo:400:kworker.0 Request processed in 32us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843615.649770:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:0.0:1788843615.649796:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788843615.649802:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788843615.649804:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788843615.649841:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1875738134475904:0@lo:400:kworker.0 00000100:00100000:0.0:1788843615.649908:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134476416:0@lo:400:kworker.0 00000100:00100000:0.0:1788843615.649924:0:3631:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:0.0:1788843615.649930:0:3631:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd008625500, transno 4294967323 00000004:00080000:0.0:1788843615.649944:0:3631:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:0.0:1788843615.650225:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134476928:0@lo:400:kworker.0 00000100:00100000:3.0:1788843615.651119:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134475776:0@lo:400:kworker.0 00010000:00080000:3.0:1788843615.651157:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00799b100 x1875738134476288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843615.651168:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134476288:0@lo:400:kworker.0 00000100:00100000:3.0:1788843615.651183:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134476800:0@lo:400:kworker.0 00000100:00100000:3.0:1788843615.651231:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134475648:0@lo:400:kworker.0 00000100:00100000:3.0:1788843615.651314:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843615.651348:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1875738134476160:0@lo:400:kworker.0 00000100:00100000:3.0:1788843615.651373:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843615.651391:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134476672:0@lo:400:kworker.0 00000100:00100000:3.0:1788843615.651413:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843615.651445:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134475648 00000100:00100000:3.0:1788843615.651453:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134475648 00000100:00100000:3.0:1788843615.651496:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134476160 00000100:00100000:3.0:1788843615.651499:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134476160 00000100:00100000:3.0:1788843615.651524:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134476672 00000100:00100000:3.0:1788843615.651527:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134476672 00000100:00100000:3.0:1788843615.651543:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788843615.651550:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134475648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843615.651601:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134475648:12345-0@lo:400:kworker.0 Request processed in 51us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843615.651608:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788843615.651626:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1788843615.651632:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875738134476160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843615.651657:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875738134476160:12345-0@lo:400:kworker.0 Request processed in 26us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843615.651662:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1788843615.651672:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1788843615.651677:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875738134476672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843615.651702:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875738134476672:12345-0@lo:400:kworker.0 Request processed in 25us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843615.651708:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1788843615.651921:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134476032:0@lo:400:kworker.0 00000100:00100000:1.0:1788843615.651956:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843615.652064:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134476032 00000100:00100000:1.0:1788843615.652069:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134476032 00000100:00100000:1.0:1788843615.652118:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788843615.652124:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134476032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843615.652172:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134476032:12345-0@lo:400:kworker.0 Request processed in 48us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843615.652178:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788843615.652197:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134475520 00000100:00100000:2.0:1788843615.652203:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134475520 00000100:00100000:1.0:1788843615.652203:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134476032:0@lo:400:kworker.0 00000100:00100000:1.0:1788843615.652210:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1875738134476544:0@lo:400:kworker.0 00000100:00100000:1.0:1788843615.652233:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843615.652234:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1788843615.652241:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3632:x1875738134475520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843615.652249:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134476544 00000100:00100000:1.0:1788843615.652252:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134476544 00000100:00100000:2.0:1788843615.652277:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3632:x1875738134475520:12345-0@lo:400:kworker.0 Request processed in 37us (7981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843615.652277:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788843615.652282:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1875738134476544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843615.652284:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1788843615.652308:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1875738134476544:12345-0@lo:400:kworker.0 Request processed in 26us (74us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843615.652313:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00080000:2.0:1788843615.652324:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788843615.652334:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1875738134476544:0@lo:400:kworker.0 00000100:00080000:2.0:1788843615.652341:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843615.652357:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134475520:0@lo:400:kworker.0 00000100:00100000:3.0:1788843615.653384:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134475648:0@lo:400:kworker.0 00000100:00100000:3.0:1788843615.653420:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1875738134476160:0@lo:400:kworker.0 00010000:00080000:3.0:1788843615.653438:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007998e00 x1875738134476672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843615.653450:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134476672:0@lo:400:kworker.0 00000001:00080000:0.0:1788843615.656375:0:6485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:0.0:1788843615.656394:0:6485:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1788843615.656489:0:6538:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788843615.656502:0:6538:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:3.0:1788843616.154768:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788843616.154799:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134477056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843616.154899:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843616.154991:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134477056 00000100:00100000:3.0:1788843616.155000:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134477056 00000100:00100000:3.0:1788843616.155059:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788843616.155071:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134477056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788843616.155119:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788843616.155194:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134477056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843616.155202:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788843616.155259:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134477056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788843616.156104:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788843616.156122:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134477184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788843616.156220:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843616.156480:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134477184 00000100:00100000:1.0:1788843616.156488:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134477184 00000100:00100000:1.0:1788843616.156543:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788843616.156552:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134477184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788843616.156573:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788843616.156619:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134477184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843616.156626:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788843616.157321:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134477184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843616.158463:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134477312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788843616.158544:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843616.158658:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134477312 00000100:00100000:0.0:1788843616.158667:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134477312 00000100:00100000:0.0:1788843616.158729:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788843616.158749:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134477312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788843616.158791:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788843616.159564:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134477312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 821us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843616.159576:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788843616.161616:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134477312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788843616.173322:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843616.173371:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843616.173572:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116601344 00000100:00100000:0.0:1788843616.173586:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116601344 00000100:00100000:0.0:1788843616.173663:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 397 00000100:00100000:0.0:1788843616.173677:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+13:2388:x1875738116601344:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1788843616.173784:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+13:2388:x1875738116601344:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 109us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843616.173791:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 397 00000100:00100000:3.0:1788843616.174187:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843616.174213:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843616.174367:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116601856 00000100:00100000:0.0:1788843616.174373:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116601856 00000100:00100000:0.0:1788843616.174433:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 155 00000100:00100000:0.0:1788843616.174442:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2388:x1875738116601856:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1788843616.174488:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2388:x1875738116601856:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 48us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843616.174496:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 155 00000100:00080000:1.0:1788843616.174909:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788843616.181004:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843616.183722:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116601600 00000100:00100000:2.0:1788843616.183744:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116601600 00000100:00100000:0.0:1788843616.183937:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116602112 00000100:00100000:0.0:1788843616.183943:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116602112 00000100:00080000:1.0:1788843616.183975:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788843616.192291:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843616.192333:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843616.193027:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116601728 00000100:00100000:1.0:1788843616.193042:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116601728 00000100:00100000:1.0:1788843616.193344:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 156 00000100:00100000:1.0:1788843616.193358:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116601728:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843616.193525:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116601728:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 170us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843616.193533:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 156 00000100:00100000:1.0:1788843616.193563:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116601472 00000100:00100000:1.0:1788843616.193568:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116601472 00000100:00100000:1.0:1788843616.193599:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116601984 00000100:00100000:1.0:1788843616.193602:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116601984 00000100:00100000:1.0:1788843616.193618:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 357 00000100:00100000:1.0:1788843616.193625:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2388:x1875738116601600:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843616.193659:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2388:x1875738116601600:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 35us (20288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843616.193666:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 357 00000100:00100000:1.0:1788843616.193679:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 358 00000100:00100000:1.0:1788843616.193685:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+18:2387:x1875738116601472:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843616.193724:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+18:2387:x1875738116601472:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 39us (12736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843616.193730:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 358 00000100:00100000:1.0:1788843616.193741:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 359 00000100:00100000:1.0:1788843616.193748:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+6:2387:x1875738116601984:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843616.193772:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+6:2387:x1875738116601984:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 25us (1439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843616.193795:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 359 00000100:00080000:3.0:1788843616.194048:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788843616.194054:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843616.194859:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 360 00000100:00100000:0.0:1788843616.194872:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2388:x1875738116602112:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1788843616.194948:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2388:x1875738116602112:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 78us (20733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843616.194955:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 360 00010000:00010000:2.0:1788843616.410800:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843617.178523:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134477440:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788843617.178644:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843617.178880:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134477440 00000100:00100000:0.0:1788843617.178891:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134477440 00000100:00100000:0.0:1788843617.179000:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788843617.179012:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134477440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788843617.179056:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788843617.179129:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134477440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843617.179136:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788843617.179295:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134477440:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788843617.179328:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788843617.179339:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007240e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134477568:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788843617.179373:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843617.186623:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134477568 00000100:00100000:1.0:1788843617.186647:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134477568 00000100:00100000:1.0:1788843617.186718:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788843617.186731:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134477568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788843617.186785:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788843617.186905:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134477568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 177us (7531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843617.186913:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788843617.191941:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007240e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134477568:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788843617.435577:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843618.461329:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788843618.461467:0:14949:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 01:00:16 (1788843616) 00010000:00010000:0.0:1788843619.482319:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788843619.675612:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788843619.995599:0:13785:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788843619.995616:0:13785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788843619.995783:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1788843619.995794:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788843620.508454:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843620.765727:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007240a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134477824:0@lo:400:kworker.0 00000100:00100000:2.0:1788843620.765823:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843620.765891:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00849aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134478336:0@lo:400:kworker.0 00000100:00100000:2.0:1788843620.765916:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843620.765947:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008499180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1875738134478848:0@lo:400:kworker.0 00000100:00100000:2.0:1788843620.765972:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843620.766006:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788843620.766012:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134477952:0@lo:400:kworker.0 00000100:00100000:2.0:1788843620.766039:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843620.766067:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008498380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134478464:0@lo:400:kworker.0 00000100:00100000:2.0:1788843620.766088:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843620.766104:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008499500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134478976:0@lo:400:kworker.0 00000100:00100000:2.0:1788843620.766124:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843620.766192:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134477824 00000100:00100000:2.0:1788843620.766203:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134477824 00000100:00100000:2.0:1788843620.766252:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134478336 00000100:00100000:2.0:1788843620.766256:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134478336 00000100:00100000:2.0:1788843620.766280:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134478848 00000100:00100000:2.0:1788843620.766283:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134478848 00000100:00100000:2.0:1788843620.766297:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134478464 00000100:00100000:2.0:1788843620.766299:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134478464 00000100:00100000:2.0:1788843620.766311:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134478976 00000100:00100000:2.0:1788843620.766313:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134478976 00000100:00100000:2.0:1788843620.766329:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1788843620.766339:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00849a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134477824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843620.766403:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00849a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134477824:12345-0@lo:400:kworker.0 Request processed in 64us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843620.766412:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1788843620.766432:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1788843620.766438:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00849b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134478336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843620.766465:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00849b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134478336:12345-0@lo:400:kworker.0 Request processed in 28us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843620.766483:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1788843620.766497:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1788843620.766503:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008499f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875738134478848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843620.766531:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008499f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875738134478848:12345-0@lo:400:kworker.0 Request processed in 29us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843620.766537:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1788843620.766548:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1788843620.766554:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008498000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134478464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843620.766579:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008498000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134478464:12345-0@lo:400:kworker.0 Request processed in 26us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843620.766584:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1788843620.766596:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1788843620.766602:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008499880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134478976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843620.766629:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008499880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134478976:12345-0@lo:400:kworker.0 Request processed in 28us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843620.766635:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00080000:2.0:1788843620.766658:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788843620.766663:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788843620.766722:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd008498380 x1875738134478464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843620.766738:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008498380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134478464:0@lo:400:kworker.0 00010000:00080000:2.0:1788843620.766750:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd008499500 x1875738134478976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843620.766759:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008499500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134478976:0@lo:400:kworker.0 00000100:00100000:2.0:1788843620.766780:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007240a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134477824:0@lo:400:kworker.0 00000100:00100000:2.0:1788843620.766791:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00849aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134478336:0@lo:400:kworker.0 00000100:00100000:2.0:1788843620.766801:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008499180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1875738134478848:0@lo:400:kworker.0 00000100:00100000:3.0:1788843620.766915:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007240e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134477696:0@lo:400:kworker.0 00000100:00100000:3.0:1788843620.766961:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843620.767001:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007243b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134478208:0@lo:400:kworker.0 00000100:00100000:3.0:1788843620.767029:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843620.767061:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008498700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134478720:0@lo:400:kworker.0 00000100:00100000:3.0:1788843620.767088:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843620.767109:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00849b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134479232:0@lo:400:kworker.0 00000100:00100000:3.0:1788843620.767131:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843620.767180:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788843620.767186:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007241880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134478080:0@lo:400:kworker.0 00000100:00100000:3.0:1788843620.767212:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843620.767230:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00849bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134478592:0@lo:400:kworker.0 00000100:00100000:3.0:1788843620.767252:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843620.767266:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008498a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134479104:0@lo:400:kworker.0 00000100:00100000:3.0:1788843620.767286:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843620.767318:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134477952 00000100:00100000:3.0:1788843620.767335:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134477952 00000100:00100000:3.0:1788843620.767374:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134478208 00000100:00100000:3.0:1788843620.767377:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134478208 00000100:00100000:3.0:1788843620.767393:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788843620.767400:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134477952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843620.767446:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134477952:12345-0@lo:400:kworker.0 Request processed in 46us (1405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843620.767453:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788843620.767466:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788843620.767472:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134478208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843620.767501:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134478208:12345-0@lo:400:kworker.0 Request processed in 29us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843620.767507:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788843620.767525:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134478720 00000100:00100000:3.0:1788843620.767528:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134478720 00000100:00100000:3.0:1788843620.767555:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134479232 00000100:00100000:3.0:1788843620.767558:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134479232 00000100:00100000:3.0:1788843620.767570:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134478592 00000100:00100000:3.0:1788843620.767572:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134478592 00000100:00100000:3.0:1788843620.767583:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134479104 00000100:00100000:3.0:1788843620.767585:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134479104 00000100:00100000:3.0:1788843620.767598:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788843620.767604:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134478720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843620.767633:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134478720:12345-0@lo:400:kworker.0 Request processed in 30us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843620.767639:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788843620.767649:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788843620.767655:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134479232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843620.767690:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134479232:12345-0@lo:400:kworker.0 Request processed in 34us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843620.767696:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788843620.767706:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788843620.767712:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134478592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843620.767737:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134478592:12345-0@lo:400:kworker.0 Request processed in 25us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843620.767743:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788843620.767753:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788843620.767759:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134479104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843620.767782:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134479104:12345-0@lo:400:kworker.0 Request processed in 23us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843620.767788:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:3.0:1788843620.767817:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788843620.767821:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843620.767847:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00849bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134478592:0@lo:400:kworker.0 00000100:00100000:3.0:1788843620.767858:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008498a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134479104:0@lo:400:kworker.0 00000100:00100000:3.0:1788843620.767867:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007243b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134478208:0@lo:400:kworker.0 00000100:00100000:3.0:1788843620.767886:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008498700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134478720:0@lo:400:kworker.0 00000100:00100000:3.0:1788843620.767895:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00849b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134479232:0@lo:400:kworker.0 00000100:00100000:3.0:1788843620.767929:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134478080 00000100:00100000:3.0:1788843620.767933:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134478080 00000100:00100000:3.0:1788843620.767957:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1788843620.767963:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134478080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843620.768006:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134478080:12345-0@lo:400:kworker.0 Request processed in 42us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843620.768014:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1788843620.768037:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007241880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134478080:0@lo:400:kworker.0 00000100:00100000:3.0:1788843620.768078:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134477952:0@lo:400:kworker.0 00000100:00100000:2.0:1788843620.768414:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134477696 00000100:00100000:2.0:1788843620.768419:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134477696 00000100:00100000:2.0:1788843620.768453:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1788843620.768461:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3633:x1875738134477696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843620.768506:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3633:x1875738134477696:12345-0@lo:400:kworker.0 Request processed in 46us (1544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843620.768613:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1788843620.768657:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007240e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134477696:0@lo:400:kworker.0 00000100:00100000:3.0:1788843620.782062:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008499180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134479360:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788843620.782209:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843620.782300:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134479360 00000100:00100000:3.0:1788843620.782311:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134479360 00000100:00100000:3.0:1788843620.782375:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788843620.782386:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134479360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788843620.782425:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843620.782478:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134479360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843620.782485:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788843620.782560:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008499180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134479360:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788843621.274916:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843621.274950:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134479488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788843621.275055:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843621.275375:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788843621.275387:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00849aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134479616:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788843621.275423:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843621.275901:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788843621.275913:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134479744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843621.275950:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843621.275990:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134479488 00000100:00100000:1.0:1788843621.275999:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134479488 00000100:00100000:1.0:1788843621.276057:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134479616 00000100:00100000:1.0:1788843621.276060:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134479616 00000100:00100000:1.0:1788843621.276073:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134479744 00000100:00100000:1.0:1788843621.276075:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134479744 00000100:00100000:1.0:1788843621.276090:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788843621.276100:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134479488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788843621.276177:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788843621.276233:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134479488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (1178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843621.276241:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788843621.276260:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788843621.276266:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008499500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134479616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788843621.276275:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788843621.276299:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008499500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134479616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843621.276305:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788843621.276315:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788843621.276321:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00799b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134479744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788843621.276403:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788843621.276437:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00799b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134479744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843621.276443:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788843621.276493:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134479744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843621.276674:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134479488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788843621.276854:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00849aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134479616:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788843621.295287:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843621.295827:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116602240 00000100:00100000:1.0:1788843621.295841:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116602240 00000100:00100000:1.0:1788843621.295923:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 399 00000100:00100000:1.0:1788843621.295937:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+13:2388:x1875738116602240:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843621.296053:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7928f422-fe0e-4906-b099-11067616e1bb+13:2388:x1875738116602240:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 118us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843621.296083:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 399 00000100:00100000:3.0:1788843621.296873:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843621.296986:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843621.297022:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843621.297055:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843621.297076:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843621.297102:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843621.297131:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116602752 00000100:00100000:3.0:1788843621.297216:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116602752 00000100:00100000:0.0:1788843621.297230:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116602496 00000100:00100000:0.0:1788843621.297234:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116602496 00000100:00100000:3.0:1788843621.297285:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116602624 00000100:00100000:3.0:1788843621.297288:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116602624 00000100:00100000:1.0:1788843621.297299:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 161 00000100:00100000:1.0:1788843621.297309:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2387:x1875738116602752:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843621.297376:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2387:x1875738116602752:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 69us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843621.297396:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 161 00000100:00100000:1.0:1788843621.297424:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116603008 00000100:00100000:1.0:1788843621.297428:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116603008 00000100:00100000:0.0:1788843621.297638:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116602368 00000100:00100000:0.0:1788843621.297643:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116602368 00000100:00100000:0.0:1788843621.297658:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116602880 00000100:00100000:0.0:1788843621.297661:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116602880 00000100:00100000:0.0:1788843621.297678:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 367 00000100:00100000:0.0:1788843621.297685:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116602496:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1788843621.299509:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116602496:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 1806us (2624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843621.299528:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 367 00000100:00100000:0.0:1788843621.299581:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 368 00000100:00100000:0.0:1788843621.299596:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+18:2387:x1875738116602368:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1788843621.299655:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+18:2387:x1875738116602368:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 66us (2599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843621.299661:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 368 00000100:00100000:0.0:1788843621.299697:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 369 00000100:00100000:0.0:1788843621.299705:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+6:2387:x1875738116602880:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1788843621.299867:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+6:2387:x1875738116602880:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 162us (2763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843621.299874:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 369 00000100:00100000:3.0:1788843621.302750:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 162 00000100:00100000:3.0:1788843621.302769:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f985500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116602624:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843621.302862:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f985500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2387:x1875738116602624:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 100us (5784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843621.302870:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 162 00000100:00080000:2.0:1788843621.305851:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788843621.305868:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788843621.305872:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788843621.305876:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788843621.309254:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 370 00000100:00100000:1.0:1788843621.309275:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2387:x1875738116603008:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843621.309463:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2387:x1875738116603008:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 193us (12438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843621.309472:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 370 00010000:00010000:1.0:1788843621.532013:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843622.298704:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134480000:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788843622.298805:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843622.298909:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788843622.298916:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008498380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134479872:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788843622.298941:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843622.299017:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134480000 00000100:00100000:0.0:1788843622.299027:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134480000 00000100:00100000:0.0:1788843622.299096:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134479872 00000100:00100000:0.0:1788843622.299100:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134479872 00000100:00100000:0.0:1788843622.299119:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788843622.299129:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134480000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788843622.299206:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788843622.299264:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134480000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843622.299271:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788843622.299290:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788843622.299296:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134479872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788843622.299315:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788843622.299344:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134479872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 47us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843622.299349:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788843622.299602:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008498380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134479872:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788843622.299616:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134480000:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788843622.556597:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843623.274349:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843623.274671:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116603264 00000100:00100000:0.0:1788843623.274685:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116603264 00000100:00100000:0.0:1788843623.274781:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 66 00000100:00100000:0.0:1788843623.274796:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+18:13165:x1875738116603264:12345-192.168.203.33@tcp:35:umount.0 00000100:00100000:0.0:1788843623.275192:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+19:13165:x1875738116603264:12345-192.168.203.33@tcp:35:umount.0 Request processed in 400us (858us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788843623.275219:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 66 00000100:00080000:1.0:1788843623.275298:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843623.280204:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843623.280423:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116603520 00000100:00100000:0.0:1788843623.280438:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116603520 00000100:00100000:0.0:1788843623.280518:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 67 00000100:00100000:0.0:1788843623.280530:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00799b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+19:13165:x1875738116603520:12345-192.168.203.33@tcp:35:umount.0 00000100:00100000:0.0:1788843623.281269:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00799b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+20:13165:x1875738116603520:12345-192.168.203.33@tcp:35:umount.0 Request processed in 732us (1073us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1788843623.281279:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 67 00000100:00100000:3.0:1788843623.291066:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843623.291250:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116603776 00000100:00100000:0.0:1788843623.291263:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116603776 00000100:00100000:0.0:1788843623.291340:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 68 00000100:00100000:0.0:1788843623.291353:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12e1e5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+20:13165:x1875738116603776:12345-192.168.203.33@tcp:35:umount.0 00000100:00100000:0.0:1788843623.292090:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12e1e5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+21:13165:x1875738116603776:12345-192.168.203.33@tcp:35:umount.0 Request processed in 736us (1034us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1788843623.292102:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 68 00000100:00100000:3.0:1788843623.309242:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843623.309433:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116604032 00000100:00100000:2.0:1788843623.309448:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116604032 00000100:00100000:2.0:1788843623.309533:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 69 00000100:00100000:2.0:1788843623.309546:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+21:13165:x1875738116604032:12345-192.168.203.33@tcp:35:umount.0 00000100:00100000:2.0:1788843623.309936:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+22:13165:x1875738116604032:12345-192.168.203.33@tcp:35:umount.0 Request processed in 391us (711us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1788843623.309967:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 69 00000100:00100000:1.0:1788843623.319381:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843623.319587:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116604160 00000100:00100000:3.0:1788843623.319601:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116604160 00000100:00100000:3.0:1788843623.319687:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 20 00000100:00100000:3.0:1788843623.319710:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00799bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7928f422-fe0e-4906-b099-11067616e1bb+13:2388:x1875738116604160:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843623.319732:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843623.319759:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd10fa3c600/0xa762dfcbd58d1044 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224907d0 expref: 13 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843623.319781:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843623.319889:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00799bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7928f422-fe0e-4906-b099-11067616e1bb+12:2388:x1875738116604160:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 189us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843623.319899:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 20 00000100:00100000:3.0:1788843623.324907:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843623.325087:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116604288 00000100:00100000:1.0:1788843623.325103:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116604288 00000100:00100000:1.0:1788843623.325234:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 21 00000100:00100000:1.0:1788843623.325247:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f986d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7928f422-fe0e-4906-b099-11067616e1bb+12:2387:x1875738116604288:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843623.325268:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843623.325298:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1420e4800/0xa762dfcbd58d1005 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490791 expref: 12 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843623.325346:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843623.325414:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f986d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7928f422-fe0e-4906-b099-11067616e1bb+11:2387:x1875738116604288:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 170us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843623.325422:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 21 00000100:00100000:3.0:1788843623.327006:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843623.327089:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116604416 00000100:00100000:2.0:1788843623.327103:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116604416 00000100:00100000:2.0:1788843623.327189:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 22 00000100:00100000:2.0:1788843623.327200:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f986a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7928f422-fe0e-4906-b099-11067616e1bb+11:2387:x1875738116604416:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843623.327219:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843623.327241:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd10f7ae600/0xa762dfcbd58d1315 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908a9 expref: 11 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843623.327259:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843623.327320:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f986a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7928f422-fe0e-4906-b099-11067616e1bb+10:2387:x1875738116604416:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 111us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843623.327329:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 22 00000100:00100000:3.0:1788843623.336830:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843623.345372:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116604800 00000100:00100000:1.0:1788843623.345397:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116604800 00000100:00100000:1.0:1788843623.345509:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 80 00000100:00100000:1.0:1788843623.345523:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f984700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2386:x1875738116604800:12345-192.168.203.33@tcp:9:umount.0 00000020:00000080:1.0:1788843623.345564:0:8901:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d1656 00000020:00010000:1.0:1788843623.345574:0:8901:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9bd141bd3800: total 0 00000100:00080000:1.0:1788843623.345579:0:8901:0:(import.c:65:import_set_state_nolock()) ffff9bd141bd1800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788843623.345644:0:8901:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1788843623.346196:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f984700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2386:x1875738116604800:12345-192.168.203.33@tcp:9:umount.0 Request processed in 672us (9377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843623.346206:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 80 00000020:00010000:1.0:1788843623.346234:0:6495:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9bd141bd3800: total 0 00010000:00010000:1.0:1788843623.346265:0:6495:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bd141bd3800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788843623.346947:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007830bb91/0xa762dfcbd58d20dd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c76 expref: 4 pid: 8901 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843623.346995:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040cae72d/0xa762dfcbd58d1a0e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a93 expref: 3 pid: 8901 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843623.347014:0:6495:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bd141bd3800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788843623.347048:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843623.347068:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843623.347070:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788843623.347214:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788843623.350973:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843623.351278:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116604928 00000100:00100000:3.0:1788843623.351291:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116604928 00000100:00100000:3.0:1788843623.351387:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 81 00000100:00100000:3.0:1788843623.351401:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2386:x1875738116604928:12345-192.168.203.33@tcp:9:umount.0 00000020:00000080:3.0:1788843623.351441:0:8423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d13e0 00000100:00080000:3.0:1788843623.351452:0:8423:0:(import.c:65:import_set_state_nolock()) ffff9bd141a78000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788843623.351514:0:8423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00080000:1.0:1788843623.351992:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843623.352037:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+2:2386:x1875738116604928:12345-192.168.203.33@tcp:9:umount.0 Request processed in 629us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843623.352046:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 81 00010000:00010000:2.0:1788843623.353118:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843623.378878:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843623.378971:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116605952 00000100:00100000:0.0:1788843623.378986:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116605952 00000100:00100000:0.0:1788843623.379076:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 258 00000100:00100000:0.0:1788843623.379089:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00849ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+22:2386:x1875738116605952:12345-192.168.203.33@tcp:39:umount.0 00000020:00000080:0.0:1788843623.379187:0:6506:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d1013 00000020:00010000:0.0:1788843623.379209:0:6506:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9bd0078e2000: total 0 00000100:00080000:0.0:1788843623.379215:0:6506:0:(import.c:65:import_set_state_nolock()) ffff9bd10f938000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788843623.379245:0:6506:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:1.0:1788843623.379410:0:10329:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9bd0078e2000: total 0 00010000:00010000:1.0:1788843623.379493:0:10329:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bd0078e2000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788843623.379541:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bd007730100) 00010000:00010000:1.0:1788843623.379546:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788843623.379556:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f70600/0xa762dfcbd58d16b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224909ac expref: 21 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843623.379583:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd00746cd00) 00010000:00010000:1.0:1788843623.379586:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843623.379590:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fb35400/0xa762dfcbd58d135b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908be expref: 20 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843623.379613:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd007450300) 00010000:00010000:1.0:1788843623.379616:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788843623.379620:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea000/0xa762dfcbd58d1fbe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c29 expref: 19 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843623.379634:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd007403000) 00010000:00010000:1.0:1788843623.379636:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788843623.379639:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be3e00/0xa762dfcbd58d19f9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a8c expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843623.379652:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd007403000) 00010000:00010000:1.0:1788843623.379655:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788843623.379658:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d18ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a46 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843623.379698:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bd0071de800) 00010000:00010000:1.0:1788843623.379701:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788843623.379705:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c200/0xa762dfcbd58d133f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908b7 expref: 16 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843623.379720:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bd007450c00) 00010000:00010000:1.0:1788843623.379723:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788843623.379727:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbeb200/0xa762dfcbd58d1a93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ab6 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843623.379739:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd007450300) 00010000:00010000:1.0:1788843623.379742:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788843623.379745:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2e00/0xa762dfcbd58d20c8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c6f expref: 14 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843623.379756:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9bd007730100) 00010000:00010000:1.0:1788843623.379758:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788843623.379761:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100031400/0xa762dfcbd58d13b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908d3 expref: 13 pid: 11996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843623.379778:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9bd007450300) 00010000:00010000:1.0:1788843623.379780:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788843623.379785:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd13fbea600/0xa762dfcbd58d209e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c61 expref: 12 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843623.379799:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd007450600) 00010000:00010000:1.0:1788843623.379801:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788843623.379813:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2600/0xa762dfcbd58d1a77 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490aaf expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843623.379828:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9bd007403000) 00010000:00010000:1.0:1788843623.379830:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788843623.379834:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947600/0xa762dfcbd58d19cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490a7e expref: 10 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843623.379849:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9bd007450c00) 00010000:00010000:1.0:1788843623.379851:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788843623.379855:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2800/0xa762dfcbd58d1d80 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490b8f expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843623.379869:0:10329:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bd0078e2000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1788843623.379887:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843623.379889:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843623.379891:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843623.380112:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00849ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+7:2386:x1875738116605952:12345-192.168.203.33@tcp:39:umount.0 Request processed in 1024us (1249us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1788843623.380130:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 258 00000100:00100000:0.0:1788843623.406296:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843623.406457:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116606080 00000100:00100000:1.0:1788843623.406470:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116606080 00000100:00100000:1.0:1788843623.406572:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 259 00000100:00100000:1.0:1788843623.406585:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+5:2386:x1875738116606080:12345-192.168.203.33@tcp:39:umount.0 00000020:00000080:1.0:1788843623.406628:0:6507:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d101a 00000100:00080000:1.0:1788843623.406652:0:6507:0:(import.c:65:import_set_state_nolock()) ffff9bd10f93b800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788843623.406696:0:6507:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788843623.406915:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f25f61b6-5faf-4e05-81a4-dea3dba05dc5+3:2386:x1875738116606080:12345-192.168.203.33@tcp:39:umount.0 Request processed in 332us (632us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788843623.406924:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 259 00010000:00010000:2.0:1788843623.407342:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788843623.409921:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788843623.578525:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843624.604489:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843625.626521:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843625.830373:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843625.830430:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843625.830483:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843625.830603:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116606336 00000100:00100000:1.0:1788843625.830616:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116606336 00000100:00100000:1.0:1788843625.830702:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116606208 00000100:00100000:1.0:1788843625.830707:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116606208 00000100:00100000:1.0:1788843625.830721:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116606464 00000100:00100000:1.0:1788843625.830724:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116606464 00000100:00100000:1.0:1788843625.830741:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 23 00000100:00100000:1.0:1788843625.830753:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f985880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7928f422-fe0e-4906-b099-11067616e1bb+12:2388:x1875738116606336:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843625.830774:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843625.830801:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd10fa3c400/0xa762dfcbd58d111d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490816 expref: 12 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843625.830824:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843625.830891:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f985880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7928f422-fe0e-4906-b099-11067616e1bb+11:2388:x1875738116606336:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 140us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843625.830900:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 23 00000100:00100000:1.0:1788843625.830919:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 24 00000100:00100000:1.0:1788843625.830925:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13332b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7928f422-fe0e-4906-b099-11067616e1bb+10:2388:x1875738116606208:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843625.830933:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843625.830943:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd13fb34000/0xa762dfcbd58d1116 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224907e5 expref: 10 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843625.830952:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843625.830972:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13332b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7928f422-fe0e-4906-b099-11067616e1bb+9:2388:x1875738116606208:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 47us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843625.830978:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 24 00000100:00100000:1.0:1788843625.831033:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 25 00000100:00100000:1.0:1788843625.831057:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f984e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7928f422-fe0e-4906-b099-11067616e1bb+8:2388:x1875738116606464:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843625.831065:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843625.831075:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd100031600/0xa762dfcbd58d12e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224908a2 expref: 8 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843625.831085:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843625.831101:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f984e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7928f422-fe0e-4906-b099-11067616e1bb+7:2388:x1875738116606464:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 45us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843625.831107:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 25 00000100:00100000:1.0:1788843625.863820:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843625.877877:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116606720 00000100:00100000:3.0:1788843625.877900:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116606720 00000100:00100000:3.0:1788843625.878036:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 260 00000100:00100000:3.0:1788843625.878051:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00799bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+6:2386:x1875738116606720:12345-192.168.203.33@tcp:39:umount.0 00000020:00000080:3.0:1788843625.878107:0:6508:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d112b 00000020:00010000:3.0:1788843625.878118:0:6508:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9bd007224000: total 0 00000100:00080000:3.0:1788843625.878124:0:6508:0:(import.c:65:import_set_state_nolock()) ffff9bd007224800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788843625.878227:0:6508:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:3.0:1788843625.878484:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00799bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2386:x1875738116606720:12345-192.168.203.33@tcp:39:umount.0 Request processed in 435us (14680us total) trans 4294967528 rc 0/0 00000100:00100000:3.0:1788843625.878492:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 260 00000100:00080000:1.0:1788843625.878930:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:2.0:1788843625.879394:0:6494:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9bd007224000: total 0 00010000:00010000:2.0:1788843625.879477:0:6494:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bd007224000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788843625.879522:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd007450600) 00010000:00010000:2.0:1788843625.879526:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788843625.879540:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007be2c00/0xa762dfcbd58d20eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c7d expref: 4 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843625.879564:0:6494:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bd007224000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788843625.879577:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843625.879580:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843625.879596:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843625.886351:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008499c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134480128:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788843625.886456:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843625.886778:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134480128 00000100:00100000:2.0:1788843625.886792:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134480128 00000100:00100000:2.0:1788843625.886854:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788843625.886866:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134480128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788843625.886905:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788843625.886989:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134480128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 126us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843625.886996:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788843625.887061:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008499c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134480128:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1788843625.887237:0:6485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bdfa9d4d-a4fc-4db6-8668-5ed8e821acee 00000001:00080000:0.0:1788843625.887254:0:6485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1788843625.887259:0:6485:0:(genops.c:885:class_export_put()) final put ffff9bd007224000/bdfa9d4d-a4fc-4db6-8668-5ed8e821acee 00000001:00100000:0.0:1788843625.887271:0:6485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f25f61b6-5faf-4e05-81a4-dea3dba05dc5 00000001:00080000:0.0:1788843625.887279:0:6485:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1788843625.887289:0:6485:0:(genops.c:885:class_export_put()) final put ffff9bd0078e2000/f25f61b6-5faf-4e05-81a4-dea3dba05dc5 00000100:00080000:1.0:1788843625.887377:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843625.889506:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843625.889662:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134480256:0@lo:400:kworker.0 00000100:00100000:3.0:1788843625.889748:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1788843625.889805:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd007224000/bdfa9d4d-a4fc-4db6-8668-5ed8e821acee for lustre-MDT0000 00000100:00100000:3.0:1788843625.889827:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008627100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134480768:0@lo:400:kworker.0 00000100:00100000:3.0:1788843625.889861:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1788843625.889884:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd0078e2000/f25f61b6-5faf-4e05-81a4-dea3dba05dc5 for lustre-MDT0000 00000100:00100000:3.0:1788843625.889895:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1875738134481280:0@lo:400:kworker.0 00000020:00000080:0.0:1788843625.889938:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd007224800 for lustre-MDT0000 00000100:00100000:3.0:1788843625.889943:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1788843625.889950:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd10f938000 for lustre-MDT0000 00000100:00100000:0.0:1788843625.889981:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008625500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134480640:0@lo:400:kworker.0 00000100:00100000:3.0:1788843625.889994:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134480512:0@lo:400:kworker.0 00000100:00100000:3.0:1788843625.890048:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843625.890065:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843625.890077:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1875738134481024:0@lo:400:kworker.0 00000100:00100000:0.0:1788843625.890110:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134481152:0@lo:400:kworker.0 00000100:00100000:3.0:1788843625.890124:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843625.890178:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134481536:0@lo:400:kworker.0 00000100:00100000:3.0:1788843625.890206:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843625.890228:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788843625.890234:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1875738134480384:0@lo:400:kworker.0 00000100:00100000:1.0:1788843625.890383:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116606848 00000100:00100000:1.0:1788843625.890391:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116606848 00000100:00100000:1.0:1788843625.890445:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134481280 00000100:00100000:1.0:1788843625.890449:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134481280 00000100:00100000:1.0:1788843625.890463:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134480640 00000100:00100000:1.0:1788843625.890466:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134480640 00000100:00100000:1.0:1788843625.890476:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134481024 00000100:00100000:1.0:1788843625.890478:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134481024 00000100:00100000:1.0:1788843625.890493:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1788843625.890500:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875738134481280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843625.890554:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875738134481280:12345-0@lo:400:kworker.0 Request processed in 54us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843625.890561:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1788843625.890577:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1788843625.890598:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134480640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843625.890628:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134480640:12345-0@lo:400:kworker.0 Request processed in 31us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843625.890635:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1788843625.890648:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1788843625.890654:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1875738134481024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843625.890678:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1875738134481024:12345-0@lo:400:kworker.0 Request processed in 25us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843625.890683:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1788843625.890697:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 261 00000100:00100000:1.0:1788843625.890704:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+5:2386:x1875738116606848:12345-192.168.203.33@tcp:39:umount.0 00000020:00000080:1.0:1788843625.890728:0:9517:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d1132 00000100:00080000:1.0:1788843625.890736:0:9517:0:(import.c:65:import_set_state_nolock()) ffff9bd13fabe800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788843625.890756:0:9517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788843625.890892:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdfa9d4d-a4fc-4db6-8668-5ed8e821acee+3:2386:x1875738116606848:12345-192.168.203.33@tcp:39:umount.0 Request processed in 188us (1409us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788843625.890901:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 261 00000100:00100000:0.0:1788843625.890913:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788843625.890929:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788843625.890936:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788843625.890963:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134481664:0@lo:400:kworker.0 00010000:00010000:1.0:1788843625.890979:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843625.890993:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134481536 00000100:00100000:1.0:1788843625.890998:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134481536 00000100:00100000:0.0:1788843625.891004:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843625.891058:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134481152 00000100:00100000:1.0:1788843625.891066:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134481152 00000100:00100000:0.0:1788843625.891083:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008625500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134480640:0@lo:400:kworker.0 00000100:00100000:1.0:1788843625.891084:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134481664 00000100:00100000:1.0:1788843625.891092:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134481664 00000100:00100000:1.0:1788843625.891124:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788843625.891138:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f986a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134481536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843625.891171:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788843625.891190:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134481152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843625.891384:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f986a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134481536:12345-0@lo:400:kworker.0 Request processed in 110us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843625.891395:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788843625.891412:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788843625.891421:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134481664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843625.892662:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134481152:12345-0@lo:400:kworker.0 Request processed in 1472us (1744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843625.892988:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788843625.893077:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134481152:0@lo:400:kworker.0 00000100:00080000:0.0:1788843625.894967:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788843625.894979:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788843625.895049:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134480768 00000100:00100000:0.0:1788843625.895064:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134480768 00000100:00100000:0.0:1788843625.895910:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134480512 00000100:00100000:0.0:1788843625.895921:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134480512 00000100:00100000:0.0:1788843625.895953:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788843625.895963:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134480768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843625.896079:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134480768:12345-0@lo:400:kworker.0 Request processed in 116us (6216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843625.896087:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788843625.896107:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788843625.896113:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134480512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843625.896171:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134480512:12345-0@lo:400:kworker.0 Request processed in 58us (6123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843625.896177:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788843625.896205:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134480256 00000100:00100000:0.0:1788843625.896210:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134480256 00000100:00100000:3.0:1788843625.896247:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843625.896259:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1788843625.896268:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3633:x1875738134480256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843625.896320:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008626680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1875738134480896:0@lo:400:kworker.0 00000100:00100000:0.0:1788843625.896326:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3633:x1875738134480256:12345-0@lo:400:kworker.0 Request processed in 56us (6579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843625.896335:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1788843625.896380:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134480384 00000100:00100000:3.0:1788843625.896388:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843625.896405:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134480384 00000100:00100000:3.0:1788843625.896417:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1875738134481408:0@lo:400:kworker.0 00000100:00100000:0.0:1788843625.896446:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134480896 00000100:00100000:0.0:1788843625.896452:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134480896 00000100:00100000:3.0:1788843625.896466:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843625.896507:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134481408 00000100:00100000:3.0:1788843625.896510:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134480512:0@lo:400:kworker.0 00000100:00100000:0.0:1788843625.896514:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134481408 00000100:00100000:0.0:1788843625.896542:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1788843625.896553:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1875738134480384:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788843625.896558:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd008624000 x1875738134481024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843625.896572:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1875738134481024:0@lo:400:kworker.0 00000100:00100000:3.0:1788843625.896592:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134481536:0@lo:400:kworker.0 00000100:00100000:0.0:1788843625.896612:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1875738134480384:12345-0@lo:400:kworker.0 Request processed in 61us (1445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843625.896620:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1788843625.896632:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1788843625.896639:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1875738134480896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843625.896669:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1875738134480896:12345-0@lo:400:kworker.0 Request processed in 31us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843625.897805:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1788843625.897847:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788843625.897862:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1875738134481408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843625.897932:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1875738134481408:12345-0@lo:400:kworker.0 Request processed in 78us (1478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843625.897938:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00080000:0.0:1788843625.897970:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788843625.897977:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843625.898167:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1875738134480384:0@lo:400:kworker.0 00000100:00100000:3.0:1788843625.898185:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008626680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1875738134480896:0@lo:400:kworker.0 00010000:00080000:3.0:1788843625.898199:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141b9e680 x1875738134481408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843625.898209:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1875738134481408:0@lo:400:kworker.0 00000100:00100000:3.0:1788843625.898268:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008627100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134480768:0@lo:400:kworker.0 00000100:00100000:3.0:1788843625.898279:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1875738134481280:0@lo:400:kworker.0 00000100:00100000:3.0:1788843625.898289:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134480256:0@lo:400:kworker.0 00000100:00100000:0.0:1788843625.904323:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134481664:0@lo:400:kworker.0 00000100:00100000:1.0:1788843625.904393:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134481664:12345-0@lo:400:kworker.0 Request processed in 12745us (13161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843625.904543:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788843625.928606:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843625.928817:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116607104 00000100:00100000:0.0:1788843625.928831:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116607104 00000100:00100000:0.0:1788843625.928907:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 401 00000100:00100000:0.0:1788843625.928920:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+7:2386:x1875738116607104:12345-192.168.203.33@tcp:251:umount.0 00000020:00000080:0.0:1788843625.929003:0:6501:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0ff0 00000020:00010000:0.0:1788843625.929025:0:6501:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9bd0075eb800: total 0 00000100:00080000:0.0:1788843625.929030:0:6501:0:(import.c:65:import_set_state_nolock()) ffff9bd0075ec800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788843625.929133:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7928f422-fe0e-4906-b099-11067616e1bb+3:2386:x1875738116607104:12345-192.168.203.33@tcp:251:umount.0 Request processed in 216us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843625.929181:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 401 00000020:00010000:3.0:1788843625.929881:0:10328:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9bd0075eb800: total 0 00010000:00010000:3.0:1788843625.929890:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843625.929960:0:10328:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bd0075eb800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788843625.930018:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd13fb35200/0xa762dfcbd58d104b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f224907d7 expref: 2 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843625.930039:0:10328:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bd0075eb800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788843625.930052:0:10328:0:(genops.c:885:class_export_put()) final put ffff9bd0075eb800/7928f422-fe0e-4906-b099-11067616e1bb 00010000:00010000:3.0:1788843625.930074:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843625.930087:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843625.930089:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788843625.930180:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd0075eb800/7928f422-fe0e-4906-b099-11067616e1bb for MGS 00000020:00000080:1.0:1788843625.930223:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd0075ec800 for MGS 00000100:00100000:0.0:1788843626.396182:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788843626.396216:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134481792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788843626.396331:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843626.396811:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134481920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788843626.396849:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843626.397176:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134481792 00000100:00100000:3.0:1788843626.397185:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134481792 00000100:00100000:3.0:1788843626.397241:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134481920 00000100:00100000:3.0:1788843626.397244:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134481920 00000100:00100000:3.0:1788843626.397263:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788843626.397274:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134481792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788843626.397304:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843626.397367:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134481792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843626.397828:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788843626.397843:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134482048:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788843626.397884:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843626.398019:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134482048 00000100:00100000:1.0:1788843626.398027:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134482048 00000100:00100000:1.0:1788843626.398057:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788843626.398064:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134481920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788843626.398091:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788843626.398134:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134481920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843626.398156:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788843626.398177:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788843626.398184:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134482048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788843626.398194:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788843626.398218:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134482048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843626.398224:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788843626.400331:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788843626.400468:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134481792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843626.400817:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134482048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788843626.400863:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134481920:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788843626.650471:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843627.418862:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134482176:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788843627.418959:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843627.419072:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134482176 00000100:00100000:3.0:1788843627.419084:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134482176 00000100:00100000:3.0:1788843627.419162:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788843627.419174:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134482176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788843627.419219:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788843627.419287:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134482176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843627.419295:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788843627.419355:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134482176:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788843627.421700:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788843627.421729:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134482304:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788843627.422373:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843627.422458:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134482304 00000100:00100000:0.0:1788843627.422479:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134482304 00000100:00100000:0.0:1788843627.422544:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788843627.422555:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134482304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788843627.422602:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788843627.422856:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134482304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 301us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843627.422865:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788843627.425563:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134482304:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788843627.680987:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788843627.898509:0:15146:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788843627.904957:0:15146:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788843627.905026:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d400/0xa762dfcbd58d10a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d10ad expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843627.905041:0:15146:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d400/0xa762dfcbd58d10a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d10ad expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843627.905050:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d400/0xa762dfcbd58d10a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d10ad expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843627.905057:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d400/0xa762dfcbd58d10a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d10ad expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843627.905087:0:15146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788843627.905092:0:15146:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788843627.905127:0:15146:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788843627.905133:0:15146:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788843627.905179:0:15146:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788843627.905220:0:15146:0:(import.c:65:import_set_state_nolock()) ffff9bd137aec800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788843627.906840:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008499c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875738134482432:0@lo:39:umount.0 00000100:00100000:1.0:1788843627.906941:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788843627.907237:0:6495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843627.907248:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d400/0xa762dfcbd58d10a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d10ad expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843627.907261:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d400 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:0.0:1788843627.907283:0:6495:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d400/0xa762dfcbd58d10a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d10ad expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843627.907296:0:6495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d400/0xa762dfcbd58d10a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d10ad expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843627.907304:0:6495:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d400/0xa762dfcbd58d10a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d10ad expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843627.907311:0:6495:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788843627.907314:0:6495:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788843627.907319:0:6495:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788843627.907366:0:6495:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d400/0xa762dfcbd58d10a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d10ad expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843627.907373:0:6495:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843627.907540:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d400/0xa762dfcbd58d10a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d10ad expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843627.907550:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d400/0xa762dfcbd58d10a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d10ad expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843627.907565:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843627.907567:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843627.907570:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843627.907579:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788843627.907593:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134482560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788843627.907645:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843627.907762:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134482560 00000100:00100000:1.0:1788843627.907772:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134482560 00000100:00100000:1.0:1788843627.907855:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788843627.907862:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134482432 00000100:00100000:1.0:1788843627.907873:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3631:x1875738134482560:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843627.907878:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134482432 00010000:00010000:1.0:1788843627.907892:0:7448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843627.907918:0:7448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd007946400/0xa762dfcbd58d10ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d10a6 expref: 24 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843627.907940:0:7448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843627.907954:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788843627.907969:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00799ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1875738134482432:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788843627.908015:0:6507:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0c07 00000100:00080000:2.0:1788843627.908026:0:6507:0:(import.c:65:import_set_state_nolock()) ffff9bd1203eb000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788843627.908087:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:3631:x1875738134482560:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843627.908097:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1788843627.908172:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843627.908260:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134482560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843627.911154:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00799ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3629:x1875738134482432:12345-0@lo:39:umount.0 Request processed in 3170us (4192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843627.911167:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:2.0:1788843627.911183:0:6507:0:(genops.c:885:class_export_put()) final put ffff9bd1203ea000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788843627.913548:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd1203ea000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788843627.913662:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd1203eb000 for lustre-MDT0000 00000100:00080000:0.0:1788843627.914250:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd137aec800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788843627.914282:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008499c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875738134482432:0@lo:39:umount.0 00000100:00080000:2.0:1788843627.917471:0:15146:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788843627.917479:0:15146:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788843627.917486:0:15146:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788843627.921834:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aea00/0xa762dfcbd58d10b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d10bb expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843627.921853:0:15146:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aea00/0xa762dfcbd58d10b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d10bb expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843627.921859:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aea00/0xa762dfcbd58d10b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d10bb expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843627.921866:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aea00/0xa762dfcbd58d10b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d10bb expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843627.921891:0:15146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788843627.921897:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6c00/0xa762dfcbd58d0faa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0fb1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843627.921923:0:15146:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6c00/0xa762dfcbd58d0faa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0fb1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843627.921929:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6c00/0xa762dfcbd58d0faa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d0fb1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843627.921935:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6c00/0xa762dfcbd58d0faa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d0fb1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843627.921949:0:10329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788843627.921953:0:15146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788843627.921969:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af600/0xa762dfcbd58d1307 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d130e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843627.921972:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aea00/0xa762dfcbd58d10b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d10bb expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843627.922012:0:15146:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af600/0xa762dfcbd58d1307 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d130e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843627.922016:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7aea00 already unused, calling callback (ffffffffc12a7c20) 00010000:00010000:2.0:1788843627.922022:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af600/0xa762dfcbd58d1307 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d130e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843627.922029:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af600/0xa762dfcbd58d1307 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d130e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788843627.922043:0:10329:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aea00/0xa762dfcbd58d10b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d10bb expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843627.922052:0:15146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788843627.922058:0:10329:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aea00/0xa762dfcbd58d10b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d10bb expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843627.922061:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1420e4200/0xa762dfcbd58d0b66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0b6d expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788843627.922085:0:10329:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aea00/0xa762dfcbd58d10b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d10bb expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843627.922087:0:15146:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1420e4200/0xa762dfcbd58d0b66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0b6d expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843627.922117:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1420e4200/0xa762dfcbd58d0b66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d0b6d expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843627.922123:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.133@tcp lock: ffff9bd1420e4200/0xa762dfcbd58d0b66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d0b6d expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843627.922156:0:15146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1788843627.922160:0:15146:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788843627.922200:0:15146:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788843627.922205:0:15146:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788843627.922210:0:15146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788843627.922216:0:15146:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:2.0:1788843627.922223:0:15146:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9bd10f901800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788843627.922229:0:15146:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9bd13fbc1000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788843627.922233:0:15146:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9bd13f92e800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788843627.922238:0:15146:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9bd13f940800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1788843627.922242:0:15146:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9bd1203f19b8) has exports, disconnecting them 00000020:00080000:2.0:1788843627.922248:0:15146:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9bd10f901800), last request at 1788843625 00000020:00000080:2.0:1788843627.922255:0:15146:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0f17 00000100:00080000:2.0:1788843627.922274:0:15146:0:(import.c:65:import_set_state_nolock()) ffff9bd10f906000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788843627.922324:0:15146:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd10f901800): rc 0 00000020:00000080:2.0:1788843627.922327:0:15146:0:(genops.c:885:class_export_put()) final put ffff9bd10f901800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788843627.922337:0:15146:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9bd13fbc1000), last request at 1788843625 00000020:00000080:2.0:1788843627.922341:0:15146:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0df1 00000100:00080000:2.0:1788843627.922346:0:15146:0:(import.c:65:import_set_state_nolock()) ffff9bd13fbc3000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788843627.922352:0:15146:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd13fbc1000): rc 0 00000020:00000080:2.0:1788843627.922361:0:15146:0:(genops.c:885:class_export_put()) final put ffff9bd13fbc1000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1788843627.922365:0:15146:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9bd13f92e800), last request at 1788843386 00000020:00000080:2.0:1788843627.922369:0:15146:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0cee 00000100:00080000:2.0:1788843627.922374:0:15146:0:(import.c:65:import_set_state_nolock()) ffff9bd13f928000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788843627.922381:0:15146:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd13f92e800): rc 0 00000020:00000080:2.0:1788843627.922382:0:15146:0:(genops.c:885:class_export_put()) final put ffff9bd13f92e800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1788843627.922386:0:15146:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9bd13f940800), last request at 1788843386 00000020:00000080:2.0:1788843627.922390:0:15146:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0caf 00000100:00080000:2.0:1788843627.922393:0:15146:0:(import.c:65:import_set_state_nolock()) ffff9bd13f92d800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788843627.922400:0:15146:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:2.0:1788843627.922486:0:15146:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd13f940800): rc 0 00000004:00000080:2.0:1788843627.922492:0:15146:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb2dcc7a6bae0 00000100:00080000:2.0:1788843627.922510:0:15146:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788843627.922514:0:15146:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 10000000:01000000:1.0:1788843627.922767:0:10329:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788843627.922771:0:10329:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1788843627.922775:0:10329:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1788843627.922787:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788843627.922798:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6c00/0xa762dfcbd58d0faa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d0fb1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843627.922806:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e6c00 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:0.0:1788843627.922811:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6c00/0xa762dfcbd58d0faa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d0fb1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843627.922820:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6c00/0xa762dfcbd58d0faa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d0fb1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843627.922828:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6c00/0xa762dfcbd58d0faa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d0fb1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843627.922834:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788843627.922837:0:6494:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788843627.922840:0:6494:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788843627.922846:0:10329:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aea00/0xa762dfcbd58d10b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d10bb expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843627.922856:0:10329:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843627.922879:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6c00/0xa762dfcbd58d0faa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d0fb1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843627.922889:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788843627.922891:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aea00/0xa762dfcbd58d10b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d10bb expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843627.922903:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aea00/0xa762dfcbd58d10b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d10bb expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843627.922915:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6c00/0xa762dfcbd58d0faa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d0fb1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843627.922922:0:10329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788843627.922924:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd1153e6c00/0xa762dfcbd58d0faa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d0fb1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843627.922940:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843627.922944:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd1420e4200/0xa762dfcbd58d0b66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d0b6d expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843627.922960:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1420e4200 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:0.0:1788843627.922963:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd1420e4200/0xa762dfcbd58d0b66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d0b6d expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843627.922971:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd1420e4200/0xa762dfcbd58d0b66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d0b6d expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843627.922978:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd1420e4200/0xa762dfcbd58d0b66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d0b6d expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843627.922983:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788843627.922985:0:6494:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788843627.922987:0:6494:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788843627.923022:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd1420e4200/0xa762dfcbd58d0b66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d0b6d expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843627.923027:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843627.923033:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd1420e4200/0xa762dfcbd58d0b66 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d0b6d expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843627.923039:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd1420e4200/0xa762dfcbd58d0b66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d0b6d expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843627.923048:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843627.923050:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843627.923051:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843627.923058:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788843627.923066:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd10f901800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788843627.923106:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd13fbc1000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788843627.923133:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd13f92e800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788843627.923184:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd10f906000 for lustre-MDT0000 00010000:00010000:1.0:1788843627.923185:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af600/0xa762dfcbd58d1307 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d130e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788843627.923195:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd13fbc3000 for lustre-MDT0000 00010000:00010000:1.0:1788843627.923198:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7af600 already unused, calling callback (ffffffffc12a7c20) 00000020:00000080:0.0:1788843627.923203:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd13f928000 for lustre-MDT0000 10000000:00010000:1.0:1788843627.923205:0:10329:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af600/0xa762dfcbd58d1307 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d130e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843627.923218:0:10329:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af600/0xa762dfcbd58d1307 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d130e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788843627.923237:0:10329:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af600/0xa762dfcbd58d1307 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d130e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843627.923241:0:10329:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788843627.923243:0:10329:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788843627.923245:0:10329:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788843627.923277:0:10329:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af600/0xa762dfcbd58d1307 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d130e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843627.923282:0:10329:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788843627.923291:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af600/0xa762dfcbd58d1307 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d130e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843627.923297:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af600/0xa762dfcbd58d1307 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d130e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843627.923308:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843627.923309:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843627.923311:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843627.923338:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134482688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788843627.923404:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134482944:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788843627.923493:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788843627.924641:0:15146:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788843627.924666:0:15146:0:(import.c:65:import_set_state_nolock()) ffff9bd13f940000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788843627.926018:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843627.926101:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008499c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134483200:0@lo:39:umount.0 00000100:00100000:0.0:1788843627.926177:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843627.926485:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788843627.926494:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134483072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788843627.926522:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843627.926631:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134483200 00000100:00100000:3.0:1788843627.926640:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134483200 00000100:00100000:3.0:1788843627.926850:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788843627.926861:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1875738134483200:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788843627.926978:0:6511:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0d49 00000100:00080000:3.0:1788843627.926987:0:6511:0:(import.c:65:import_set_state_nolock()) ffff9bd10f7bf000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788843627.927023:0:6511:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1788843627.927185:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3629:x1875738134483200:12345-0@lo:39:umount.0 Request processed in 325us (1006us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788843627.927193:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00010000:00010000:0.0:1788843627.927379:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788843627.927413:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd13f940000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788843627.927421:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008499c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134483200:0@lo:39:umount.0 00000100:00100000:1.0:1788843627.927569:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134482816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788843627.927600:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843627.927682:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134482688 00000100:00100000:2.0:1788843627.927687:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134482688 00000100:00100000:2.0:1788843627.927804:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134483072 00000100:00100000:2.0:1788843627.927808:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134483072 00000100:00100000:3.0:1788843627.928080:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134482816 00000100:00100000:3.0:1788843627.928084:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134482816 00000100:00100000:3.0:1788843627.928110:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788843627.928117:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00799b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e79d9884-ba2e-42e7-accb-b4784b9c1837+25:3631:x1875738134482688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788843627.928132:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843627.928173:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd10f7af800/0xa762dfcbd58d10bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d10b4 expref: 25 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843627.928188:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843627.928225:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00799b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e79d9884-ba2e-42e7-accb-b4784b9c1837+24:3631:x1875738134482688:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (2210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843627.928232:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788843627.928247:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788843627.928254:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007999f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e79d9884-ba2e-42e7-accb-b4784b9c1837+23:3631:x1875738134483072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788843627.928262:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843627.928271:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd10f7afc00/0xa762dfcbd58d130e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d1307 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843627.928294:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843627.928320:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007999f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e79d9884-ba2e-42e7-accb-b4784b9c1837+22:3631:x1875738134483072:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (1797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843627.928326:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788843627.928340:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788843627.928347:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007998e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e79d9884-ba2e-42e7-accb-b4784b9c1837+21:3632:x1875738134482816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788843627.928355:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843627.928364:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1153e7c00/0xa762dfcbd58d0fb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d0faa expref: 21 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843627.928372:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843627.928398:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007998e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:3632:x1875738134482816:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843627.928404:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788843627.928476:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843627.928574:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134482944 00000100:00100000:2.0:1788843627.928579:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134482944 00000100:00100000:3.0:1788843627.928620:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788843627.928627:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e79d9884-ba2e-42e7-accb-b4784b9c1837+20:3633:x1875738134482944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788843627.928637:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843627.928646:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd118f71a00/0xa762dfcbd58d0b6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d0b66 expref: 20 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843627.928655:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843627.928813:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134482816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788843627.928860:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134483072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788843627.928868:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134482688:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788843627.931182:0:15146:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788843627.931190:0:15146:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1788843627.931215:0:15146:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788843627.931283:0:15146:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788843627.931306:0:15146:0:(import.c:65:import_set_state_nolock()) ffff9bd006449000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788843627.931330:0:15146:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788843627.931332:0:15146:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1788843627.931361:0:15146:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788843627.931401:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e79d9884-ba2e-42e7-accb-b4784b9c1837+19:3633:x1875738134482944:12345-0@lo:103:ldlm_bl.0 Request processed in 2769us (2921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843627.931413:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788843627.931420:0:15146:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788843627.931437:0:15146:0:(import.c:65:import_set_state_nolock()) ffff9bd0078e5000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788843627.931493:0:15146:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9bd1203f19b8) has no exports 00000100:00100000:0.0:1788843627.931691:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134482944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788843627.931721:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008498380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134483328:0@lo:9:umount.0 00000100:00100000:0.0:1788843627.931756:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843627.931815:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00849aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134483456:0@lo:9:umount.0 00000100:00100000:0.0:1788843627.931834:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843627.931862:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134483328 00000100:00100000:0.0:1788843627.931867:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134483328 00000100:00100000:0.0:1788843627.931905:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134483456 00000100:00100000:0.0:1788843627.931907:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134483456 00000100:00100000:0.0:1788843627.931924:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788843627.931931:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1875738134483328:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788843627.931952:0:8424:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0ea7 00000100:00080000:0.0:1788843627.931959:0:8424:0:(import.c:65:import_set_state_nolock()) ffff9bd006465000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788843627.932005:0:8424:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788843627.932116:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3629:x1875738134483328:12345-0@lo:9:umount.0 Request processed in 186us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843627.932130:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788843627.932166:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788843627.932173:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1875738134483456:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788843627.932185:0:8424:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0fdb 00000100:00080000:2.0:1788843627.932191:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd006449000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788843627.932192:0:8424:0:(import.c:65:import_set_state_nolock()) ffff9bd10f900800 : changing import state from FULL to CLOSED 00000004:00080000:2.0:1788843627.932209:0:3629:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788843627.932212:0:3629:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788843627.932216:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008498380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134483328:0@lo:9:umount.0 00000001:00000004:0.0:1788843627.932219:0:8424:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1788843627.932298:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3629:x1875738134483456:12345-0@lo:9:umount.0 Request processed in 126us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843627.932304:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1788843627.932319:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788843627.932323:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788843627.932336:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843627.932341:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788843627.933796:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd0078e5000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788843627.933819:0:3629:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788843627.933821:0:3629:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788843627.933827:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00849aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134483456:0@lo:9:umount.0 00000020:00080000:2.0:1788843627.944695:0:15146:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9bd1203f19b8) has no exports 00000020:00000080:2.0:1788843627.985064:0:15146:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0bc1 00000020:00000080:2.0:1788843627.985082:0:15146:0:(genops.c:885:class_export_put()) final put ffff9bd120391800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788843627.985175:0:15146:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788843627.985264:0:15146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788843627.985277:0:15146:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788843627.985282:0:15146:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9bd136c50000) has no exports 00000020:00000080:0.0:1788843627.985605:0:15146:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0bba 00000020:00000080:0.0:1788843627.985611:0:15146:0:(genops.c:885:class_export_put()) final put ffff9bd137ace000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788843627.985681:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd120391800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788843627.985815:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd137ace000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788843627.985886:0:15146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788843627.985894:0:15146:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788843627.985898:0:15146:0:(genops.c:885:class_export_put()) final put ffff9bd120354000/lustre-QMT0000_UUID 00000020:00000080:0.0:1788843627.986084:0:15146:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd120354000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788843627.986095:0:15146:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1788843628.698323:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788843628.958127:0:8417:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788843628.958165:0:8417:0:(genops.c:885:class_export_put()) final put ffff9bd006463800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788843628.958195:0:8417:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f25f61b6-5faf-4e05-81a4-dea3dba05dc5 00000020:00000080:1.0:1788843628.958197:0:8417:0:(genops.c:885:class_export_put()) final put ffff9bd141a7a800/f25f61b6-5faf-4e05-81a4-dea3dba05dc5 00000020:00000080:1.0:1788843628.958222:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd006463800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788843628.958284:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd141a7a800/f25f61b6-5faf-4e05-81a4-dea3dba05dc5 for lustre-OST0000 00000020:00000080:1.0:1788843628.958313:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd006465000 for lustre-OST0000 00000020:00000080:1.0:1788843628.958320:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd141a78000 for lustre-OST0000 00000001:00100000:1.0:1788843628.966116:0:7438:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788843628.966132:0:7438:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:1.0:1788843628.966137:0:7438:0:(genops.c:885:class_export_put()) final put ffff9bd10c0f0800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788843628.966249:0:7438:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of bdfa9d4d-a4fc-4db6-8668-5ed8e821acee 00000001:00080000:1.0:1788843628.966256:0:7438:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:1.0:1788843628.966259:0:7438:0:(genops.c:885:class_export_put()) final put ffff9bd13fab8800/bdfa9d4d-a4fc-4db6-8668-5ed8e821acee 00000001:00100000:0.0:1788843628.966310:0:9500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788843628.966314:0:9500:0:(genops.c:885:class_export_put()) final put ffff9bd10f906800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788843628.966344:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd10c0f0800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1788843628.966468:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd10f7bf000 for lustre-MDT0001 00000001:00100000:1.0:1788843628.966686:0:7438:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f25f61b6-5faf-4e05-81a4-dea3dba05dc5 00000001:00080000:1.0:1788843628.966691:0:7438:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:1.0:1788843628.966694:0:7438:0:(genops.c:885:class_export_put()) final put ffff9bd10f93e000/f25f61b6-5faf-4e05-81a4-dea3dba05dc5 00000020:00000080:3.0:1788843628.966849:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd13fab8800/bdfa9d4d-a4fc-4db6-8668-5ed8e821acee for lustre-MDT0001 00000020:00000080:3.0:1788843628.967019:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd10f93e000/f25f61b6-5faf-4e05-81a4-dea3dba05dc5 for lustre-MDT0001 00000020:00000080:3.0:1788843628.967040:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd13fabe800 for lustre-MDT0001 00000020:00000080:3.0:1788843628.967044:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd10f93b800 for lustre-MDT0001 00000001:00100000:0.0:1788843628.967941:0:9500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f25f61b6-5faf-4e05-81a4-dea3dba05dc5 00000020:00000080:0.0:1788843628.967948:0:9500:0:(genops.c:885:class_export_put()) final put ffff9bd141bd3800/f25f61b6-5faf-4e05-81a4-dea3dba05dc5 00000020:00000080:3.0:1788843628.968424:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd10f906800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788843628.968454:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd141bd3800/f25f61b6-5faf-4e05-81a4-dea3dba05dc5 for lustre-OST0001 00000020:00000080:3.0:1788843628.968474:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd10f900800 for lustre-OST0001 00000020:00000080:3.0:1788843628.968479:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd141bd1800 for lustre-OST0001 00010000:00010000:0.0:1788843629.726662:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788843629.915678:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788843630.747814:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843631.002443:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788843631.002468:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00849aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134483584:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788843631.002541:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843631.002673:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134483584 00000100:00100000:2.0:1788843631.002691:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134483584 00000100:00100000:2.0:1788843631.002761:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788843631.002773:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134483584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788843631.002804:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788843631.002853:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134483584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843631.002861:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788843631.002951:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00849aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134483584:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788843631.006289:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788843631.006484:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008498380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134483712:0@lo:400:kworker.0 00000100:00100000:1.0:1788843631.006568:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843631.006717:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008499180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134483840:0@lo:400:kworker.0 00000100:00100000:3.0:1788843631.006751:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843631.006843:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134483712 00000100:00100000:0.0:1788843631.006851:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134483712 00000100:00100000:0.0:1788843631.006905:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:0.0:1788843631.006919:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+19:3632:x1875738134483712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843631.007029:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134483840 00000100:00100000:3.0:1788843631.007224:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134483840 00000100:00100000:3.0:1788843631.007260:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788843631.007264:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3633:x1875738134483840:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788843631.007270:0:7934:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788843631.007313:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3633:x1875738134483840:12345-0@lo:400:kworker.0 Request processed in 47us (561us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788843631.007320:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00080000:3.0:1788843631.007360:0:3633:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788843631.007370:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9bd13e8a2000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788843631.007382:0:3633:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1788843631.013328:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00849b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134483968:0@lo:400:kworker.0 00000100:00100000:2.0:1788843631.013529:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843631.013559:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+19:3632:x1875738134483712:12345-0@lo:400:kworker.0 Request processed in 6642us (6987us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843631.013573:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1788843631.013580:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00849aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134484480:0@lo:400:kworker.0 00000100:00100000:2.0:1788843631.013608:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843631.013634:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788843631.013642:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008498700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134484096:0@lo:400:kworker.0 00000100:00100000:2.0:1788843631.013667:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843631.013678:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134483968 00000100:00100000:2.0:1788843631.013686:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007240e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134484608:0@lo:400:kworker.0 00000100:00100000:0.0:1788843631.013687:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134483968 00000100:00100000:2.0:1788843631.013719:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843631.013726:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134484480 00000100:00100000:0.0:1788843631.013731:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134484480 00000100:00100000:2.0:1788843631.013755:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134484096 00000100:00100000:2.0:1788843631.013761:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134484096 00000100:00100000:0.0:1788843631.013777:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1788843631.013785:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788843631.013790:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134484480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843631.013794:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3630:x1875738134483968:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788843631.013802:0:9517:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788843631.014456:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3630:x1875738134483968:12345-0@lo:400:kworker.0 Request processed in 660us (926us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788843631.014465:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875738134484480:12345-0@lo:400:kworker.0 Request processed in 676us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843631.014471:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788843631.014479:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1788843631.014495:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788843631.014502:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3630:x1875738134484096:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788843631.014507:0:9517:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00080000:0.0:1788843631.014515:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788843631.014528:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134484608 00000100:00100000:0.0:1788843631.014533:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134484608 00000100:00100000:2.0:1788843631.014541:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3630:x1875738134484096:12345-0@lo:400:kworker.0 Request processed in 37us (874us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788843631.014548:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788843631.014577:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788843631.014586:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007240a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134484608:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788843631.014601:0:3630:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788843631.014607:0:3630:0:(import.c:65:import_set_state_nolock()) ffff9bd006461800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788843631.014611:0:3630:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788843631.014616:0:3630:0:(import.c:65:import_set_state_nolock()) ffff9bd006461800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788843631.014621:0:3630:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 184 00000100:00100000:0.0:1788843631.014627:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007240a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134484608:12345-0@lo:400:kworker.0 Request processed in 42us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843631.014638:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:2.0:1788843631.014640:0:3630:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bd006461800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:2.0:1788843631.014670:0:3630:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd102fb9c00 x1875738134484736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788843631.014675:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788843631.014694:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008498700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134484096:0@lo:400:kworker.0 00000100:00100000:0.0:1788843631.014708:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3629:1875738134484736:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788843631.014716:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007240e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134484608:0@lo:400:kworker.0 00000100:00080000:2.0:1788843631.014729:0:3630:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788843631.014733:0:3630:0:(import.c:65:import_set_state_nolock()) ffff9bd13f944800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788843631.014737:0:3630:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788843631.014740:0:3630:0:(import.c:65:import_set_state_nolock()) ffff9bd13f944800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1788843631.014747:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788843631.014748:0:3630:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 164 00000100:00080000:2.0:1788843631.014756:0:3630:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bd13f944800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:2.0:1788843631.014773:0:3630:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd102fb8700 x1875738134484864/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788843631.014784:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134484736 00000100:00100000:0.0:1788843631.014790:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134484736 00000100:00100000:2.0:1788843631.014791:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00849b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134483968:0@lo:400:kworker.0 00010000:00080000:2.0:1788843631.014808:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00849aa00 x1875738134484480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843631.014816:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788843631.014823:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00849aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1875738134484480:0@lo:400:kworker.0 00000100:00100000:0.0:1788843631.014828:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3629:x1875738134484736:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1788843631.015096:0:6506:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788843631.018885:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008498380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134483712:0@lo:400:kworker.0 00000100:00100000:1.0:1788843631.019844:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008498a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134484224:0@lo:400:kworker.0 00000100:00100000:1.0:1788843631.019933:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843631.019986:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788843631.019994:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00849bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1875738134484352:0@lo:400:kworker.0 00000100:00100000:1.0:1788843631.020018:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843631.020056:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134484224 00000100:00100000:2.0:1788843631.020387:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134484352 00000100:00100000:2.0:1788843631.020395:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134484352 00000100:00100000:2.0:1788843631.020956:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788843631.021258:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1875738134484352:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788843631.021272:0:6508:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788843631.021309:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134484224 00000100:00100000:1.0:1788843631.021835:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1788843631.021843:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00799a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134484224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843631.021988:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00799a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134484224:12345-0@lo:400:kworker.0 Request processed in 144us (2054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843631.021996:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00080000:1.0:1788843631.022027:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788843631.022077:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd008498a80 x1875738134484224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843631.022097:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008498a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134484224:0@lo:400:kworker.0 00000100:00100000:1.0:1788843631.022177:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875738134484864:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788843631.022215:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843631.022246:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134484864 00000100:00100000:1.0:1788843631.022250:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134484864 00000100:00100000:1.0:1788843631.022266:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788843631.022270:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3629:x1875738134484864:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1788843631.022285:0:11996:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788843631.022313:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3629:x1875738134484864:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 42us (99us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788843631.022319:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:1.0:1788843631.022341:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd13f944800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788843631.022357:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788843631.022361:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875738134484864:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1788843631.026354:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9bd13e8a2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788843631.026363:0:3633:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 164 00000100:00080000:3.0:1788843631.026387:0:3633:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9bd13e8a2000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:3.0:1788843631.026537:0:3633:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd10fe22680 x1875738134484992/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788843631.026562:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008499180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134483840:0@lo:400:kworker.0 00000100:00100000:2.0:1788843631.026939:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1875738134484352:12345-0@lo:400:kworker.0 Request processed in 5890us (6917us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788843631.026957:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788843631.027041:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134484992:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788843631.027098:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788843631.027354:0:3632:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788843631.027359:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9bd007225800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788843631.027363:0:3632:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788843631.027367:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9bd007225800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788843631.027370:0:3632:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 208 00000100:00080000:3.0:1788843631.027375:0:3632:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bd007225800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:3.0:1788843631.027391:0:3632:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd10fe23480 x1875738134485120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788843631.027422:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00849bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1875738134484352:0@lo:400:kworker.0 00000100:00100000:1.0:1788843631.027913:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1875738134485120:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788843631.027947:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843631.028047:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134484992 00000100:00100000:2.0:1788843631.028053:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134484992 00000100:00100000:2.0:1788843631.028236:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788843631.028244:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3629:x1875738134484992:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788843631.028259:0:6512:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788843631.028304:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3629:x1875738134484992:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 59us (1205us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788843631.028313:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788843631.028444:0:11996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134485120 00000100:00100000:3.0:1788843631.028450:0:11996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134485120 00000100:00100000:3.0:1788843631.028484:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788843631.028501:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3629:x1875738134485120:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1788843631.028509:0:11996:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788843631.028589:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3629:x1875738134485120:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 87us (641us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788843631.028614:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:1.0:1788843631.029039:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd007225800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788843631.029045:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788843631.029048:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1875738134485120:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1788843631.030232:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd13e8a2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788843631.030241:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788843631.030250:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134484992:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788843631.054182:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3629:x1875738134484736:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 39351us (39432us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788843631.054196:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:1.0:1788843631.054541:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd006461800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788843631.054547:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788843631.054551:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3629:1875738134484736:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788843631.514375:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134485248:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788843631.514455:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843631.514503:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134485248 00000100:00100000:3.0:1788843631.514513:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134485248 00000100:00100000:3.0:1788843631.514581:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788843631.514593:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134485248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788843631.514637:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788843631.517952:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134485248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3352us (3486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843631.517981:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788843631.517986:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134485248:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788843631.771647:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843632.794369:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843633.818361:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788843634.077031:0:6485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788843634.077042:0:6485:0:(genops.c:885:class_export_put()) final put ffff9bd13f940800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788843634.077110:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd13f940800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1788843634.077197:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd13f92d800 for lustre-MDT0000 00010000:00010000:0.0:1788843634.843346:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843635.866407:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788843636.126267:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788843636.126275:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788843636.126279:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bd13e8a2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788843636.126287:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 409 00000100:00080000:3.0:1788843636.126292:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788843636.126299:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9bd13e8a2000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:3.0:1788843636.126323:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd10fe20380 x1875738134485632/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788843636.126340:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788843636.126343:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788843636.126345:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bd13f944800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788843636.126348:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 409 00000100:00080000:3.0:1788843636.126351:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788843636.126355:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bd13f944800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:3.0:1788843636.126366:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd10fe22d80 x1875738134485760/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788843636.126375:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788843636.126378:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788843636.126393:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bd006461800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788843636.126397:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 409 00000100:00080000:3.0:1788843636.126399:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788843636.126403:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bd006461800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:3.0:1788843636.126414:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd10fe21180 x1875738134485888/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788843636.126434:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788843636.126436:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788843636.126438:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bd007225800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788843636.126441:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 409 00000100:00080000:3.0:1788843636.126443:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788843636.126446:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bd007225800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:3.0:1788843636.126454:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd10fe21c00 x1875738134486272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788843636.126559:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134485504:0@lo:400:kworker.0 00000100:00100000:2.0:1788843636.126642:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843636.126713:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134486528:0@lo:400:kworker.0 00000100:00100000:2.0:1788843636.126738:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843636.126762:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788843636.126767:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134486016:0@lo:400:kworker.0 00000100:00100000:2.0:1788843636.126790:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843636.127109:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134485632:0@lo:38:kworker.0 00000100:00100000:1.0:1788843636.127188:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843636.127208:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875738134485760:0@lo:38:kworker.0 00000100:00100000:1.0:1788843636.127230:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843636.127244:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3629:1875738134485888:0@lo:38:kworker.0 00000100:00100000:1.0:1788843636.127263:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843636.127276:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1875738134486272:0@lo:38:kworker.0 00000100:00100000:1.0:1788843636.127295:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843636.127337:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134486016 00000100:00100000:1.0:1788843636.127343:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134486016 00000100:00100000:1.0:1788843636.127389:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134485760 00000100:00100000:1.0:1788843636.127392:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134485760 00000100:00100000:1.0:1788843636.127400:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134485888 00000100:00100000:1.0:1788843636.127402:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134485888 00000100:00100000:1.0:1788843636.127409:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134486272 00000100:00100000:1.0:1788843636.127411:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134486272 00000100:00100000:1.0:1788843636.127422:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1788843636.127431:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134486016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843636.127480:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134486016:12345-0@lo:400:kworker.0 Request processed in 50us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843636.127633:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1788843636.127662:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788843636.127667:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3629:x1875738134485760:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1788843636.127683:0:6507:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788843636.128290:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134485632 00000100:00100000:2.0:1788843636.128296:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134485632 00000100:00100000:2.0:1788843636.128327:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788843636.128335:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3629:x1875738134485632:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1788843636.128344:0:6511:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788843636.128393:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3629:x1875738134485632:12345-0@lo:38:kworker.0 Request processed in 59us (1205us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788843636.128412:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788843636.128434:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788843636.128439:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3629:x1875738134485888:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1788843636.128447:0:6508:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788843636.128474:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3629:x1875738134485888:12345-0@lo:38:kworker.0 Request processed in 33us (1210us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788843636.128479:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788843636.128509:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788843636.128514:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3629:x1875738134486272:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1788843636.128521:0:6508:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788843636.128552:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3629:x1875738134486272:12345-0@lo:38:kworker.0 Request processed in 36us (1255us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788843636.128557:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:2.0:1788843636.128603:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788843636.128618:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134485376:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788843636.128666:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843636.128688:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134486400:0@lo:400:kworker.0 00000100:00100000:2.0:1788843636.128707:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843636.128726:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788843636.128730:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134486144:0@lo:400:kworker.0 00000100:00100000:2.0:1788843636.128750:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843636.128771:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134486400 00000100:00100000:2.0:1788843636.128775:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134486400 00000100:00100000:2.0:1788843636.128804:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1788843636.128810:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875738134486400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843636.128845:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875738134486400:12345-0@lo:400:kworker.0 Request processed in 35us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843636.128857:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00080000:2.0:1788843636.128874:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788843636.128896:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fe22680 x1875738134486400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843636.128909:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134486400:0@lo:400:kworker.0 00010000:00080000:2.0:1788843636.128956:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10fe23800 x1875738134486016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843636.128965:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134486016:0@lo:400:kworker.0 00000100:00080000:2.0:1788843636.128996:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd13e8a2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788843636.129000:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788843636.129003:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134485632:0@lo:38:kworker.0 00000100:00080000:2.0:1788843636.129011:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd006461800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788843636.129014:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788843636.129017:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3629:1875738134485888:0@lo:38:kworker.0 00000100:00080000:2.0:1788843636.129024:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd007225800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788843636.129027:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788843636.129029:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1875738134486272:0@lo:38:kworker.0 00000100:00100000:3.0:1788843636.129750:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134485504 00000100:00100000:3.0:1788843636.129758:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134485504 00000100:00100000:3.0:1788843636.129805:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1788843636.129814:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+19:3630:x1875738134485504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843636.129865:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e79d9884-ba2e-42e7-accb-b4784b9c1837+19:3630:x1875738134485504:12345-0@lo:400:kworker.0 Request processed in 53us (3224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843636.129872:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1788843636.129903:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134485376 00000100:00100000:3.0:1788843636.129907:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134485376 00000100:00100000:3.0:1788843636.129951:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788843636.129958:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134485376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788843636.129978:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788843636.130024:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134485376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (1357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843636.130031:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788843636.130051:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134486528 00000100:00100000:3.0:1788843636.130055:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134486528 00000100:00100000:3.0:1788843636.130080:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134486144 00000100:00100000:3.0:1788843636.130083:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134486144 00000100:00100000:3.0:1788843636.130098:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788843636.130104:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134486528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843636.130170:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134486528:12345-0@lo:400:kworker.0 Request processed in 31us (3395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843636.130177:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788843636.130190:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788843636.130197:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134486144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843636.130225:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134486144:12345-0@lo:400:kworker.0 Request processed in 28us (1472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843636.130231:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:3.0:1788843636.130245:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788843636.130248:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843636.130274:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134485504:0@lo:400:kworker.0 00000100:00100000:3.0:1788843636.130287:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134486528:0@lo:400:kworker.0 00000100:00100000:3.0:1788843636.130315:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134486144:0@lo:400:kworker.0 00000100:00100000:3.0:1788843636.130330:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134485376:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788843636.152426:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3629:x1875738134485760:12345-0@lo:38:kworker.0 Request processed in 24746us (25184us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788843636.152441:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00080000:2.0:1788843636.152577:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd13f944800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788843636.152585:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788843636.152589:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875738134485760:0@lo:38:kworker.0 00000100:00100000:0.0:1788843636.635308:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134486656:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788843636.635423:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843636.635999:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134486656 00000100:00100000:1.0:1788843636.636013:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134486656 00000100:00100000:1.0:1788843636.636085:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788843636.636099:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008627100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134486656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788843636.636175:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788843636.636251:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008627100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134486656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 155us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843636.636259:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788843636.636377:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134486656:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788843636.894515:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843637.914915:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843638.939125:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788843639.130987:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788843639.963170:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843640.986702:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843641.242737:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788843641.242795:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134486784:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788843641.242918:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843641.243203:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134486784 00000100:00100000:2.0:1788843641.243215:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134486784 00000100:00080000:1.0:1788843641.243319:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1788843641.243321:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788843641.243336:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134486784:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788843641.243338:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788843641.243346:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bd13e8a2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788843641.243364:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 414 00000100:00080000:1.0:1788843641.243371:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00002000:00000024:2.0:1788843641.243378:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788843641.243379:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9bd13e8a2000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:1.0:1788843641.243414:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd141b68380 x1875738134487040/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788843641.243436:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1788843641.243440:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134486784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (519us total) trans 0 rc 0/0 00000100:00080000:1.0:1788843641.243441:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788843641.243445:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bd13f944800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788843641.243453:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 414 00000100:00100000:2.0:1788843641.243457:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:1.0:1788843641.243458:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788843641.243465:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bd13f944800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:1.0:1788843641.243480:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd141b6bb80 x1875738134487168/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788843641.243490:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134487040:0@lo:38:kworker.0 00000100:00080000:1.0:1788843641.243491:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788843641.243498:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788843641.243502:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bd006461800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788843641.243506:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 414 00000100:00080000:1.0:1788843641.243509:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788843641.243512:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bd006461800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:1.0:1788843641.243526:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd141b69f80 x1875738134487296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788843641.243538:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788843641.243554:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788843641.243564:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788843641.243565:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bd007225800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788843641.243569:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 414 00000100:00080000:1.0:1788843641.243572:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788843641.243575:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bd007225800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:1.0:1788843641.243588:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd141b6a680 x1875738134487552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788843641.243626:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134487808:0@lo:400:kworker.0 00000100:00100000:0.0:1788843641.243656:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1875738134487680:0@lo:400:kworker.0 00000100:00100000:1.0:1788843641.243665:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843641.243703:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788843641.243704:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843641.243712:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134486912:0@lo:400:kworker.0 00000100:00100000:0.0:1788843641.243740:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788843641.243748:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1875738134487424:0@lo:400:kworker.0 00000100:00100000:1.0:1788843641.243753:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843641.243791:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843641.243797:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134486912 00000100:00100000:1.0:1788843641.243804:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134486912 00000100:00100000:1.0:1788843641.243841:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:0.0:1788843641.243843:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134487680 00000100:00100000:0.0:1788843641.243850:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134487680 00000100:00100000:1.0:1788843641.243851:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1328dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+19:3632:x1875738134486912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843641.243893:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134487424 00000100:00100000:0.0:1788843641.243897:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134487424 00000100:00100000:1.0:1788843641.243899:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1328dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e79d9884-ba2e-42e7-accb-b4784b9c1837+19:3632:x1875738134486912:12345-0@lo:400:kworker.0 Request processed in 49us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843641.243918:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:0.0:1788843641.243936:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1788843641.243945:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008626680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1875738134487680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843641.243983:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e79d9884-ba2e-42e7-accb-b4784b9c1837:3632:1875738134486912:0@lo:400:kworker.0 00000100:00100000:0.0:1788843641.243994:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008626680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1875738134487680:12345-0@lo:400:kworker.0 Request processed in 50us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843641.244002:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1788843641.244019:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1788843641.244025:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1875738134487424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843641.244056:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1875738134487424:12345-0@lo:400:kworker.0 Request processed in 30us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843641.244062:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00010000:00080000:0.0:1788843641.244095:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141b69880 x1875738134487424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843641.244107:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1875738134487424:0@lo:400:kworker.0 00010000:00080000:0.0:1788843641.244117:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141b68e00 x1875738134487680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843641.244125:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1875738134487680:0@lo:400:kworker.0 00000100:00100000:2.0:1788843641.244317:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875738134487168:0@lo:38:kworker.0 00000100:00100000:2.0:1788843641.244345:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843641.244369:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3629:1875738134487296:0@lo:38:kworker.0 00000100:00100000:2.0:1788843641.244392:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843641.244406:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1875738134487552:0@lo:38:kworker.0 00000100:00100000:2.0:1788843641.244428:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788843641.244513:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788843641.244520:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843641.244538:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134487808 00000100:00100000:3.0:1788843641.244542:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134487808 00000100:00100000:1.0:1788843641.244565:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134487168 00000100:00100000:1.0:1788843641.244571:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134487168 00000100:00100000:1.0:1788843641.244601:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134487296 00000100:00100000:1.0:1788843641.244604:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134487296 00000100:00100000:3.0:1788843641.244617:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788843641.244621:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134487552 00000100:00100000:1.0:1788843641.244625:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134487552 00000100:00100000:3.0:1788843641.244628:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134487808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843641.244652:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788843641.244658:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3629:x1875738134487168:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1788843641.244677:0:6507:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788843641.244682:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134487808:12345-0@lo:400:kworker.0 Request processed in 55us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843641.244692:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788843641.244731:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134487808:0@lo:400:kworker.0 00000100:00100000:3.0:1788843641.244756:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788843641.244760:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3629:x1875738134487296:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1788843641.244771:0:11996:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788843641.244808:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3629:x1875738134487296:12345-0@lo:38:kworker.0 Request processed in 46us (415us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788843641.244814:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788843641.244841:0:11996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788843641.244845:0:11996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3629:x1875738134487552:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1788843641.244851:0:11996:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788843641.244874:0:11996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3629:x1875738134487552:12345-0@lo:38:kworker.0 Request processed in 28us (446us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788843641.244879:0:11996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00080000:3.0:1788843641.244922:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd006461800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788843641.244928:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788843641.244931:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3629:1875738134487296:0@lo:38:kworker.0 00000100:00080000:3.0:1788843641.244950:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd007225800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788843641.244954:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788843641.244956:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1875738134487552:0@lo:38:kworker.0 00000100:00100000:3.0:1788843641.244996:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134486784:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788843641.245207:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788843641.245994:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134487040 00000100:00100000:0.0:1788843641.246007:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134487040 00000100:00100000:0.0:1788843641.246060:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788843641.246067:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3629:x1875738134487040:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1788843641.246098:0:6511:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788843641.246210:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3629:x1875738134487040:12345-0@lo:38:kworker.0 Request processed in 142us (2673us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788843641.246217:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00080000:3.0:1788843641.247035:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd13e8a2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788843641.247044:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788843641.247049:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134487040:0@lo:38:kworker.0 00000100:00100000:1.0:1788843641.273888:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3629:x1875738134487168:12345-0@lo:38:kworker.0 Request processed in 29215us (29528us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788843641.273915:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00080000:3.0:1788843641.276884:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd13f944800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788843641.276917:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788843641.276923:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875738134487168:0@lo:38:kworker.0 00000100:00100000:3.0:1788843641.756595:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788843641.756634:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134487936:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788843641.756744:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843641.757055:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134487936 00000100:00100000:0.0:1788843641.757067:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134487936 00000100:00100000:0.0:1788843641.757132:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788843641.757174:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134487936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788843641.757215:0:8425:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788843641.757282:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134487936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 140us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843641.757289:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788843641.758277:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134487936:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788843642.013790:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:02000400:2.0:1788843642.266389:0:15146:0:(genops.c:1852:obd_exports_barrier()) lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? 00000020:01000000:2.0:1788843642.284938:0:15146:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd00732dde0 - data ffff9bd131b001b0/ffff9bd0078f5800 00000020:01000000:2.0:1788843642.285242:0:15146:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd1123732a0 - data ffff9bd131977438/ffff9bd13e88e000 00000001:00000004:2.0:1788843642.295695:0:15146:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:1.0:1788843642.375980:0:15146:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788843642.375994:0:15146:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1788843642.376016:0:15146:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9bd008499c00 x1875738134483200/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788843637 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843642.376051:0:15146:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788843642.384109:0:15146:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788843642.384134:0:15146:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:1.0:1788843642.384176:0:15146:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788843642.384180:0:15146:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788843642.385957:0:8899:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788843642.385969:0:8899:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:2.0:1788843642.385994:0:8899:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788843642.388749:0:15146:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788843642.388762:0:15146:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:1.0:1788843642.388806:0:15146:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788843642.388809:0:15146:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788843642.390572:0:9760:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788843642.390582:0:9760:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:2.0:1788843642.390600:0:9760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788843642.393425:0:15146:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0b89 00000020:00000080:1.0:1788843642.393442:0:15146:0:(genops.c:885:class_export_put()) final put ffff9bd1203ef800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788843642.394638:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd1203ef800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788843642.415738:0:15146:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0b9e 00000020:00000080:3.0:1788843642.415762:0:15146:0:(genops.c:885:class_export_put()) final put ffff9bd1203ec000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788843642.415788:0:15146:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788843642.415803:0:15146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788843642.415813:0:15146:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788843642.415818:0:15146:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9bd1203f3370) has no exports 00000004:01000000:3.0:1788843642.416040:0:15146:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788843642.416053:0:15146:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0fd4 00000020:00000080:3.0:1788843642.416059:0:15146:0:(genops.c:885:class_export_put()) final put ffff9bd0078e1800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788843642.416064:0:15146:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788843642.416081:0:15146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788843642.416093:0:15146:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788843642.416096:0:15146:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff9bd0078bb370) has no exports 00000020:00000080:3.0:1788843642.416104:0:15146:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0fcd 00000020:00000080:3.0:1788843642.416108:0:15146:0:(genops.c:885:class_export_put()) final put ffff9bd0078e7800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788843642.416549:0:15146:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788843642.416555:0:15146:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788843642.416560:0:15146:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1788843642.416568:0:15146:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788843642.416570:0:15146:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788843642.416615:0:15146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788843642.416624:0:15146:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788843642.416632:0:15146:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0e92 00000020:00000080:3.0:1788843642.416639:0:15146:0:(genops.c:885:class_export_put()) final put ffff9bd006467000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788843642.416642:0:15146:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788843642.416647:0:15146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788843642.416652:0:15146:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788843642.416654:0:15146:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9bd13eb10000) has no exports 00000020:00000080:3.0:1788843642.416658:0:15146:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0e8b 00000020:00000080:3.0:1788843642.416662:0:15146:0:(genops.c:885:class_export_put()) final put ffff9bd00644a000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788843642.417493:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd1203ec000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1788843642.417520:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd0078e1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788843642.417540:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd0078e7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788843642.417546:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd0078e5000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788843642.417553:0:8:0:(genops.c:885:class_export_put()) final put ffff9bd0078e4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788843642.417556:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd0078e4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788843642.417572:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788843642.417698:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd006467000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788843642.417705:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd00644a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788843642.418060:0:15146:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788843642.418065:0:15146:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788843642.418069:0:15146:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1788843642.418076:0:15146:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788843642.418079:0:15146:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788843642.418205:0:15146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788843642.418218:0:15146:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788843642.418236:0:15146:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788843642.418244:0:15146:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0d42 00000020:00000080:3.0:1788843642.418253:0:15146:0:(genops.c:885:class_export_put()) final put ffff9bd13f943800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788843642.418258:0:15146:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788843642.418262:0:15146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788843642.418276:0:15146:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788843642.418281:0:15146:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9bd13df33370) has no exports 00000020:00000080:3.0:1788843642.418287:0:15146:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0d3b 00000020:00000080:3.0:1788843642.418292:0:15146:0:(genops.c:885:class_export_put()) final put ffff9bd13f942000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788843642.418909:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd006449000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788843642.418919:0:8:0:(genops.c:885:class_export_put()) final put ffff9bd006448800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788843642.418922:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd006448800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788843642.418928:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788843642.419010:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd13f943800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788843642.419016:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd13f942000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788843642.427340:0:15146:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1788843642.427353:0:15146:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788843642.427359:0:15146:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1788843642.427370:0:15146:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788843642.427481:0:15146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788843642.427501:0:15146:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788843642.427537:0:15146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788843642.427541:0:15146:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788843642.427549:0:15146:0:(genops.c:885:class_export_put()) final put ffff9bd1203e9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788843642.427555:0:15146:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd1203e9000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788843642.427565:0:15146:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788843642.427705:0:15146:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0ba5 00000020:00000080:2.0:1788843642.427713:0:15146:0:(genops.c:885:class_export_put()) final put ffff9bd1203ea800/lustre-MDD0000_UUID 00000020:01000000:2.0:1788843642.427719:0:15146:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788843642.427724:0:15146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788843642.427747:0:15146:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788843642.427752:0:15146:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9bd1203f4d28) has no exports 00000020:00000080:2.0:1788843642.427779:0:15146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788843642.427783:0:15146:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788843642.427790:0:15146:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0bac 00000020:00000080:2.0:1788843642.427809:0:15146:0:(genops.c:885:class_export_put()) final put ffff9bd1203ee800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788843642.427820:0:15146:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd118db4800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788843642.427824:0:15146:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd118db4800 3 00000020:01000004:2.0:1788843642.427828:0:15146:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bd118db4800 from lustre-MDT0000 00000020:00000080:2.0:1788843642.427850:0:15146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788843642.427854:0:15146:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788843642.427857:0:15146:0:(genops.c:885:class_export_put()) final put ffff9bd1203ed800/lustre-MDT0000_UUID 00000020:00000080:2.0:1788843642.427859:0:15146:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd1203ed800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788843642.427868:0:15146:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788843642.427916:0:15146:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1788843642.427921:0:15146:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788843642.427924:0:15146:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788843642.427928:0:15146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788843642.427930:0:15146:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788843642.427938:0:15146:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9bd11ae3a000 e79d9884-ba2e-42e7-accb-b4784b9c1837 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788843642.427944:0:15146:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9bd133398000) has exports, disconnecting them 00000020:00080000:2.0:1788843642.427949:0:15146:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9bd11ae3a000), last request at 1788843366 00000020:00000080:2.0:1788843642.427968:0:15146:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0b4a 00000020:00010000:2.0:1788843642.427972:0:15146:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9bd11ae3a000: total 2 00000100:00080000:2.0:1788843642.427977:0:15146:0:(import.c:65:import_set_state_nolock()) ffff9bd12e2da800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788843642.427998:0:15146:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd11ae3a000): rc 0 00000020:00080000:2.0:1788843642.428003:0:15146:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9bd133398000) has no exports 00000020:00010000:2.0:1788843642.428018:0:6495:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9bd11ae3a000: total 2 00010000:00010000:2.0:1788843642.428045:0:6495:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bd11ae3a000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788843642.428080:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd13fb34400/0xa762dfcbd58d109f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d1098 expref: 14 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843642.428114:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd118f71000/0xa762dfcbd58d0c54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d0c4d expref: 13 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843642.428131:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd10f7ae800/0xa762dfcbd58d10c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d10c2 expref: 12 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843642.428172:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd10fa3c000/0xa762dfcbd58d1059 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d1052 expref: 11 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843642.428185:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd13fb35e00/0xa762dfcbd58d0f6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d0f64 expref: 10 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843642.428198:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd10f7ae200/0xa762dfcbd58d1075 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d106e expref: 9 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843642.428209:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd13fb34600/0xa762dfcbd58d12f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d12eb expref: 8 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843642.428220:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd10fa3de00/0xa762dfcbd58d1067 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d1060 expref: 7 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843642.428230:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd118f71600/0xa762dfcbd58d0c46 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d0c3f expref: 6 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843642.428244:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd100030e00/0xa762dfcbd58d12dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d12d6 expref: 5 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843642.428255:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd007947a00/0xa762dfcbd58d1083 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d107c expref: 4 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843642.428280:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd13fb34a00/0xa762dfcbd58d1300 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d12f9 expref: 3 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843642.428293:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd13fb35000/0xa762dfcbd58d1091 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa762dfcbd58d108a expref: 2 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843642.428306:0:6495:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bd11ae3a000, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1788843642.428321:0:6495:0:(genops.c:885:class_export_put()) final put ffff9bd11ae3a000/e79d9884-ba2e-42e7-accb-b4784b9c1837 00010000:00010000:2.0:1788843642.428328:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843642.428330:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843642.428332:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843642.428400:0:6501:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9bd105512a00:6501] 2 exiting: rc = 0 00000100:00100000:2.0:1788843642.428575:0:6500:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9bd1116ea800:6500] 1 exiting: rc = 0 00000100:00100000:1.0:1788843642.428729:0:6498:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9bd105513a00:6498] 0 exiting: rc = 1 00000020:00000080:1.0:1788843642.428788:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd13f940000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788843642.428795:0:8:0:(genops.c:885:class_export_put()) final put ffff9bd13f942800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788843642.428797:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd13f942800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788843642.428803:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788843642.428869:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd1203ea800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788843642.428873:0:8:0:(genops.c:885:class_export_put()) final put ffff9bd1203eb800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788843642.428875:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd1203eb800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788843642.428885:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788843642.428934:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd1203ee800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788843642.428939:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd11ae3a000/e79d9884-ba2e-42e7-accb-b4784b9c1837 for MGS 00000020:00000080:1.0:1788843642.428970:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd12e2da800 for MGS 00000100:00100000:2.0:1788843642.431948:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.431963:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.431970:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.431976:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.431982:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.431989:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.431996:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432001:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432008:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432014:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432020:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432025:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432031:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432039:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432045:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432051:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432057:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432063:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432096:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432103:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432111:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432119:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432126:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432133:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432512:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432524:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432530:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432538:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432546:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432553:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432559:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432571:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432577:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432583:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432589:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432595:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432602:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432608:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432615:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432621:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432627:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432633:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432639:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432645:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432651:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432657:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432663:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432669:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432674:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432679:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432685:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432692:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432698:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432717:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432723:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432728:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432734:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432740:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432747:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432754:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432759:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432765:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432771:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843642.432776:0:15146:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1788843642.441018:0:15146:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd0075a8d20 - data ffff9bd131b196c0/ffff9bd10f8c1c00 00000020:01000000:2.0:1788843642.441229:0:15146:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd112373540 - data ffff9bd1126ab0d8/ffff9bd10482b000 00000020:00000080:2.0:1788843642.441773:0:15146:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0b2e 00000020:00000080:2.0:1788843642.441785:0:15146:0:(genops.c:885:class_export_put()) final put ffff9bd12e00d000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788843642.441808:0:15146:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd118db4800 from MGS, refs=2 00000020:01000004:2.0:1788843642.441812:0:15146:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd118db4800 2 00000020:01000004:2.0:1788843642.441815:0:15146:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bd118db4800 from MGS 00000020:00000080:2.0:1788843642.441840:0:15146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788843642.441850:0:15146:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788843642.441852:0:15146:0:(genops.c:885:class_export_put()) final put ffff9bd12e009800/MGS 00000020:00000080:2.0:1788843642.441855:0:15146:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd12e009800/MGS for MGS 00000020:01000000:2.0:1788843642.441862:0:15146:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788843642.441969:0:15146:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788843642.441974:0:15146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788843642.441981:0:15146:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788843642.441990:0:15146:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9bd137aec000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788843642.441997:0:15146:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9bd136c53370) has exports, disconnecting them 00000020:00080000:2.0:1788843642.442002:0:15146:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9bd137aec000), last request at 1788843366 00000020:00000080:2.0:1788843642.442007:0:15146:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0bf9 00000020:00080000:2.0:1788843642.442018:0:15146:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd137aec000): rc 0 00000020:00000080:2.0:1788843642.442023:0:15146:0:(genops.c:885:class_export_put()) final put ffff9bd137aec000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788843642.442775:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd12e00d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788843642.442789:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd137aec000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788843642.488241:0:15146:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788843642.488254:0:15146:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788843642.488261:0:15146:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788843642.488271:0:15146:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788843642.488643:0:15146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788843642.488656:0:15146:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788843642.488666:0:15146:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd118db4800 1 00000020:00000080:2.0:1788843642.488676:0:15146:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0b20 00000020:00000080:2.0:1788843642.488687:0:15146:0:(genops.c:885:class_export_put()) final put ffff9bd12e00e800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788843642.489386:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd137aec800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788843642.489398:0:38:0:(genops.c:885:class_export_put()) final put ffff9bd137acc800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788843642.489402:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd137acc800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788843642.489411:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:2.0:1788843642.494972:0:15146:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788843642.494995:0:15146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788843642.495008:0:15146:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788843642.495014:0:15146:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9bd13339cd28) has no exports 00000020:00000080:1.0:1788843642.495485:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd12e00e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788843642.625988:0:15146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788843642.626007:0:15146:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788843642.626015:0:15146:0:(genops.c:885:class_export_put()) final put ffff9bd12e00a800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788843642.626021:0:15146:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd12e00a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788843642.626028:0:15146:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788843642.626290:0:15146:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bd118db5800 00000020:02000400:1.0:1788843642.626484:0:15146:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788843643.034537:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843644.058242:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843645.084381:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843646.110993:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843646.362439:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134488064:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788843646.362548:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843646.362565:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134488192:0@lo:400:kworker.0 00000400:00000100:0.0:1788843646.362594:0:3631:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875738134488192 offset 0 length 224: 4 00000100:00100000:2.0:1788843646.364239:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134488064 00000100:00100000:2.0:1788843646.364258:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134488064 00000100:00100000:2.0:1788843646.364343:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788843646.364355:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134488064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788843646.364399:0:10088:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788843646.365445:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134488064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1084us (2888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843646.365459:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:2.0:1788843646.365503:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788843646.365653:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788843646.365658:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788843646.365663:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bd13e8a2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788843646.365669:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 419 00000100:00080000:1.0:1788843646.365674:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788843646.365680:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9bd13e8a2000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:1.0:1788843646.365726:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd141b68a80 x1875738134488320/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788843646.365751:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788843646.365767:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788843646.365769:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bd13f944800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788843646.365773:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 419 00000100:00080000:1.0:1788843646.365776:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788843646.365780:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bd13f944800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:3.0:1788843646.365970:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134488064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788843646.366200:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd141b6aa00 x1875738134488448/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788843646.366211:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788843646.366215:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788843646.366217:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bd006461800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788843646.366220:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 419 00000100:00080000:1.0:1788843646.366223:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788843646.366226:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bd006461800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:1.0:1788843646.366240:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd141b6bb80 x1875738134488576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788843646.366272:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788843646.366275:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788843646.366277:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bd007225800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788843646.366280:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 419 00000100:00080000:1.0:1788843646.366283:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788843646.366285:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bd007225800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:1.0:1788843646.366294:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd141b6a680 x1875738134488832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788843646.366345:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134488320:0@lo:38:kworker.0 00000100:00100000:1.0:1788843646.366421:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843646.366451:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875738134488448:0@lo:38:kworker.0 00000100:00100000:1.0:1788843646.366475:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843646.366490:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3629:1875738134488576:0@lo:38:kworker.0 00000100:00100000:1.0:1788843646.366507:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843646.366519:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1875738134488832:0@lo:38:kworker.0 00000100:00100000:2.0:1788843646.366638:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134488960:0@lo:400:kworker.0 00000100:00100000:3.0:1788843646.366717:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134488704:0@lo:400:kworker.0 00000100:00100000:1.0:1788843646.366765:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843646.366916:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788843646.366925:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134489088:0@lo:400:kworker.0 00000100:00100000:1.0:1788843646.366958:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843646.366992:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134488320 00000100:00100000:1.0:1788843646.367000:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134488320 00000100:00100000:1.0:1788843646.367036:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788843646.367044:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3629:x1875738134488320:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788843646.367064:0:7934:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788843646.367110:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3629:x1875738134488320:12345-0@lo:38:kworker.0 Request processed in 65us (689us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788843646.367118:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788843646.367184:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843646.367402:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134488448 00000100:00100000:3.0:1788843646.367406:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134488448 00000100:00100000:3.0:1788843646.367433:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134488576 00000100:00100000:3.0:1788843646.367437:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134488576 00000100:00100000:3.0:1788843646.367448:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134488832 00000100:00100000:3.0:1788843646.367451:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134488832 00000100:00100000:3.0:1788843646.367458:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134488704 00000100:00100000:3.0:1788843646.367460:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134488704 00000100:00100000:3.0:1788843646.367501:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1788843646.367509:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134488704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843646.367575:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134488704:12345-0@lo:400:kworker.0 Request processed in 67us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843646.367581:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1788843646.367596:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788843646.367600:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3629:x1875738134488448:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788843646.367611:0:9517:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788843646.367635:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3629:x1875738134488448:12345-0@lo:38:kworker.0 Request processed in 33us (1159us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788843646.367651:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788843646.367665:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788843646.367669:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3629:x1875738134488576:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788843646.367678:0:9517:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788843646.367704:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3629:x1875738134488576:12345-0@lo:38:kworker.0 Request processed in 33us (1195us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788843646.367709:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788843646.367720:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788843646.367725:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3629:x1875738134488832:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788843646.367733:0:9517:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788843646.367755:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3629:x1875738134488832:12345-0@lo:38:kworker.0 Request processed in 29us (990us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788843646.367761:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00080000:3.0:1788843646.367778:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788843646.367818:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9bd141b68380 x1875738134488704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843646.367831:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134488704:0@lo:400:kworker.0 00000100:00100000:1.0:1788843646.368065:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134489088 00000100:00100000:1.0:1788843646.368070:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134489088 00000100:00100000:1.0:1788843646.368121:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788843646.368129:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134489088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843646.368192:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134489088:12345-0@lo:400:kworker.0 Request processed in 65us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843646.368198:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:1.0:1788843646.368232:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd13e8a2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788843646.368246:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788843646.368249:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134488320:0@lo:38:kworker.0 00000100:00080000:1.0:1788843646.368260:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd13f944800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788843646.368263:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788843646.368266:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875738134488448:0@lo:38:kworker.0 00000100:00080000:1.0:1788843646.368273:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd006461800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788843646.368277:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788843646.368279:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3629:1875738134488576:0@lo:38:kworker.0 00000100:00080000:1.0:1788843646.368287:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd007225800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788843646.368290:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788843646.368293:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1875738134488832:0@lo:38:kworker.0 00000100:00100000:1.0:1788843646.368333:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134489088:0@lo:400:kworker.0 00000100:00100000:1.0:1788843646.368351:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843646.368384:0:9517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134488960 00000100:00100000:1.0:1788843646.368388:0:9517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134488960 00000100:00100000:1.0:1788843646.368412:0:9517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1788843646.368418:0:9517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875738134488960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843646.368451:0:9517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875738134488960:12345-0@lo:400:kworker.0 Request processed in 34us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843646.368457:0:9517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00010000:00080000:1.0:1788843646.368478:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9bd141b69f80 x1875738134488960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843646.368488:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134488960:0@lo:400:kworker.0 00000100:00080000:3.0:1788843646.368657:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788843646.368661:0:6502:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788843646.874882:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134489216:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788843646.874989:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843646.876739:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134489216 00000100:00100000:0.0:1788843646.876757:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134489216 00000100:00100000:0.0:1788843646.876903:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788843646.876916:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134489216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788843646.876959:0:8426:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788843646.877067:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134489216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 153us (2078us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843646.877075:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788843646.877196:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134489216:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788843647.147112:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788843647.212081:0:15348:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788843647.249101:0:15348:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1788843647.249234:0:15348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d108a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d1091 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843647.249254:0:15348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d108a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d1091 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843647.249265:0:15348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d108a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d1091 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843647.249274:0:15348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d108a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d1091 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843647.249299:0:15348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788843647.249306:0:15348:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1788843647.249335:0:10328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:2.0:1788843647.249338:0:15348:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:3.0:1788843647.249343:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d108a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d1091 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843647.249343:0:15348:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788843647.249351:0:15348:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00010000:00010000:3.0:1788843647.249352:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946600 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:3.0:1788843647.249356:0:10328:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d108a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d1091 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788843647.249359:0:15348:0:(import.c:65:import_set_state_nolock()) ffff9bd13f944800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788843647.249364:0:15348:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788843647.249366:0:15348:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788843647.249369:0:15348:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788843647.249371:0:10328:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d108a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d1091 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843647.249378:0:10328:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d108a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d1091 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843647.249384:0:10328:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788843647.249387:0:10328:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788843647.249390:0:10328:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788843647.249439:0:10328:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d108a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d1091 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.249445:0:10328:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843647.249483:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d108a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d1091 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.249491:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d108a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d1091 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.249503:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843647.249505:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843647.249507:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843647.249516:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788843647.249538:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134489344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843647.249628:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843647.249733:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134489344 00000100:00100000:0.0:1788843647.249751:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134489344 00000100:00100000:0.0:1788843647.249808:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788843647.249818:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd133328850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3633:x1875738134489344:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788843647.249825:0:6491:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788843647 with bad export cookie 12061448818605755210 00010000:00010000:3.0:1788843647.256628:0:15348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aec00/0xa762dfcbd58d1098 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d109f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.256652:0:15348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aec00/0xa762dfcbd58d1098 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d109f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.256680:0:15348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aec00/0xa762dfcbd58d1098 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d109f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.256687:0:15348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aec00/0xa762dfcbd58d1098 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d109f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.256726:0:15348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788843647.256735:0:15348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35600/0xa762dfcbd58d0f64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0f6b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.256741:0:15348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35600/0xa762dfcbd58d0f64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0f6b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.256747:0:15348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35600/0xa762dfcbd58d0f64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d0f6b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.256753:0:15348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35600/0xa762dfcbd58d0f64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d0f6b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.256769:0:15348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788843647.256776:0:15348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd100030a00/0xa762dfcbd58d12f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d1300 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.256781:0:15348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd100030a00/0xa762dfcbd58d12f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d1300 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.256785:0:15348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd100030a00/0xa762dfcbd58d12f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d1300 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.256802:0:15348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.133@tcp lock: ffff9bd100030a00/0xa762dfcbd58d12f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d1300 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.256817:0:15348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788843647.256823:0:15348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5a00/0xa762dfcbd58d0c4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d0c54 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.256829:0:15348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5a00/0xa762dfcbd58d0c4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d0c54 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.256835:0:15348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5a00/0xa762dfcbd58d0c4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d0c54 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.256840:0:15348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5a00/0xa762dfcbd58d0c4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d0c54 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.256852:0:15348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1788843647.256856:0:15348:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:3.0:1788843647.256905:0:10328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788843647.256913:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aec00/0xa762dfcbd58d1098 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d109f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.256922:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7aec00 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:3.0:1788843647.256926:0:10328:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aec00/0xa762dfcbd58d1098 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d109f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.256936:0:10328:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aec00/0xa762dfcbd58d1098 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d109f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843647.256954:0:10328:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aec00/0xa762dfcbd58d1098 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d109f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843647.256960:0:10328:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788843647.256962:0:10328:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1788843647.256964:0:10328:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:3.0:1788843647.257010:0:10328:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aec00/0xa762dfcbd58d1098 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d109f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.257016:0:10328:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843647.257045:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aec00/0xa762dfcbd58d1098 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d109f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.257052:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aec00/0xa762dfcbd58d1098 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d109f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.257072:0:10328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788843647.257076:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35600/0xa762dfcbd58d0f64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d0f6b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.257082:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb35600 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:3.0:1788843647.257085:0:10328:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35600/0xa762dfcbd58d0f64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d0f6b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.257092:0:10328:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35600/0xa762dfcbd58d0f64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d0f6b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843647.257099:0:10328:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35600/0xa762dfcbd58d0f64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d0f6b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843647.257117:0:10328:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788843647.257120:0:10328:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788843647.257122:0:10328:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788843647.257181:0:10328:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35600/0xa762dfcbd58d0f64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d0f6b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.257188:0:10328:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843647.257209:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35600/0xa762dfcbd58d0f64 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d0f6b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.257216:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35600/0xa762dfcbd58d0f64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d0f6b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.257233:0:10328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788843647.257237:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd100030a00/0xa762dfcbd58d12f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d1300 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.257243:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd100030a00 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:3.0:1788843647.257246:0:10328:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd100030a00/0xa762dfcbd58d12f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d1300 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.257252:0:10328:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd100030a00/0xa762dfcbd58d12f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d1300 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843647.257258:0:10328:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd100030a00/0xa762dfcbd58d12f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d1300 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843647.257264:0:10328:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788843647.257267:0:10328:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788843647.257269:0:10328:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788843647.257287:0:10328:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd100030a00/0xa762dfcbd58d12f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d1300 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.257293:0:10328:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843647.257299:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd100030a00/0xa762dfcbd58d12f9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d1300 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.257305:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd100030a00/0xa762dfcbd58d12f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d1300 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.257316:0:10328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843647.257319:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5a00/0xa762dfcbd58d0c4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d0c54 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.257325:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1420e5a00 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:3.0:1788843647.257328:0:10328:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5a00/0xa762dfcbd58d0c4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d0c54 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.257334:0:10328:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5a00/0xa762dfcbd58d0c4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d0c54 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843647.257341:0:10328:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5a00/0xa762dfcbd58d0c4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d0c54 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843647.257346:0:10328:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788843647.257349:0:10328:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788843647.257351:0:10328:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788843647.257362:0:10328:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5a00/0xa762dfcbd58d0c4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d0c54 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.257367:0:10328:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843647.257373:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5a00/0xa762dfcbd58d0c4d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d0c54 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.257386:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5a00/0xa762dfcbd58d0c4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa762dfcbd58d0c54 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843647.257400:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843647.257401:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843647.257403:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843647.257434:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134489472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843647.257523:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843647.257585:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788843647.257591:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134489856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843647.257614:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843647.257639:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134489600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843647.257664:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843647.257680:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788843647.257685:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10fe21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134489728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843647.257704:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843647.257727:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134489472 00000100:00100000:3.0:1788843647.257735:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134489472 00000100:00100000:3.0:1788843647.257765:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134489856 00000100:00100000:3.0:1788843647.257767:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134489856 00000100:00100000:3.0:1788843647.257776:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134489600 00000100:00100000:3.0:1788843647.257778:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134489600 00000100:00100000:3.0:1788843647.257786:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134489728 00000100:00100000:3.0:1788843647.257788:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134489728 00000100:00100000:3.0:1788843647.257802:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788843647.257810:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3633:x1875738134489472:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788843647.257817:0:6493:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788843647 with bad export cookie 12061448818605755210 00000100:00100000:3.0:1788843647.257891:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3633:x1875738134489472:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (366us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788843647.257900:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788843647.257918:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788843647.257922:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10fe22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3633:x1875738134489856:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788843647.257927:0:6493:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788843647 with bad export cookie 12061448818605755210 00000100:00100000:3.0:1788843647.257955:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10fe22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3633:x1875738134489856:12345-0@lo:103:ldlm_bl.0 Request processed in 30us (339us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788843647.257961:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788843647.257973:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788843647.257977:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3630:x1875738134489600:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788843647.257980:0:6493:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788843647 with bad export cookie 12061448818605755210 00000100:00100000:3.0:1788843647.258010:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3630:x1875738134489600:12345-0@lo:103:ldlm_bl.0 Request processed in 32us (346us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788843647.258017:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788843647.258031:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788843647.258036:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3630:x1875738134489728:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788843647.258040:0:6493:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788843647 with bad export cookie 12061448818605755210 00000100:00100000:3.0:1788843647.258066:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3630:x1875738134489728:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (360us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788843647.258072:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1788843647.258105:0:3630:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.133@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788843647.258111:0:3630:0:(import.c:65:import_set_state_nolock()) ffff9bd12e00b000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788843647.258116:0:3630:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.133@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:1.0:1788843647.258250:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843647.258451:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788843647.258950:0:15348:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1788843647.258956:0:15348:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1788843647.258962:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788843647.258969:0:15348:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788843647.258977:0:15348:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9bd10f902000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788843647.258984:0:15348:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9bd13fbc1800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788843647.258990:0:15348:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9bd13eb13370) has exports, disconnecting them 00000020:00080000:2.0:1788843647.258995:0:15348:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9bd10f902000), last request at 1788843646 00000020:00000080:2.0:1788843647.259017:0:15348:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0f2c 00000100:00080000:2.0:1788843647.259032:0:15348:0:(import.c:65:import_set_state_nolock()) ffff9bd10f901000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788843647.259085:0:15348:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd10f902000): rc 0 00000020:00000080:2.0:1788843647.259088:0:15348:0:(genops.c:885:class_export_put()) final put ffff9bd10f902000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1788843647.259109:0:15348:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9bd13fbc1800), last request at 1788843646 00000020:00000080:2.0:1788843647.259113:0:15348:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0e06 00000100:00080000:2.0:1788843647.259119:0:15348:0:(import.c:65:import_set_state_nolock()) ffff9bd13fbc5800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788843647.259131:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd10f902000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1788843647.259192:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd10f901000 for lustre-MDT0001 00000020:00080000:2.0:1788843647.259206:0:15348:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd13fbc1800): rc 0 00000020:00000080:2.0:1788843647.259208:0:15348:0:(genops.c:885:class_export_put()) final put ffff9bd13fbc1800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1788843647.259219:0:15348:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb2dcc1cf7ae0 00000020:00000080:2.0:1788843647.259230:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd13fbc1800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00010000:00010000:1.0:1788843647.259413:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788843647.259556:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd13fbc5800 for lustre-MDT0001 00010000:00010000:1.0:1788843647.261183:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843647.261485:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788843647.261544:0:15348:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788843647.261550:0:15348:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:2.0:1788843647.266744:0:15348:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788843647.266756:0:15348:0:(import.c:65:import_set_state_nolock()) ffff9bd13e8a2000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788843647.266880:0:3633:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.133@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1788843647.267322:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd133328850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3633:x1875738134489344:12345-0@lo:103:ldlm_bl.0 Request processed in 17502us (17691us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788843647.267333:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788843647.274707:0:15348:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788843647.274719:0:15348:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 3 00000004:00080000:0.0:1788843647.274756:0:15348:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788843647.274826:0:15348:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788843647.274876:0:15348:0:(import.c:65:import_set_state_nolock()) ffff9bd13e958800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788843647.274906:0:15348:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788843647.274908:0:15348:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1788843647.274916:0:15348:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788843647.274980:0:15348:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788843647.274993:0:15348:0:(import.c:65:import_set_state_nolock()) ffff9bd13e95e800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788843647.275086:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008625500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134489984:0@lo:9:umount.0 00000100:00100000:1.0:1788843647.275204:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843647.275269:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134490112:0@lo:9:umount.0 00000100:00100000:1.0:1788843647.275293:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788843647.277087:0:15348:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9bd13eb13370) has no exports 00000100:00100000:0.0:1788843647.279237:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134489984 00000100:00100000:0.0:1788843647.279266:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134489984 00000100:00100000:0.0:1788843647.279329:0:8901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134490112 00000100:00100000:0.0:1788843647.279334:0:8901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134490112 00000100:00100000:1.0:1788843647.279489:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788843647.279504:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1875738134489984:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788843647.279544:0:8424:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0e53 00000100:00080000:1.0:1788843647.279558:0:8424:0:(import.c:65:import_set_state_nolock()) ffff9bd00644a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788843647.279606:0:8424:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788843647.279769:0:8901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788843647.279779:0:8901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3629:x1875738134490112:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788843647.279792:0:8901:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0f95 00000100:00080000:0.0:1788843647.279798:0:8901:0:(import.c:65:import_set_state_nolock()) ffff9bd10f904000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788843647.279834:0:8901:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1788843647.280008:0:8901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3629:x1875738134490112:12345-0@lo:9:umount.0 Request processed in 231us (4713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843647.280016:0:8901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788843647.280296:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3629:x1875738134489984:12345-0@lo:9:umount.0 Request processed in 797us (5092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843647.280304:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00010000:1.0:1788843647.280327:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788843647.280368:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd13e958800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788843647.280381:0:3629:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788843647.280383:0:3629:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788843647.280387:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008625500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134489984:0@lo:9:umount.0 00000100:00080000:1.0:1788843647.280400:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd13e95e800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788843647.280408:0:3629:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788843647.280409:0:3629:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788843647.280425:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134490112:0@lo:9:umount.0 00000100:00080000:3.0:1788843647.287436:0:3630:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.133@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788843647.287444:0:3630:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788843647.287480:0:3630:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd141b69500 x1875738134488192/t0(0) o400->MGC192.168.203.133@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788843662 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843647.287508:0:3630:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd10fe23100 x1875738134489344/t0(0) o103->MGC192.168.203.133@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788843663 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843647.287521:0:3630:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd10fe22d80 x1875738134489472/t0(0) o103->MGC192.168.203.133@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788843663 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843647.287589:0:3630:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd10fe20380 x1875738134489856/t0(0) o103->MGC192.168.203.133@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788843663 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843647.287598:0:3630:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd10fe21c00 x1875738134489600/t0(0) o103->MGC192.168.203.133@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788843663 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843647.287608:0:3630:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd10fe21180 x1875738134489728/t0(0) o103->MGC192.168.203.133@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788843663 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788843647.289499:0:3633:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9bd12e00b000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1788843647.289535:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134489472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843647.289545:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134489344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843647.289791:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e79d9884-ba2e-42e7-accb-b4784b9c1837:3633:1875738134489856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843647.289884:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e79d9884-ba2e-42e7-accb-b4784b9c1837:3631:1875738134488192:0@lo:400:kworker.0 00010000:00010000:2.0:1788843647.289904:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788843647.293836:0:3630:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788843647.293850:0:3630:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788843647.293852:0:3630:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788843647.293859:0:3630:0:(import.c:65:import_set_state_nolock()) ffff9bd12e00b000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788843647.293878:0:3630:0:(import.c:510:import_select_connection()) MGC192.168.203.133@tcp: connect to NID 0@lo last attempt 144 00000100:00080000:3.0:1788843647.293892:0:3630:0:(import.c:624:import_select_connection()) MGC192.168.203.133@tcp: import ffff9bd12e00b000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:1.0:1788843647.294746:0:3630:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd007768a80 x1875738134490240/t0(0) o250->MGC192.168.203.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788843647.294811:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134489600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788843647.294850:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10fe21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e79d9884-ba2e-42e7-accb-b4784b9c1837:3630:1875738134489728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843647.295041:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e79d9884-ba2e-42e7-accb-b4784b9c1837:3629:1875738134490240:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1788843647.295106:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875738134490240 offset 0 length 520: 4 00000020:00080000:2.0:1788843647.302731:0:15348:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9bd13eb13370) has no exports 00000020:01000000:3.0:1788843647.372723:0:15348:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd00732d9c0 - data ffff9bd131a2bbd0/ffff9bd00674a400 00000020:01000000:3.0:1788843647.372994:0:15348:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd131e54420 - data ffff9bd13197f360/ffff9bd13f936c00 00000001:00000004:3.0:1788843647.388511:0:15348:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1788843647.451191:0:15348:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788843647.451203:0:15348:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1788843647.451214:0:15348:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788843647.454314:0:15348:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788843647.454326:0:15348:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 4 00000004:00080000:2.0:1788843647.454414:0:15348:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788843647.454418:0:15348:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788843647.455366:0:8895:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788843647.455374:0:8895:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1788843647.455388:0:8895:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788843647.456505:0:15348:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788843647.456514:0:15348:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1788843647.456540:0:15348:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788843647.456543:0:15348:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788843647.457301:0:9755:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788843647.457307:0:9755:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1788843647.457328:0:9755:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788843647.463108:0:15348:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0c70 00000020:00000080:1.0:1788843647.463121:0:15348:0:(genops.c:885:class_export_put()) final put ffff9bd13e8a0000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788843647.464152:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd13e8a0000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788843647.472977:0:15348:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0c85 00000020:00000080:1.0:1788843647.472992:0:15348:0:(genops.c:885:class_export_put()) final put ffff9bd13e864000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788843647.473002:0:15348:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1788843647.473007:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788843647.473021:0:15348:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00000080:2.0:1788843647.473050:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd13e864000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00080000:1.0:1788843647.473200:0:15348:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9bd1203f0000) has no exports 00000004:01000000:1.0:1788843647.473431:0:15348:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788843647.473441:0:15348:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0f8e 00000020:00000080:1.0:1788843647.473446:0:15348:0:(genops.c:885:class_export_put()) final put ffff9bd0078e6000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788843647.473496:0:15348:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788843647.473501:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788843647.473508:0:15348:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788843647.473510:0:15348:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff9bd0078b8000) has no exports 00000020:00000080:1.0:1788843647.473517:0:15348:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0f87 00000020:00000080:1.0:1788843647.473520:0:15348:0:(genops.c:885:class_export_put()) final put ffff9bd1203e8000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788843647.473739:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd0078e6000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1788843647.476068:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd1203e8000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1788843647.481251:0:15348:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788843647.481260:0:15348:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788843647.481264:0:15348:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1788843647.481272:0:15348:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788843647.481287:0:15348:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788843647.481377:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788843647.481391:0:15348:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788843647.481400:0:15348:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0e4c 00000020:00000080:1.0:1788843647.481408:0:15348:0:(genops.c:885:class_export_put()) final put ffff9bd0059c6800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788843647.482203:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd13e95e800 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1788843647.482216:0:8:0:(genops.c:885:class_export_put()) final put ffff9bd10f93e800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788843647.482219:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd10f93e800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1788843647.482226:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788843647.483682:0:15348:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788843647.483694:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788843647.483706:0:15348:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788843647.483711:0:15348:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9bd13df34d28) has no exports 00000020:00000080:1.0:1788843647.483720:0:15348:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0e45 00000020:00000080:1.0:1788843647.483728:0:15348:0:(genops.c:885:class_export_put()) final put ffff9bd13e958000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788843647.484209:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd0059c6800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1788843647.484220:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd13e958000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1788843647.485407:0:15348:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788843647.485415:0:15348:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788843647.485419:0:15348:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 5 00000004:00080000:1.0:1788843647.485427:0:15348:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788843647.485429:0:15348:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788843647.485481:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788843647.485492:0:15348:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1788843647.485509:0:15348:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788843647.485516:0:15348:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0ca8 00000020:00000080:1.0:1788843647.485524:0:15348:0:(genops.c:885:class_export_put()) final put ffff9bd13f928800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788843647.485530:0:15348:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1788843647.485548:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788843647.485553:0:15348:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788843647.485556:0:15348:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9bd13eb14d28) has no exports 00000020:00000080:1.0:1788843647.485562:0:15348:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0ca1 00000020:00000080:1.0:1788843647.485567:0:15348:0:(genops.c:885:class_export_put()) final put ffff9bd13e8a5000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788843647.485885:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd13e958800 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1788843647.485892:0:8:0:(genops.c:885:class_export_put()) final put ffff9bd006464000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788843647.485895:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd006464000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1788843647.485900:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788843647.485978:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd13f928800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1788843647.485983:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd13e8a5000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788843647.490225:0:15348:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788843647.490235:0:15348:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788843647.490240:0:15348:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788843647.490251:0:15348:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788843647.490310:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788843647.490333:0:15348:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788843647.490376:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788843647.490380:0:15348:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788843647.490386:0:15348:0:(genops.c:885:class_export_put()) final put ffff9bd13e8a7800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788843647.490392:0:15348:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd13e8a7800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788843647.490406:0:15348:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788843647.490575:0:15348:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0c8c 00000020:00000080:0.0:1788843647.490582:0:15348:0:(genops.c:885:class_export_put()) final put ffff9bd13e865800/lustre-MDD0001_UUID 00000020:01000000:0.0:1788843647.490587:0:15348:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788843647.490591:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788843647.490596:0:15348:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788843647.490599:0:15348:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9bd13eb119b8) has no exports 00000020:00000080:0.0:1788843647.490647:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788843647.490652:0:15348:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788843647.490657:0:15348:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0c93 00000020:00000080:0.0:1788843647.490661:0:15348:0:(genops.c:885:class_export_put()) final put ffff9bd13e867800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788843647.490668:0:15348:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd12e2b3800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788843647.490672:0:15348:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd12e2b3800 2 00000020:01000004:0.0:1788843647.490675:0:15348:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bd12e2b3800 from lustre-MDT0001 00000020:00000080:0.0:1788843647.490692:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788843647.490695:0:15348:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788843647.490698:0:15348:0:(genops.c:885:class_export_put()) final put ffff9bd13e8a0800/lustre-MDT0001_UUID 00000020:00000080:0.0:1788843647.490700:0:15348:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd13e8a0800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788843647.490708:0:15348:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788843647.490740:0:15348:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788843647.490754:0:15348:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788843647.490756:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788843647.490760:0:15348:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788843647.490767:0:15348:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9bd137ae9800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788843647.490771:0:15348:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9bd1333999b8) has exports, disconnecting them 00000020:00080000:0.0:1788843647.490776:0:15348:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9bd137ae9800), last request at 1788843386 00000020:00000080:0.0:1788843647.490780:0:15348:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0ce7 00000020:00080000:0.0:1788843647.490810:0:15348:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd137ae9800): rc 0 00000020:00000080:0.0:1788843647.490815:0:15348:0:(genops.c:885:class_export_put()) final put ffff9bd137ae9800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1788843647.492609:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd13e8a2000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1788843647.492626:0:8:0:(genops.c:885:class_export_put()) final put ffff9bd13e865000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788843647.492629:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd13e865000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1788843647.492637:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788843647.492776:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd13e865800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1788843647.492781:0:8:0:(genops.c:885:class_export_put()) final put ffff9bd13e864800/lustre-MDD0001_UUID 00000020:00000080:2.0:1788843647.492783:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd13e864800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1788843647.492787:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1788843647.492975:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd13e867800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788843647.492980:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd137ae9800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1788843647.494154:0:15348:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1788843647.494161:0:15348:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788843647.494165:0:15348:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788843647.494171:0:15348:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788843647.494196:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd13f944800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1788843647.494478:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788843647.494487:0:15348:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1788843647.494492:0:15348:0:(genops.c:885:class_export_put()) final put ffff9bd13f946000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1788843647.494495:0:15348:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd13f946000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1788843647.494500:0:15348:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1788843647.494557:0:15348:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd12e2b3800 1 00000020:00000080:2.0:1788843647.494563:0:15348:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0c23 00000020:00000080:2.0:1788843647.494569:0:15348:0:(genops.c:885:class_export_put()) final put ffff9bd120397000/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1788843647.494582:0:15348:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1788843647.494595:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd120397000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788843647.494608:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788843647.494614:0:15348:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788843647.494618:0:15348:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9bd13e91cd28) has no exports 00000020:00000080:2.0:1788843647.576588:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788843647.576611:0:15348:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1788843647.576617:0:15348:0:(genops.c:885:class_export_put()) final put ffff9bd12e2b2800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788843647.576622:0:15348:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd12e2b2800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1788843647.576637:0:15348:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1788843647.582387:0:15348:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bd12e2b6000 00000020:01000000:2.0:1788843647.582418:0:15348:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788843647.582425:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788843647.582430:0:15348:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788843647.582435:0:15348:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9bd136c54d28) has no exports 00000100:00100000:2.0:1788843647.582515:0:6506:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9bd1032ee200:6506] 0 exiting: rc = 1 00000100:00100000:1.0:1788843647.582644:0:6508:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9bd12e1c8c00:6508] 2 exiting: rc = 0 00000100:00100000:1.0:1788843647.582740:0:6507:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9bd1032ee400:6507] 1 exiting: rc = 0 00000100:00100000:0.0:1788843647.584013:0:9517:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9bd006447c00:9517] 3 exiting: rc = 0 00000100:00100000:1.0:1788843647.584177:0:11996:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9bd10f99e200:11996] 4 exiting: rc = 0 00000100:00100000:2.0:1788843647.584589:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584597:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584602:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584607:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584612:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584617:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584622:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584628:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584633:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584638:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584643:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584649:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584653:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584659:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584663:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584668:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584673:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584678:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584683:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584689:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584694:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584699:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584704:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584709:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584725:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584737:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584743:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584754:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584759:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584764:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584769:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584779:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584921:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584930:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584935:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584940:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584945:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584951:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584965:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584971:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584976:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584982:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584987:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584992:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.584998:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.585002:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.585007:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.585011:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.585016:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.585021:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.585025:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.585030:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.585035:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.585040:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.585045:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.585053:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.585058:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.585063:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.585068:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.585079:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.585084:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.585089:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.585094:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.585099:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.592669:0:6509:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9bd136c1fc00:6509] 0 exiting: rc = 1 00000100:00100000:1.0:1788843647.593010:0:6510:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9bd136c1e000:6510] 1 exiting: rc = 0 00000100:00100000:2.0:1788843647.593116:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593124:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593131:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593135:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593225:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593234:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593241:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593246:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593252:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593256:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593266:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593272:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593277:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593283:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593287:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593291:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593295:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593300:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593305:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593310:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593314:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593319:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593324:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593329:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593334:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593339:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593344:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593350:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593355:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593359:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593376:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593380:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593385:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593392:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593398:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593404:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593409:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593415:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593421:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593426:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593431:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593435:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593440:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593444:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593450:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593454:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593460:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593508:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593515:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593520:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593524:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593608:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593614:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593619:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593625:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593629:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593634:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593639:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593643:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593648:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593653:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593659:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593668:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.593708:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.594520:0:6512:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9bd13306dc00:6512] 1 exiting: rc = 0 00000100:00100000:1.0:1788843647.594528:0:7934:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9bd13fad6e00:7934] 2 exiting: rc = 0 00000100:00100000:1.0:1788843647.594816:0:6511:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9bd1330f1000:6511] 0 exiting: rc = 1 00000100:00100000:2.0:1788843647.594942:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.594961:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.594968:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.594982:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.594989:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595000:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595006:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595011:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595017:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595022:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595027:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595032:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595038:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595043:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595048:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595053:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595060:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595076:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595082:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595087:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595093:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595098:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595103:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595108:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595114:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595120:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595126:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595132:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595187:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595210:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595216:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595221:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595226:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595232:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595237:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595242:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595253:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595258:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595264:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595270:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595275:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595294:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595300:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595305:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595311:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595316:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595416:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595422:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595428:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595433:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595439:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595443:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595449:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595466:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595472:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595477:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595482:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595487:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595492:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595497:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595503:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595508:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595513:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.595523:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.604222:0:6514:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9bd13306d400:6514] 1 exiting: rc = 0 00000100:00100000:1.0:1788843647.604231:0:6513:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9bd13306a600:6513] 0 exiting: rc = 1 00000100:00100000:0.0:1788843647.604325:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604333:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604337:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604342:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604347:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604352:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604356:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604360:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604365:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604370:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604374:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604378:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604382:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604387:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604391:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604396:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604400:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604404:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604408:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604413:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604427:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604432:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604437:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604441:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604450:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604457:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604462:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604470:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604475:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604479:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604483:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604488:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604492:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604497:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604502:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604509:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604514:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604518:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604524:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604539:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604546:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604550:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604555:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604561:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604566:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604571:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604577:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604582:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604590:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604595:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604600:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604605:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604610:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604615:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604620:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604633:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604638:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604642:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604647:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604652:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604656:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604661:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604665:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.604669:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605011:0:6515:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9bd12e124600:6515] 0 exiting: rc = 1 00000100:00100000:2.0:1788843647.605195:0:6516:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9bd13306d200:6516] 1 exiting: rc = 0 00000100:00100000:0.0:1788843647.605309:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605315:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605319:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605324:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605329:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605334:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605338:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605343:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605348:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605353:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605358:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605363:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605369:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605374:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605379:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605384:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605389:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605397:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605402:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605406:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605411:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605416:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605421:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605425:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605429:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605441:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605448:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605453:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605458:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605462:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605467:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605471:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605476:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605480:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605484:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605488:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605492:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605496:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605500:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605504:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605508:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605513:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605517:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605522:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605526:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605530:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605534:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605538:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605542:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605546:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605549:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605553:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605557:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605562:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605565:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605570:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605573:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605577:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605581:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605586:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605594:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605598:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605603:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.605607:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.606186:0:6518:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9bd12e125c00:6518] 1 exiting: rc = 0 00000100:00100000:3.0:1788843647.606503:0:6517:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9bd12e125a00:6517] 0 exiting: rc = 1 00000100:00100000:0.0:1788843647.606542:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606549:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606553:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606558:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606562:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606567:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606572:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606576:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606581:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606585:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606590:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606594:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606599:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606604:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606608:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606613:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606617:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606622:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606627:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606631:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606635:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606639:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606643:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606648:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606653:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606657:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606662:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606666:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606670:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606674:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606679:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606691:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606701:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606708:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606713:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606719:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606724:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606729:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606734:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606926:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606932:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606937:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606942:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606946:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606951:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606955:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606959:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606964:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606968:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606973:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606977:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606981:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606986:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606990:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606995:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.606999:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.607003:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.607007:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.607011:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.607015:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.607019:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.607023:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.607027:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.607032:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843647.608580:0:6519:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9bd132ab8a00:6519] 0 exiting: rc = 1 00000100:00100000:2.0:1788843647.608787:0:6520:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9bd132ab9c00:6520] 1 exiting: rc = 0 00000100:00100000:2.0:1788843647.609173:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9bd132ab8600:6521] 2 exiting: rc = 0 00000100:00100000:0.0:1788843647.609232:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609239:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609255:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609260:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609266:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609271:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609277:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609282:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609288:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609310:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609316:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609321:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609327:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609332:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609337:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609342:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609347:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609352:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609358:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609364:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609370:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609375:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609381:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609386:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609391:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609396:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609402:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609407:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609412:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609417:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609422:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609427:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609432:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609449:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609455:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609460:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609465:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609475:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609480:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609485:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609495:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609506:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609512:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609521:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609526:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609531:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609540:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609545:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609554:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609560:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609569:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609574:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609582:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609588:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609593:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609602:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609607:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609615:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609620:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609626:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609634:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609640:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609649:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843647.609654:0:15348:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788843647.614514:0:15348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788843647.614526:0:15348:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788843647.614532:0:15348:0:(genops.c:885:class_export_put()) final put ffff9bd136c58000/MDS_uuid 00000020:00000080:1.0:1788843647.614536:0:15348:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd136c58000/MDS_uuid for MDS 00000020:01000000:1.0:1788843647.614545:0:15348:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788843647.614711:0:15348:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1788843648.156134:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843649.186491:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843650.208812:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843651.227282:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788843651.240035:0:15549:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788843651.248263:0:15549:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788843651.248312:0:15549:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d600/0xa762dfcbd58d106e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d1075 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843651.248343:0:15549:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d600/0xa762dfcbd58d106e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d1075 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843651.248351:0:15549:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d600/0xa762dfcbd58d106e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d1075 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843651.248357:0:15549:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d600/0xa762dfcbd58d106e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d1075 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843651.248387:0:15549:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788843651.248392:0:15549:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788843651.248418:0:15549:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788843651.248422:0:15549:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788843651.248428:0:15549:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788843651.248434:0:15549:0:(import.c:65:import_set_state_nolock()) ffff9bd006461800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788843651.248439:0:15549:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788843651.248441:0:15549:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788843651.248444:0:15549:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788843651.249301:0:15549:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788843651.249305:0:15549:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788843651.249309:0:15549:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788843651.249328:0:15549:0:(import.c:65:import_set_state_nolock()) ffff9bd0059c6000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788843651.249731:0:10328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843651.249740:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d600/0xa762dfcbd58d106e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d1075 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843651.249750:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d600 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:2.0:1788843651.249754:0:10328:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d600/0xa762dfcbd58d106e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d1075 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843651.249765:0:10328:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d600/0xa762dfcbd58d106e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d1075 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843651.249772:0:10328:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d600/0xa762dfcbd58d106e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d1075 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843651.249777:0:10328:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788843651.249779:0:10328:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788843651.249781:0:10328:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788843651.249796:0:10328:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bd12e00b000 00010000:00010000:2.0:1788843651.249800:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d600/0xa762dfcbd58d106e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xa762dfcbd58d1075 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843651.249806:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d600/0xa762dfcbd58d106e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xa762dfcbd58d1075 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843651.249817:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843651.249819:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843651.249821:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843651.250715:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3629:1875738134490368:0@lo:39:umount.0 00000400:00000100:1.0:1788843651.250770:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875738134490368 offset 0 length 224: 4 00000100:00080000:3.0:1788843651.482636:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) e79d9884-ba2e-42e7-accb-b4784b9c1837->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788843651.482646:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) e79d9884-ba2e-42e7-accb-b4784b9c1837->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788843651.482650:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788843651.482654:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788843651.482676:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bd007225800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788843651.482686:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 424 00000100:00080000:3.0:1788843651.482691:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788843651.482699:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bd007225800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:3.0:1788843651.482742:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd141b6bb80 x1875738134490496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788843651.482897:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134490624:0@lo:400:kworker.0 00000400:00000100:2.0:1788843651.482949:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875738134490624 offset 0 length 224: 4 00000100:00100000:1.0:1788843651.483247:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1875738134490496:0@lo:38:kworker.0 00000400:00000100:1.0:1788843651.483273:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875738134490496 offset 0 length 520: 4 00010000:00010000:2.0:1788843652.250598:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788843652.506280:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) e79d9884-ba2e-42e7-accb-b4784b9c1837->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788843652.506299:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) e79d9884-ba2e-42e7-accb-b4784b9c1837->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788843652.506302:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788843652.506305:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788843652.506684:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788843652.506703:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1875738134490752:0@lo:400:kworker.0 00000400:00000100:2.0:1788843652.506760:0:3631:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875738134490752 offset 0 length 224: 4 00000001:00100000:2.0:1788843653.022002:0:8417:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788843653.022012:0:8417:0:(genops.c:885:class_export_put()) final put ffff9bd00644b000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788843653.022802:0:9500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788843653.022808:0:9500:0:(genops.c:885:class_export_put()) final put ffff9bd10f900000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788843653.022910:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd00644b000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788843653.022964:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd00644a800 for lustre-OST0000 00000020:00000080:0.0:1788843653.023104:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd10f900000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788843653.023352:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd10f904000 for lustre-OST0001 00010000:00010000:1.0:1788843653.274430:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843654.300233:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843655.323741:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843656.346451:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788843656.538903:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) e79d9884-ba2e-42e7-accb-b4784b9c1837->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788843656.538914:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) e79d9884-ba2e-42e7-accb-b4784b9c1837->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788843656.538917:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788843656.538920:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788843656.540269:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1875738134490880:0@lo:400:kworker.0 00000400:00000100:2.0:1788843656.540698:0:3631:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875738134490880 offset 0 length 224: 4 00010000:00010000:1.0:1788843657.372728:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843657.626532:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843647/real 1788843647] req@ffff9bd007768a80 x1875738134490240/t0(0) o250->MGC192.168.203.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788843657 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843657.626566:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd007768a80 x1875738134490240/t0(0) o250->MGC192.168.203.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788843657 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788843657.626587:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd12e00b000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788843657.626614:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788843657.626618:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e79d9884-ba2e-42e7-accb-b4784b9c1837:3629:1875738134490240:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:3.0:1788843657.626927:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) e79d9884-ba2e-42e7-accb-b4784b9c1837->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788843657.626933:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788843657.626936:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bd12e00b000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788843657.626940:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.133@tcp: connect to NID 0@lo last attempt 425 00000100:00080000:3.0:1788843657.626946:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.133@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788843657.626952:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.133@tcp: import ffff9bd12e00b000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:3.0:1788843657.626986:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd141b68000 x1875738134491008/t0(0) o250->MGC192.168.203.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788843657.627025:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788843657.627029:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788843657.627426:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788843657.627441:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134491136:0@lo:400:kworker.0 00000400:00000100:2.0:1788843657.627489:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875738134491136 offset 0 length 224: 4 00000100:00100000:1.0:1788843657.628137:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e79d9884-ba2e-42e7-accb-b4784b9c1837:3629:1875738134491008:0@lo:250:kworker.0 00000400:00000100:1.0:1788843657.628210:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875738134491008 offset 0 length 520: 4 00010000:00010000:0.0:1788843658.394385:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843659.419465:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843660.443911:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843661.467611:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843661.722604:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843651/real 1788843651] req@ffff9bd141b6a680 x1875738134490368/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788843661 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843661.722639:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd141b6a680 x1875738134490368/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788843661 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788843661.722660:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd0059c6000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788843661.722681:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3629:1875738134490368:0@lo:39:umount.0 00000100:00080000:3.0:1788843661.722801:0:15549:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788843661.722805:0:15549:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788843661.722811:0:15549:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788843661.723784:0:15549:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946000/0xa762dfcbd58d107c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d1083 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843661.723801:0:15549:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946000/0xa762dfcbd58d107c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d1083 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843661.723808:0:15549:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946000/0xa762dfcbd58d107c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d1083 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843661.723815:0:15549:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.133@tcp lock: ffff9bd007946000/0xa762dfcbd58d107c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d1083 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843661.724162:0:15549:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788843661.724182:0:15549:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d12eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d12f2 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843661.724190:0:15549:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d12eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d12f2 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843661.724195:0:15549:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d12eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d12f2 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843661.724200:0:15549:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d12eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d12f2 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843661.729562:0:6495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788843661.729578:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd007946000/0xa762dfcbd58d107c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d1083 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843661.729608:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946000 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:0.0:1788843661.729613:0:6495:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd007946000/0xa762dfcbd58d107c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d1083 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843661.729624:0:6495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd007946000/0xa762dfcbd58d107c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d1083 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843661.729631:0:6495:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd007946000/0xa762dfcbd58d107c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d1083 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843661.729637:0:6495:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788843661.729640:0:6495:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1788843661.729655:0:6495:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bd12e00b000 00010000:00010000:0.0:1788843661.729659:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd007946000/0xa762dfcbd58d107c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa762dfcbd58d1083 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843661.729666:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd007946000/0xa762dfcbd58d107c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa762dfcbd58d1083 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843661.729684:0:6495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843661.729688:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d12eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d12f2 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843661.729693:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7afe00 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:0.0:1788843661.729696:0:6495:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d12eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d12f2 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843661.729703:0:6495:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d12eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d12f2 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843661.729716:0:6495:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d12eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d12f2 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843661.729722:0:6495:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788843661.729725:0:6495:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788843661.729731:0:6495:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bd12e00b000 00010000:00010000:0.0:1788843661.729734:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d12eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa762dfcbd58d12f2 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843661.729741:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843661.729743:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843661.729745:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843661.731418:0:15549:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788843661.731542:0:15549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afe00/0xa762dfcbd58d12eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa762dfcbd58d12f2 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843661.731564:0:15549:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1788843661.731572:0:15549:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1788843661.731575:0:15549:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788843661.731612:0:15549:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788843661.731616:0:15549:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788843661.731624:0:15549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788843661.731630:0:15549:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788843661.731635:0:15549:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9bd10fbb3370) has no exports 00000020:00080000:3.0:1788843661.731659:0:15549:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9bd10fbb3370) has no exports 00010000:00010000:2.0:1788843661.732245:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788843661.734688:0:15549:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd11596e780 - data ffff9bd131acf288/ffff9bd10fa38000 00000020:01000000:3.0:1788843661.734820:0:15549:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd13e84b000 - data ffff9bd131a90360/ffff9bd0059e0c00 00100000:10000000:3.0:1788843661.747907:0:15549:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788843661.763181:0:15549:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0dc0 00000020:00000080:3.0:1788843661.763195:0:15549:0:(genops.c:885:class_export_put()) final put ffff9bd0059c0000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788843661.763435:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd0059c0000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:1.0:1788843661.765972:0:15549:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd10c0f0000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788843661.765985:0:15549:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd10c0f0000 2 00000020:01000004:1.0:1788843661.765989:0:15549:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bd10c0f0000 from lustre-OST0000 00000020:00000080:1.0:1788843661.766025:0:15549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788843661.766038:0:15549:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788843661.766043:0:15549:0:(genops.c:885:class_export_put()) final put ffff9bd0059c4800/lustre-OST0000_UUID 00000020:00000080:1.0:1788843661.766047:0:15549:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd0059c4800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788843661.766062:0:15549:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788843661.766162:0:15549:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788843661.766168:0:15549:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788843661.766172:0:15549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788843661.766177:0:15549:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788843661.766185:0:15549:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9bd006467800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788843661.766192:0:15549:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9bd13df319b8) has exports, disconnecting them 00000020:00080000:1.0:1788843661.766198:0:15549:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9bd006467800), last request at 1788843406 00000020:00000080:1.0:1788843661.766954:0:15549:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0dea 00000020:00080000:1.0:1788843661.766981:0:15549:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd006467800): rc 0 00000020:00000080:1.0:1788843661.766989:0:15549:0:(genops.c:885:class_export_put()) final put ffff9bd006467800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788843661.767067:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd006467800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788843661.769276:0:15549:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788843661.769285:0:15549:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788843661.769289:0:15549:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788843661.769297:0:15549:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788843661.769464:0:15549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788843661.769475:0:15549:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788843661.769482:0:15549:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788843661.769486:0:15549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788843661.769490:0:15549:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788843661.769498:0:15549:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9bd0059c1800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788843661.769504:0:15549:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff9bd10fbb19b8) has exports, disconnecting them 00000020:00080000:0.0:1788843661.769509:0:15549:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9bd0059c1800), last request at 1788843406 00000020:00000080:0.0:1788843661.769513:0:15549:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0dff 00000020:00080000:0.0:1788843661.769538:0:15549:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd0059c1800): rc 0 00000020:00000080:0.0:1788843661.769544:0:15549:0:(genops.c:885:class_export_put()) final put ffff9bd0059c1800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788843661.770350:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd006461800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788843661.770361:0:8:0:(genops.c:885:class_export_put()) final put ffff9bd13f92c800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788843661.770365:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd13f92c800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788843661.770372:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788843661.770435:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd0059c1800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1788843661.772503:0:15549:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788843661.772513:0:15549:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788843661.772517:0:15549:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788843661.772524:0:15549:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788843661.772551:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd0059c6000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788843661.772711:0:15549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788843661.772721:0:15549:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1788843661.772725:0:15549:0:(genops.c:885:class_export_put()) final put ffff9bd0059c2800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1788843661.772729:0:15549:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd0059c2800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1788843661.772735:0:15549:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1788843661.772817:0:15549:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd10c0f0000 1 00000020:00000080:3.0:1788843661.772823:0:15549:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0d88 00000020:00000080:3.0:1788843661.772829:0:15549:0:(genops.c:885:class_export_put()) final put ffff9bd13e862800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788843661.772838:0:15549:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788843661.772845:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd13e862800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788843661.772854:0:15549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788843661.772859:0:15549:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788843661.772862:0:15549:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9bd136c519b8) has no exports 00000020:00000080:3.0:1788843661.791018:0:15549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788843661.791030:0:15549:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788843661.791036:0:15549:0:(genops.c:885:class_export_put()) final put ffff9bd13f945000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788843661.791041:0:15549:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd13f945000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788843661.791053:0:15549:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788843661.791184:0:15549:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bd13f947800 00000020:02000400:3.0:1788843661.791228:0:15549:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788843662.491228:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788843662.752160:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) e79d9884-ba2e-42e7-accb-b4784b9c1837->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788843662.752175:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) e79d9884-ba2e-42e7-accb-b4784b9c1837->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788843662.752178:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788843662.752182:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788843662.752315:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134491264:0@lo:400:kworker.0 00000400:00000100:0.0:1788843662.752392:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875738134491264 offset 0 length 224: 4 00010000:00010000:1.0:1788843663.525632:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843664.541486:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843665.562331:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788843665.868093:0:15764:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788843665.891297:0:15764:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788843665.891389:0:15764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d1052 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d1059 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843665.891417:0:15764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d1052 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d1059 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843665.891426:0:15764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d1052 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d1059 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843665.891434:0:15764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d1052 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d1059 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843665.891452:0:15764:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788843665.891458:0:15764:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788843665.891480:0:15764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788843665.891491:0:15764:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd141b6bb80 x1875738134490496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788843676 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843665.891509:0:15764:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788843665.891515:0:15764:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788843665.891521:0:15764:0:(import.c:65:import_set_state_nolock()) ffff9bd007225800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788843665.891526:0:15764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788843665.891529:0:15764:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd141b6bb80 x1875738134490496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788843676 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843665.891549:0:15764:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788843665.891553:0:15764:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000100:00100000:3.0:1788843665.891863:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1875738134490496:0@lo:38:kworker.0 00000100:00080000:0.0:1788843665.893001:0:15764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788843665.893013:0:15764:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd141b6aa00 x1875738134490624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843667 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843665.893033:0:15764:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd141b68a80 x1875738134490752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843668 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843665.893132:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134490624:0@lo:400:kworker.0 00000100:00100000:0.0:1788843665.893167:0:15764:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd141b68380 x1875738134490880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843672 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843665.893177:0:15764:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd141b68e00 x1875738134491136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843673 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843665.893185:0:15764:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd007768a80 x1875738134491264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843678 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843665.893191:0:15764:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788843665.893196:0:15764:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00010000:00010000:1.0:1788843665.893922:0:10329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843665.893932:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d1052 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d1059 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843665.893943:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947e00 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:1.0:1788843665.893948:0:10329:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d1052 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d1059 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843665.893959:0:10329:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d1052 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d1059 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788843665.893972:0:10329:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d1052 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d1059 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843665.893982:0:10329:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788843665.893985:0:10329:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788843665.893988:0:10329:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788843665.894002:0:10329:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bd12e00b000 00010000:00010000:1.0:1788843665.894006:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d1052 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa762dfcbd58d1059 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843665.894018:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d1052 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa762dfcbd58d1059 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843665.894046:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843665.894048:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843665.894049:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843665.894251:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1875738134490752:0@lo:400:kworker.0 00000100:00100000:2.0:1788843665.894344:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134491264:0@lo:400:kworker.0 00000100:00100000:2.0:1788843665.894353:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134491136:0@lo:400:kworker.0 00000100:00080000:0.0:1788843665.894930:0:15764:0:(import.c:65:import_set_state_nolock()) ffff9bd0075e9800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788843665.895083:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3629:1875738134491392:0@lo:39:umount.0 00000400:00000100:2.0:1788843665.895130:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875738134491392 offset 0 length 224: 4 00000100:00100000:2.0:1788843665.896517:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1875738134490880:0@lo:400:kworker.0 00010000:00010000:1.0:1788843666.586270:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843667.610374:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788843667.866426:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) e79d9884-ba2e-42e7-accb-b4784b9c1837->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788843667.866436:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) e79d9884-ba2e-42e7-accb-b4784b9c1837->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788843668.636327:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843669.658990:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843670.685854:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843671.706413:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843672.026288:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843657/real 1788843657] req@ffff9bd141b68000 x1875738134491008/t0(0) o250->MGC192.168.203.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788843672 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843672.026341:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd141b68000 x1875738134491008/t0(0) o250->MGC192.168.203.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788843672 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788843672.026360:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd12e00b000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788843672.026385:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788843672.026389:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e79d9884-ba2e-42e7-accb-b4784b9c1837:3629:1875738134491008:0@lo:250:kworker.0 00000100:00080000:1.0:1788843672.026734:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) e79d9884-ba2e-42e7-accb-b4784b9c1837->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788843672.026740:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788843672.026743:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bd12e00b000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788843672.026748:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.133@tcp: connect to NID 0@lo last attempt 435 00000100:00080000:1.0:1788843672.026753:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.133@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788843672.026758:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.133@tcp: import ffff9bd12e00b000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:1.0:1788843672.026788:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd00776b800 x1875738134491520/t0(0) o250->MGC192.168.203.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788843672.026864:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e79d9884-ba2e-42e7-accb-b4784b9c1837:3629:1875738134491520:0@lo:250:kworker.0 00000400:00000100:2.0:1788843672.026910:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875738134491520 offset 0 length 520: 4 00010000:00010000:1.0:1788843672.730339:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843673.754465:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843674.778455:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843675.098279:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843665/real 1788843665] req@ffff9bd0084e2a00 x1875738134491392/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788843675 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843675.098315:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd0084e2a00 x1875738134491392/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788843675 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788843675.098339:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd0075e9800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788843675.098364:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3629:1875738134491392:0@lo:39:umount.0 00000100:00080000:0.0:1788843675.099856:0:15764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788843675.099864:0:15764:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788843675.099870:0:15764:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788843675.100799:0:15764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35c00/0xa762dfcbd58d1060 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d1067 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843675.100817:0:15764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35c00/0xa762dfcbd58d1060 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d1067 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843675.100845:0:15764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35c00/0xa762dfcbd58d1060 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d1067 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843675.100853:0:15764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35c00/0xa762dfcbd58d1060 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d1067 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843675.100883:0:15764:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843675.100891:0:15764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5200/0xa762dfcbd58d12d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d12dd expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843675.100896:0:15764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5200/0xa762dfcbd58d12d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d12dd expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843675.100902:0:15764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5200/0xa762dfcbd58d12d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d12dd expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843675.100907:0:15764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5200/0xa762dfcbd58d12d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa762dfcbd58d12dd expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843675.100927:0:15764:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788843675.100931:0:15764:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788843675.100958:0:15764:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788843675.100963:0:15764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788843675.100967:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788843675.100972:0:15764:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788843675.100977:0:15764:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9bd13df30000) has no exports 00000020:00080000:0.0:1788843675.100997:0:15764:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9bd13df30000) has no exports 00010000:00010000:1.0:1788843675.101972:0:10328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788843675.101982:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35c00/0xa762dfcbd58d1060 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d1067 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843675.101991:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fb35c00 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:1.0:1788843675.101996:0:10328:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35c00/0xa762dfcbd58d1060 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d1067 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843675.102017:0:10328:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35c00/0xa762dfcbd58d1060 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d1067 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788843675.102024:0:10328:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35c00/0xa762dfcbd58d1060 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d1067 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843675.102031:0:10328:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788843675.102034:0:10328:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1788843675.102036:0:10328:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1788843675.102051:0:10328:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bd12e00b000 00010000:00010000:1.0:1788843675.102054:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35c00/0xa762dfcbd58d1060 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa762dfcbd58d1067 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843675.102061:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd13fb35c00/0xa762dfcbd58d1060 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa762dfcbd58d1067 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843675.102075:0:10328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843675.102079:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5200/0xa762dfcbd58d12d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d12dd expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843675.102084:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1420e5200 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:1.0:1788843675.102087:0:10328:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5200/0xa762dfcbd58d12d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa762dfcbd58d12dd expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843675.102094:0:10328:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5200/0xa762dfcbd58d12d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d12dd expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788843675.102101:0:10328:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5200/0xa762dfcbd58d12d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d12dd expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843675.102115:0:10328:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788843675.102117:0:10328:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788843675.102119:0:10328:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788843675.102124:0:10328:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bd12e00b000 00010000:00010000:1.0:1788843675.102127:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5200/0xa762dfcbd58d12d6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa762dfcbd58d12dd expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843675.102134:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd1420e5200/0xa762dfcbd58d12d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa762dfcbd58d12dd expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843675.102199:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843675.102201:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843675.102203:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843675.102366:0:6495:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788843675.109646:0:15764:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd11af2ea80 - data ffff9bd005c3b438/ffff9bd10fdfdc00 00000020:01000000:0.0:1788843675.109829:0:15764:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd11596eea0 - data ffff9bd131b030d8/ffff9bd0078f2c00 00100000:10000000:0.0:1788843675.119710:0:15764:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788843675.131899:0:15764:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0ee6 00000020:00000080:1.0:1788843675.131911:0:15764:0:(genops.c:885:class_export_put()) final put ffff9bd10f93a800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788843675.131966:0:15764:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd006461000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788843675.131970:0:15764:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd006461000 2 00000020:01000004:1.0:1788843675.131974:0:15764:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bd006461000 from lustre-OST0001 00000020:00000080:1.0:1788843675.131998:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788843675.132008:0:15764:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788843675.132011:0:15764:0:(genops.c:885:class_export_put()) final put ffff9bd10f938800/lustre-OST0001_UUID 00000020:00000080:1.0:1788843675.132014:0:15764:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd10f938800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788843675.132020:0:15764:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1788843675.132122:0:15764:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import e79d9884-ba2e-42e7-accb-b4784b9c1837->MGS 00010000:00010000:1.0:1788843675.132136:0:15764:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd1420e4400/0xa762dfcbd58d0c3f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d0c46 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788843675.132326:0:15764:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd1420e4400/0xa762dfcbd58d0c3f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d0c46 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843675.132346:0:15764:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788843675.132349:0:15764:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788843675.132352:0:15764:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788843675.132373:0:15764:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bd12e00b000 00010000:00010000:1.0:1788843675.132377:0:15764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd1420e4400/0xa762dfcbd58d0c3f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa762dfcbd58d0c46 expref: -99 pid: 7436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843675.132394:0:15764:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aee00/0xa762dfcbd58d10c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa762dfcbd58d10c9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788843675.132401:0:15764:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aee00/0xa762dfcbd58d10c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa762dfcbd58d10c9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843675.132406:0:15764:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788843675.132408:0:15764:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788843675.132410:0:15764:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788843675.132418:0:15764:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bd12e00b000 00010000:00010000:1.0:1788843675.132422:0:15764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd10f7aee00/0xa762dfcbd58d10c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa762dfcbd58d10c9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788843675.132437:0:15764:0:(import.c:65:import_set_state_nolock()) ffff9bd12e00b000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788843675.132441:0:15764:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788843675.132444:0:15764:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788843675.132445:0:15764:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788843675.132450:0:15764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788843675.132460:0:15764:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd00776b800 x1875738134491520/t0(0) o250->MGC192.168.203.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788843692 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788843675.132482:0:15764:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788843675.132485:0:15764:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:3.0:1788843675.132552:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e79d9884-ba2e-42e7-accb-b4784b9c1837:3629:1875738134491520:0@lo:250:kworker.0 10000000:01000000:1.0:1788843675.132944:0:15764:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788843675.132960:0:15764:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0b3c 00000020:00000080:1.0:1788843675.132966:0:15764:0:(genops.c:885:class_export_put()) final put ffff9bd10481c800/e79d9884-ba2e-42e7-accb-b4784b9c1837 00000020:00000080:2.0:1788843675.133729:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd10f93a800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788843675.136365:0:15764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.133@tcp (flags='') 00000020:00000080:1.0:1788843675.136381:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788843675.136390:0:15764:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.133@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788843675.136396:0:15764:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9bd13339b370) has no exports 10000000:01000000:1.0:1788843675.136424:0:6503:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788843675.136497:0:15764:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.133@tcp: client import never connected 00000100:00080000:1.0:1788843675.136502:0:15764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788843675.136507:0:15764:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788843675.136510:0:15764:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788843675.136513:0:15764:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788843675.138741:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd10481c800/e79d9884-ba2e-42e7-accb-b4784b9c1837 for MGC192.168.203.133@tcp 00000020:00000080:1.0:1788843675.141823:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788843675.141843:0:15764:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.133@tcp (uuid e79d9884-ba2e-42e7-accb-b4784b9c1837) 00000020:01000000:1.0:1788843675.141855:0:15764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788843675.141864:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788843675.141879:0:15764:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788843675.141889:0:15764:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9bd10f7bc000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788843675.141897:0:15764:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff9bd13e918000) has exports, disconnecting them 00000020:00080000:1.0:1788843675.141902:0:15764:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9bd10f7bc000), last request at 1788843430 00000020:00000080:1.0:1788843675.141906:0:15764:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0f10 00000020:00080000:1.0:1788843675.141925:0:15764:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd10f7bc000): rc 0 00000020:00000080:1.0:1788843675.141930:0:15764:0:(genops.c:885:class_export_put()) final put ffff9bd10f7bc000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788843675.145802:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd12e00b000 for MGC192.168.203.133@tcp 00000020:00000080:2.0:1788843675.145820:0:8:0:(genops.c:885:class_export_put()) final put ffff9bd12e00d800/e79d9884-ba2e-42e7-accb-b4784b9c1837 00000020:00000080:2.0:1788843675.145823:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd12e00d800/e79d9884-ba2e-42e7-accb-b4784b9c1837 for MGC192.168.203.133@tcp 00000020:01000000:2.0:1788843675.145831:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.133@tcp (e79d9884-ba2e-42e7-accb-b4784b9c1837) 00010000:01000000:2.0:1788843675.151224:0:15764:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788843675.151231:0:15764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788843675.151247:0:15764:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788843675.151255:0:15764:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788843675.152766:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd10f7bc000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788843675.155211:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788843675.155225:0:15764:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1788843675.155233:0:15764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788843675.155239:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788843675.155243:0:15764:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788843675.155251:0:15764:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9bd0075ed800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788843675.155258:0:15764:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff9bd13e91b370) has exports, disconnecting them 00000020:00080000:2.0:1788843675.155263:0:15764:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9bd0075ed800), last request at 1788843430 00000020:00000080:2.0:1788843675.155268:0:15764:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0f25 00000020:00080000:2.0:1788843675.155286:0:15764:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd0075ed800): rc 0 00000020:00000080:2.0:1788843675.155292:0:15764:0:(genops.c:885:class_export_put()) final put ffff9bd0075ed800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788843675.155957:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd007225800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788843675.155966:0:8:0:(genops.c:885:class_export_put()) final put ffff9bd007223000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788843675.155970:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd007223000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788843675.155976:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788843675.156084:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd0075ed800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1788843675.156110:0:15764:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788843675.156113:0:15764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788843675.156117:0:15764:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788843675.156121:0:15764:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788843675.156152:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd0075e9800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1788843675.231475:0:10329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1788843675.231880:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788843675.243687:0:10328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:2.0:1788843675.245746:0:6495:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:2.0:1788843675.246079:0:6490:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9bd13dfc0e00:6490] 1 exiting: rc = 0 00000100:00100000:1.0:1788843675.247424:0:6489:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9bd10336e000:6489] 0 exiting: rc = 1 00000100:00100000:3.0:1788843675.248897:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.249886:0:6492:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9bd1116bf600:6492] 1 exiting: rc = 0 00000100:00100000:2.0:1788843675.249894:0:7448:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9bd13e915200:7448] 3 exiting: rc = 0 00000100:00100000:3.0:1788843675.250069:0:6493:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9bd107c0f600:6493] 2 exiting: rc = 0 00000100:00100000:1.0:1788843675.250324:0:6491:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9bd106ba5800:6491] 0 exiting: rc = 1 00000100:00100000:2.0:1788843675.252941:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.252952:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.252958:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.252964:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.252969:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.252976:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253034:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253040:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253047:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253053:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253058:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253063:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253069:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253089:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253095:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253101:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253110:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253115:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253120:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253126:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253131:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253136:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253589:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253598:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253611:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253617:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253622:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253627:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253632:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253636:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253641:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253646:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253651:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253655:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253660:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253665:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253678:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253684:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253690:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253694:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253699:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253704:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253708:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253713:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253718:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253723:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253728:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253732:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253745:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253750:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253755:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253760:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253765:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253770:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253775:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253780:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253785:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253790:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253795:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253801:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253805:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253810:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253817:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843675.253823:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788843675.254948:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788843675.254959:0:15764:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1788843675.254964:0:15764:0:(genops.c:885:class_export_put()) final put ffff9bd0075ec000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1788843675.254968:0:15764:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd0075ec000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1788843675.254973:0:15764:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1788843675.255021:0:15764:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd006461000 1 00000020:00000080:2.0:1788843675.255026:0:15764:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa762dfcbd58d0eb5 00000020:00000080:2.0:1788843675.255032:0:15764:0:(genops.c:885:class_export_put()) final put ffff9bd13fbc3800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788843675.255047:0:15764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788843675.255051:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788843675.255055:0:15764:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788843675.255059:0:15764:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff9bd10fbb4d28) has no exports 00000020:00000080:3.0:1788843675.255250:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd13fbc3800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788843675.325036:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788843675.325055:0:15764:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788843675.325063:0:15764:0:(genops.c:885:class_export_put()) final put ffff9bd006465800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788843675.325069:0:15764:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd006465800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788843675.325076:0:15764:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788843675.326744:0:15764:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bd006463000 00000020:01000000:3.0:1788843675.326776:0:15764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788843675.326784:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788843675.326790:0:15764:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788843675.326795:0:15764:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9bd10fbb0000) has no exports 00000020:00000080:3.0:1788843675.326821:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788843675.326832:0:15764:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788843675.326836:0:15764:0:(genops.c:885:class_export_put()) final put ffff9bd1203e8800/OSS_uuid 00000020:00000080:3.0:1788843675.326840:0:15764:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd1203e8800/OSS_uuid for OSS 00000020:01000000:3.0:1788843675.326849:0:15764:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788843675.327011:0:8421:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9bd13f932400:8421] 0 exiting: rc = 1 00000100:00100000:1.0:1788843675.327091:0:8424:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9bd13f9e2c00:8424] 2 exiting: rc = 0 00000100:00100000:1.0:1788843675.327175:0:8423:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9bd13fa97800:8423] 1 exiting: rc = 0 00000100:00080000:2.0:1788843675.327439:0:6502:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788843675.328304:0:8901:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9bd0059b3600:8901] 3 exiting: rc = 0 00000100:00100000:3.0:1788843675.328377:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328385:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328390:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328396:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328504:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328511:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328516:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328523:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328528:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328533:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328538:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328543:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328548:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328553:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328569:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328575:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328580:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328585:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328589:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328594:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328600:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328605:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328610:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328615:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328620:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328624:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328629:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328634:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328638:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328643:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328648:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328652:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328657:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328663:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328668:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328683:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328689:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328694:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328699:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328704:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328709:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328714:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328719:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328723:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328728:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328733:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328737:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328742:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328747:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328760:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328765:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328770:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328775:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328781:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328787:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328791:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328797:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328803:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328809:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328815:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328819:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328825:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328830:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.328836:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.331934:0:8426:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9bd13e8b0c00:8426] 1 exiting: rc = 0 00000100:00100000:3.0:1788843675.333033:0:8425:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9bd137bcfc00:8425] 0 exiting: rc = 1 00000100:00100000:2.0:1788843675.333056:0:10088:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9bd00745c200:10088] 2 exiting: rc = 0 00000100:00100000:3.0:1788843675.333440:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333460:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333470:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333476:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333482:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333488:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333494:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333499:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333504:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333509:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333515:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333521:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333527:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333532:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333537:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333542:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333547:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333552:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333557:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333574:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333580:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333584:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333590:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333594:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333599:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333604:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333608:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333613:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333618:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333623:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333633:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333646:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333657:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333666:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333685:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333693:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333699:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333716:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333721:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333726:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333732:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333736:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333741:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333745:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333749:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333754:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333759:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333764:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333769:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333773:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333778:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333783:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333789:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333794:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333807:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333811:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333816:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333821:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333825:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333829:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333833:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333837:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333842:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843675.333851:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.337588:0:8427:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9bd13fae9800:8427] 0 exiting: rc = 1 00000100:00100000:3.0:1788843675.339656:0:8428:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9bd13fae9c00:8428] 1 exiting: rc = 0 00000100:00100000:3.0:1788843675.347717:0:8429:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9bd13fae8e00:8429] 2 exiting: rc = 0 00000100:00100000:1.0:1788843675.351319:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351405:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351413:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351418:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351423:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351427:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351433:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351438:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351442:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351449:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351455:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351460:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351465:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351469:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351475:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351480:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351486:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351491:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351496:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351501:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351507:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351512:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351518:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351524:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351530:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351549:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351556:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351563:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351568:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351573:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351578:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351582:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351588:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351593:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351614:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351620:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351625:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351631:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351637:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351642:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351648:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351654:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351660:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351668:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351686:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351693:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351698:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351703:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351708:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351728:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351735:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351740:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351745:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351751:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351757:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351763:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351769:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351775:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351781:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351787:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351793:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351798:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351804:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843675.351809:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373354:0:8430:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9bd13fa98400:8430] 0 exiting: rc = 1 00000100:00100000:0.0:1788843675.373460:0:8431:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9bd13fa98c00:8431] 1 exiting: rc = 0 00000100:00100000:0.0:1788843675.373520:0:9766:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_002: service thread [ffff9bd007246600:9766] 2 exiting: rc = 0 00000100:00100000:0.0:1788843675.373578:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373586:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373592:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373597:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373603:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373614:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373622:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373627:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373631:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373636:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373641:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373647:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373651:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373657:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373662:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373668:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373683:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373688:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373694:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373716:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373722:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373727:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373735:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373740:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373746:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373751:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373756:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373762:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373783:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373788:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373794:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373800:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373806:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373812:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373818:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373823:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373829:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373835:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373841:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373846:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373850:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373855:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373860:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373866:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373871:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373876:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373882:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373887:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373892:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373896:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373901:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373907:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373912:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373918:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373929:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373937:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373952:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373958:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373964:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373969:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373974:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373979:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.373984:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.374000:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.374823:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9bd0018ad000:8433] 1 exiting: rc = 0 00000100:00100000:0.0:1788843675.374919:0:8432:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9bd0018ace00:8432] 0 exiting: rc = 1 00000100:00100000:0.0:1788843675.374974:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.374983:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.374989:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.374994:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375000:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375016:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375022:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375028:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375034:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375040:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375046:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375051:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375057:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375064:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375070:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375077:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375083:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375103:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375110:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375117:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375122:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375128:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375133:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375163:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375170:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375176:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375182:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375189:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375195:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375214:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375221:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375227:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375242:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375248:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375253:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375260:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375266:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375272:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375278:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375284:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375290:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375308:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375315:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375321:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375328:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375334:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375340:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375347:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375353:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375359:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375365:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375371:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375377:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375395:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375403:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375410:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375416:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375423:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375428:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375434:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375440:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375446:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375452:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843675.375465:0:15764:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788843675.405239:0:15764:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788843697.122855:0:16529:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg333-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788843707.588613:0:17129:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788843707.588624:0:17129:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788843707.588626:0:17129:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788843707.590284:0:17129:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bd137acd000 00000020:01000004:3.0:1788843707.590330:0:17129:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788843707.590341:0:17129:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788843707.590460:0:17129:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9bd0078b99b8) 00000020:00000080:3.0:1788843707.590482:0:17129:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788843707.661884:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788843707.664562:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788843707.666623:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1788843707.666904:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1788843707.667278:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1788843707.667543:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1788843707.667764:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1788843707.668069:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788843707.668377:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788843707.668644:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1788843707.668898:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1788843707.669088:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788843707.669916:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788843707.670253:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1788843707.670503:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788843707.670698:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1788843707.670977:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788843707.671285:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1788843707.671531:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1788843707.672177:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1788843707.672499:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788843707.672737:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1788843707.673000:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788843707.673292:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788843707.673486:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788843707.673713:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1788843707.673957:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788843707.674217:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788843707.674429:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788843707.674655:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788843707.674881:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788843707.675048:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788843707.675433:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1788843707.676400:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1788843707.676940:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788843707.677568:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1788843707.677861:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1788843707.678103:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1788843707.678493:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1788843707.678687:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788843707.682919:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788843707.683209:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1788843707.683463:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788843707.683841:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1788843707.684085:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788843707.684479:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788843707.686084:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1788843707.688991:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1788843707.689407:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1788843707.689673:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1788843707.690412:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1788843707.690620:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1788843707.690806:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:1.0:1788843707.691923:0:17129:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788843707.692435:0:17129:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788843707.692445:0:17129:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788843707.692831:0:17129:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa762dfcbd58d20f9 00000020:01000004:0.0:1788843707.692843:0:17129:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788843707.692850:0:17129:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788843707.692856:0:17129:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bd137acd000 from MGS 00000020:01000004:0.0:1788843707.692860:0:17129:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788843707.692873:0:17129:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9bd13e9199b8) 00000020:00000080:0.0:1788843707.692884:0:17129:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788843707.692966:0:17129:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd137acd000 from MGS, refs=2 00080000:01000000:0.0:1788843707.692973:0:17129:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788843707.692979:0:17129:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa762dfcbd58d2107 00000100:00100000:0.0:1788843707.693133:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788843707.693386:0:17129:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788843707.693393:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788843707.694011:0:17129:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788843707.694022:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788843707.696874:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788843707.697299:0:17129:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788843707.697306:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788843707.698044:0:17129:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788843707.698052:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788843707.698891:0:17129:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788843707.698900:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788843707.699901:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843707.699906:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843707.699908:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843707.700695:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843707.700699:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843707.700701:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843707.701360:0:17129:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788843707.711270:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788843707.713781:0:17129:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788843707.715946:0:17141:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788843707.716073:0:17129:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788843707.716806:0:17129:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788843707.718491:0:17129:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788843707.719468:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788843707.720502:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788843707.720511:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788843707.724863:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788843707.724879:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788843707.727034:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788843707.727044:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788843707.727793:0:17129:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788843707.727811:0:17129:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.133@tcp' 00000020:01000004:2.0:1788843707.727813:0:17129:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788843707.727840:0:17129:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.133@tcp (typ=mgc) 00000020:00000080:2.0:1788843707.727852:0:17129:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.133@tcp (ffff9bd10fbb0000) 00000020:00000080:2.0:1788843707.727866:0:17129:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788843707.728115:0:17129:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd008551800@MGC192.168.203.133@tcp: add connection 192.168.203.133@tcp at head 00010000:00010000:2.0:1788843707.728343:0:17129:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.133@tcp-0 is initialized 00000040:01000000:2.0:1788843707.728349:0:17129:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.133@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788843707.728668:0:17146:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788843707.731381:0:17147:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788843707.731938:0:17129:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.133@tcp (uuid 20b96c6c-8494-483a-b913-89dfc06b1440) 00000020:00000080:3.0:1788843707.731963:0:17129:0:(genops.c:1385:class_connect()) connect: client 20b96c6c-8494-483a-b913-89dfc06b1440, cookie 0xa762dfcbd58d2115 00000100:00080000:3.0:1788843707.731977:0:17129:0:(import.c:510:import_select_connection()) MGC192.168.203.133@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788843707.731984:0:17129:0:(import.c:624:import_select_connection()) MGC192.168.203.133@tcp: import ffff9bd008551800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:3.0:1788843707.733070:0:17129:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd141b6b480 x1875738134491648/t0(0) o250->MGC192.168.203.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788843707.733220:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:20b96c6c-8494-483a-b913-89dfc06b1440:3629:1875738134491648:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788843707.733301:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843707.734286:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134491648 00000100:00100000:3.0:1788843707.734299:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134491648 00000100:00100000:3.0:1788843707.734350:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788843707.734358:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007745450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3629:x1875738134491648:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788843707.734387:0:17142:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 20b96c6c-8494-483a-b913-89dfc06b1440@0@lo t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:3.0:1788843707.734415:0:17142:0:(genops.c:1385:class_connect()) connect: client 20b96c6c-8494-483a-b913-89dfc06b1440, cookie 0xa762dfcbd58d211c 00000100:00080000:2.0:1788843707.735320:0:17129:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 20b96c6c-8494-483a-b913-89dfc06b1440->MGS 00000020:01000004:2.0:1788843707.735347:0:17129:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788843707.735385:0:17129:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788843707.735402:0:17129:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9bd10fbb4d28) 00000020:00000080:2.0:1788843707.735418:0:17129:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:3.0:1788843707.735725:0:17142:0:(import.c:65:import_set_state_nolock()) ffff9bd13fac2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788843707.735817:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007745450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+5:3629:x1875738134491648:12345-0@lo:250:mount.lustre.0 Request processed in 1457us (2516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843707.735827:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788843707.737628:0:3629:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.133@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788843707.737647:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.133@tcp: connect to target with instance 0 00000100:00080000:3.0:1788843707.737657:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.133@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788843707.737662:0:3629:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788843707.737667:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd008551800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788843707.737670:0:3629:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788843707.737686:0:3629:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788843707.737694:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:20b96c6c-8494-483a-b913-89dfc06b1440:3629:1875738134491648:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788843707.745426:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788843707.747392:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788843707.747400:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788843707.753676:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788843707.753690:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788843707.757000:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788843707.757012:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788843707.758115:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788843707.758443:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788843707.758448:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788843707.762418:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788843707.762440:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788843707.836030:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788843707.836479:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788843707.836486:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788843707.843232:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788843707.843248:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788843707.847540:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788843707.847907:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788843707.847916:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788843707.848643:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788843707.848654:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788843707.850590:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788843707.850810:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788843707.850817:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788843707.851497:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788843707.851505:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788843707.852079:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788843707.852286:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788843707.852291:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788843707.853046:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788843707.853053:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788843707.887363:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788843707.887621:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788843707.887628:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788843707.892550:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788843707.892566:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788843707.895843:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788843707.895858:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788843707.913264:0:17129:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788843707.917339:0:17129:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788843707.917350:0:17129:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.133@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788843707.917475:0:17129:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.133@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788843707.917528:0:17129:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.133@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788843707.917533:0:17129:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788843707.917535:0:17129:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788843707.917541:0:17129:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788843707.917542:0:17129:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788843707.917543:0:17129:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788843707.917544:0:17129:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788843707.917545:0:17129:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788843707.917547:0:17129:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788843707.917548:0:17129:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788843707.917549:0:17129:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788843707.917552:0:17129:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788843707.917554:0:17129:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788843707.917555:0:17129:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788843707.917556:0:17129:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788843707.917557:0:17129:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788843707.917558:0:17129:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788843707.917559:0:17129:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788843707.917560:0:17129:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788843707.917561:0:17129:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788843707.917562:0:17129:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788843707.917563:0:17129:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788843707.917594:0:17129:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788843707.917617:0:17129:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007769180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17129:1875738134491776:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788843707.917696:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843707.917868:0:17129:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1102fc480 going to sleep for 11 seconds 00000100:00100000:3.0:1788843707.923684:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134491776 00000100:00100000:3.0:1788843707.923811:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134491776 00000100:00100000:3.0:1788843707.923892:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788843707.923904:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007746850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+5:17129:x1875738134491776:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788843707.923966:0:17145:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788843707.923970:0:17145:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788843707.923973:0:17145:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788843707.930912:0:17165:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788843707.931627:0:17145:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:3.0:1788843707.937029:0:17166:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788843707.937037:0:17166:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1788843707.937040:0:17166:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788843707.937043:0:17166:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788843707.937511:0:17166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1788843707.938111:0:17145:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788843707.938129:0:17145:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788843707.941014:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007746850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+5:17129:x1875738134491776:12345-0@lo:253:mount.lustre.0 Request processed in 17102us (23308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843707.941034:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788843707.941430:0:17129:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007769180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17129:1875738134491776:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788843707.941984:0:17129:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788843707.941988:0:17129:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788843707.941990:0:17129:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788843707.941992:0:17129:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843707.941993:0:17129:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843707.941994:0:17129:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843707.941996:0:17129:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843707.941997:0:17129:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788843707.941999:0:17129:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788843707.942000:0:17129:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843707.942002:0:17129:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788843707.942023:0:17129:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bd137acd000 from lustre-MDT0000 10000000:01000000:2.0:1788843707.942505:0:17129:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788843707.942510:0:17129:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788843707.942521:0:17129:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9bd10fbb0000 10000000:01000000:2.0:1788843707.942526:0:17129:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788843707.942535:0:17129:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9bd10fbb0000 from 1 10000000:01000000:2.0:1788843707.942538:0:17129:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788843707.942583:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d212a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843707.942594:0:17129:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d212a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843707.942604:0:17129:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d212a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843707.942629:0:17129:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17129:1875738134491904:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788843707.942689:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843707.942823:0:17129:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd105a650c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843707.942970:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134491904 00000100:00100000:3.0:1788843707.942978:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134491904 00000100:00100000:3.0:1788843707.943066:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788843707.943085:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007745c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+5:17129:x1875738134491904:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788843707.943098:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843707.943113:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007be3200/0xa762dfcbd58d2131 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d212a expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843707.943170:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007be3200/0xa762dfcbd58d2131 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d212a expref: 6 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843707.943181:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007be3200/0xa762dfcbd58d2131 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d212a expref: 6 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843707.943212:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be3200, rc 0) 00000100:00100000:3.0:1788843707.943259:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007745c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+6:17129:x1875738134491904:12345-0@lo:101:mount.lustre.0 Request processed in 176us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843707.943266:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788843707.943333:0:17129:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17129:1875738134491904:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843707.943348:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d212a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2131 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843707.943357:0:17129:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d212a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2131 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843707.943408:0:17129:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17129:1875738134492032:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843707.943446:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843707.943862:0:17129:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd105a650c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843707.943920:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134492032 00000100:00100000:0.0:1788843707.943925:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134492032 00000100:00100000:0.0:1788843707.943960:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788843707.943975:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007745850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+6:17129:x1875738134492032:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788843707.944625:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007745850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+6:17129:x1875738134492032:12345-0@lo:501:mount.lustre.0 Request processed in 649us (1188us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788843707.944634:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788843707.944749:0:17129:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17129:1875738134492032:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788843707.944781:0:17129:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788843707.944809:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d212a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2131 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843707.944818:0:17129:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d212a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2131 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843707.944827:0:17129:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bd137acd000 10000000:01000000:2.0:1788843707.944830:0:17129:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788843707.944835:0:17129:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9bd137acd000 10000000:01000000:2.0:1788843707.944837:0:17129:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788843707.944839:0:17129:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9bd137acd000 from 1 10000000:01000000:2.0:1788843707.944841:0:17129:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788843707.944867:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007947800/0xa762dfcbd58d2138 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843707.944875:0:17129:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd007947800/0xa762dfcbd58d2138 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843707.944883:0:17129:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd007947800/0xa762dfcbd58d2138 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843707.944898:0:17129:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17129:1875738134492160:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788843707.944930:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843707.944959:0:17129:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd105a650c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843707.944965:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134492160 00000100:00100000:0.0:1788843707.944970:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134492160 00000100:00100000:0.0:1788843707.945000:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788843707.945007:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007747c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+6:17129:x1875738134492160:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788843707.945015:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843707.945028:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd10fa3d600/0xa762dfcbd58d213f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2138 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843707.945045:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd10fa3d600/0xa762dfcbd58d213f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2138 expref: 7 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843707.945054:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd10fa3d600/0xa762dfcbd58d213f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2138 expref: 7 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843707.945061:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3d600, rc 0) 00000100:00100000:0.0:1788843707.945098:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007747c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+7:17129:x1875738134492160:12345-0@lo:101:mount.lustre.0 Request processed in 91us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843707.945104:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788843707.945181:0:17129:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17129:1875738134492160:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843707.945192:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd007947800/0xa762dfcbd58d2138 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d213f expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843707.945199:0:17129:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd007947800/0xa762dfcbd58d2138 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d213f expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843707.945218:0:17129:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788843707.945232:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007947800/0xa762dfcbd58d2138 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d213f expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843707.945239:0:17129:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007947800/0xa762dfcbd58d2138 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d213f expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843707.945245:0:17129:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788843707.945249:0:17129:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788843707.945253:0:17129:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9bd137acd000 10000000:01000000:2.0:1788843707.945256:0:17129:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788843707.945259:0:17129:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788843707.945261:0:17129:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788843707.945275:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946400/0xa762dfcbd58d2146 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843707.945283:0:17129:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd007946400/0xa762dfcbd58d2146 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843707.945290:0:17129:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd007946400/0xa762dfcbd58d2146 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843707.945302:0:17129:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17129:1875738134492288:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788843707.945327:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843707.945343:0:17129:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd105a650c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843707.945399:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134492288 00000100:00100000:0.0:1788843707.945404:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134492288 00000100:00100000:0.0:1788843707.945422:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788843707.945428:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007747450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+7:17129:x1875738134492288:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788843707.945446:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843707.945461:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd10fa3de00/0xa762dfcbd58d214d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2146 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843707.945482:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd10fa3de00/0xa762dfcbd58d214d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2146 expref: 8 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843707.945490:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd10fa3de00/0xa762dfcbd58d214d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2146 expref: 8 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843707.945496:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3de00, rc 0) 00000100:00100000:0.0:1788843707.945532:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007747450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+8:17129:x1875738134492288:12345-0@lo:101:mount.lustre.0 Request processed in 104us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843707.945538:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788843707.946069:0:17129:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17129:1875738134492288:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843707.946084:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd007946400/0xa762dfcbd58d2146 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d214d expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843707.946102:0:17129:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd007946400/0xa762dfcbd58d2146 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d214d expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843707.946196:0:17129:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17129:1875738134492416:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843707.946229:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843707.946242:0:17129:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd105a650c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843707.946322:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134492416 00000100:00100000:0.0:1788843707.946327:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134492416 00000100:00100000:0.0:1788843707.946350:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788843707.946356:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007744c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+8:17129:x1875738134492416:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788843707.946554:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007744c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+9:17129:x1875738134492416:12345-0@lo:501:mount.lustre.0 Request processed in 198us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843707.946562:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788843707.946637:0:17129:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17129:1875738134492416:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843707.946677:0:17129:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17129:1875738134492544:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788843707.946726:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843707.946753:0:17129:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd105a650c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843707.946832:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134492544 00000100:00100000:1.0:1788843707.946838:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134492544 00000100:00100000:1.0:1788843707.946885:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788843707.946895:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007745050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+9:17129:x1875738134492544:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788843707.948593:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007745050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+9:17129:x1875738134492544:12345-0@lo:503:mount.lustre.0 Request processed in 1693us (1859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843707.948618:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788843707.948838:0:17129:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17129:1875738134492544:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788843707.949516:0:17167:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fbbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20b96c6c-8494-483a-b913-89dfc06b1440:17167:1875738134492672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843707.949567:0:17167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843707.949606:0:17167:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0077220c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843707.949656:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134492672 00000100:00100000:0.0:1788843707.949664:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134492672 00000100:00100000:0.0:1788843707.949716:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788843707.949725:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007747850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+9:17167:x1875738134492672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843707.952055:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007747850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+9:17167:x1875738134492672:12345-0@lo:502:llog_process_th.0 Request processed in 2323us (2479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843707.952069:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788843707.952536:0:17167:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fbbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20b96c6c-8494-483a-b913-89dfc06b1440:17167:1875738134492672:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788843707.952576:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788843707.952587:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843707.952590:0:17167:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788843707.952594:0:17167:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788843707.952597:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788843707.952612:0:17167:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9bd10fbb19b8) 00000020:00000080:2.0:1788843707.952630:0:17167:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788843707.952635:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788843707.952794:0:17167:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788843707.952803:0:17167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa762dfcbd58d215b 00000020:00000080:2.0:1788843707.953016:0:17167:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788843707.953021:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843707.953024:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843707.953025:0:17167:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788843707.953028:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788843707.953031:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843707.953033:0:17167:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788843707.953036:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788843707.953043:0:17167:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9bd10fbb3370) 00000020:00000080:2.0:1788843707.953051:0:17167:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788843707.953054:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788843707.953056:0:17167:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788843707.953059:0:17167:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788843707.953064:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788843707.953099:0:17167:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd137acd000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788843707.953124:0:17167:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9bd13339b370) 00000020:00000080:2.0:1788843707.953132:0:17167:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788843707.954880:0:17167:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788843707.954891:0:17167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa762dfcbd58d2170 00000020:00000080:2.0:1788843707.955006:0:17167:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788843707.955012:0:17167:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788843707.955015:0:17167:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa762dfcbd58d2177 00080000:01000000:2.0:1788843707.955020:0:17167:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788843707.955023:0:17167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa762dfcbd58d217e 00010000:00010000:2.0:1788843708.065058:0:17167:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788843708.069783:0:17167:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:2.0:1788843708.070323:0:17167:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788843708.070798:0:17167:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9bd1333999b8) 00000020:00000080:2.0:1788843708.070819:0:17167:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788843708.070899:0:17167:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788843708.070907:0:17167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa762dfcbd58d218c 00000020:00000080:2.0:1788843708.071659:0:17167:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788843708.084392:0:17167:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa762dfcbd58d2193 00000020:00000080:1.0:1788843708.087041:0:17167:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788843708.087056:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843708.087063:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843708.087065:0:17167:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788843708.087068:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788843708.087372:0:17167:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1788843708.087375:0:17167:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788843708.087377:0:17167:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788843708.087379:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788843708.087383:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843708.087386:0:17167:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788843708.087389:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843708.087394:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843708.087396:0:17167:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788843708.087401:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788843708.087465:0:17167:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788843708.087484:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843708.087487:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843708.087488:0:17167:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788843708.087490:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843708.087493:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843708.087494:0:17167:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788843708.087497:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788843708.087502:0:17167:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.133@tcp to nid 0x20000c0a8cb85 (192.168.203.133@tcp) 00000020:00000080:1.0:1788843708.087531:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788843708.087548:0:17167:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9bd13eb119b8) 00000020:00000080:1.0:1788843708.087567:0:17167:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788843708.087572:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788843708.087631:0:17167:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788843708.087637:0:17167:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788843708.087653:0:17167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa762dfcbd58d21a1 00010000:00080000:1.0:1788843708.087700:0:17167:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd12e2ab000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.133@tcp at head 00010000:00010000:1.0:1788843708.091952:0:17167:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1788843708.093627:0:17167:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788843708.093648:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788843708.093688:0:17167:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788843708.093711:0:17167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa762dfcbd58d21a8 00000100:00080000:2.0:1788843708.093723:0:17167:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788843708.093729:0:17167:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9bd12e2ab000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:2.0:1788843708.093774:0:17167:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd102fbbb80 x1875738134492800/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788843708.093806:0:17167:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1788843708.093866:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843708.093870:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843708.093872:0:17167:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788843708.093875:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788843708.093878:0:17167:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1788843708.093880:0:17167:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788843708.093881:0:17167:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788843708.093883:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788843708.093885:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843708.093886:0:17167:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788843708.093888:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788843708.093893:0:17167:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788843708.093896:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843708.093897:0:17167:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788843708.093900:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788843708.093903:0:17167:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.133@tcp to nid 0x20000c0a8cb85 (192.168.203.133@tcp) 00000020:01000000:2.0:1788843708.093925:0:17167:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788843708.093928:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788843708.093940:0:17167:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9bd13339cd28) 00000020:00000080:2.0:1788843708.093951:0:17167:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788843708.093955:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788843708.094018:0:17167:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788843708.094023:0:17167:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788843708.094035:0:17167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa762dfcbd58d21b6 00010000:00080000:2.0:1788843708.094064:0:17167:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd118910000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.133@tcp at head 00000100:00100000:3.0:1788843708.094299:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134492800:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788843708.094374:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843708.094485:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134492800 00000100:00100000:1.0:1788843708.094493:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134492800 00000100:00100000:1.0:1788843708.094528:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788843708.094537:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3629:x1875738134492800:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1788843708.094552:0:17154:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00010000:2.0:1788843708.096418:0:17167:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788843708.107044:0:17167:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788843708.107300:0:17167:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788843708.108697:0:17167:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788843708.109308:0:17167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788843708.117624:0:17167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788843708.118479:0:17173:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788843708.118484:0:17173:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788843708.119599:0:17167:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788843708.119612:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788843708.119655:0:17167:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788843708.119676:0:17167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa762dfcbd58d21bd 00000100:00080000:0.0:1788843708.119688:0:17167:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788843708.119694:0:17167:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bd118910000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:0.0:1788843708.119749:0:17167:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd0084e1180 x1875738134492928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788843708.119768:0:17167:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788843708.119847:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843708.119852:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843708.119854:0:17167:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788843708.119857:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788843708.119860:0:17167:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1788843708.119862:0:17167:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788843708.119864:0:17167:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788843708.119865:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788843708.119868:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843708.119869:0:17167:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788843708.119871:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788843708.119876:0:17167:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788843708.119879:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843708.119881:0:17167:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788843708.119884:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788843708.119887:0:17167:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.133@tcp to nid 0x20000c0a8cb85 (192.168.203.133@tcp) 00000020:01000000:0.0:1788843708.119912:0:17167:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788843708.119914:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788843708.119928:0:17167:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9bd13e91b370) 00000020:00000080:0.0:1788843708.119940:0:17167:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1788843708.119945:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788843708.120012:0:17167:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788843708.120018:0:17167:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:0.0:1788843708.120024:0:17167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa762dfcbd58d21cb 00010000:00080000:0.0:1788843708.120058:0:17167:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd13e8a4000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.133@tcp at head 00010000:00010000:0.0:1788843708.120289:0:17167:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1788843708.120358:0:17167:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788843708.120374:0:17167:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1788843708.120575:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134492928:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788843708.120689:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875738134492928 offset 0 length 520: 4 00000100:00100000:0.0:1788843708.126266:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3629:x1875738134492800:12345-0@lo:38:llog_process_th.0 Request processed in 31722us (31885us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788843708.126304:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788843708.126510:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd12e2ab000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788843708.126517:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788843708.126522:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134492800:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788843708.130568:0:17167:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788843708.133397:0:17167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788843708.133643:0:17167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788843708.137286:0:17175:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788843708.137295:0:17175:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788843708.139594:0:17167:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788843708.139607:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788843708.139646:0:17167:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788843708.139668:0:17167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa762dfcbd58d21d2 00000100:00080000:3.0:1788843708.139680:0:17167:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788843708.139686:0:17167:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bd13e8a4000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:3.0:1788843708.139729:0:17167:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd141b68a80 x1875738134493056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788843708.139793:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134493056:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788843708.139851:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875738134493056 offset 0 length 520: 4 00000100:00080000:3.0:1788843708.139908:0:17167:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788843708.140006:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843708.140011:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843708.140022:0:17167:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788843708.140026:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788843708.140030:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843708.140031:0:17167:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788843708.140034:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788843708.140036:0:17167:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788843708.140038:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843708.140040:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843708.140042:0:17167:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788843708.140045:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788843708.140047:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843708.140048:0:17167:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788843708.140052:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788843708.140090:0:17167:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20b96c6c-8494-483a-b913-89dfc06b1440:17167:1875738134493184:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843708.140181:0:17167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843708.140214:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134493184 00000100:00100000:3.0:1788843708.140221:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134493184 00000100:00100000:3.0:1788843708.140263:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788843708.140272:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007746050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+9:17167:x1875738134493184:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843708.140387:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007746050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+9:17167:x1875738134493184:12345-0@lo:502:llog_process_th.0 Request processed in 115us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843708.140394:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788843708.140444:0:17167:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1333523c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843708.140477:0:17167:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20b96c6c-8494-483a-b913-89dfc06b1440:17167:1875738134493184:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788843708.140501:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843708.140505:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843708.140507:0:17167:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788843708.140511:0:17167:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788843708.140985:0:17129:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1788843708.141007:0:17129:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788843708.141065:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946400/0xa762dfcbd58d2146 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d214d expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843708.141086:0:17129:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007946400/0xa762dfcbd58d2146 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d214d expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843708.141095:0:17129:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd137acd000 from 1 10000000:01000000:1.0:1788843708.141098:0:17129:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788843708.141167:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fbea000/0xa762dfcbd58d21d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843708.141177:0:17129:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd13fbea000/0xa762dfcbd58d21d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843708.141187:0:17129:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd13fbea000/0xa762dfcbd58d21d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843708.141212:0:17129:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17129:1875738134493312:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788843708.141249:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843708.141275:0:17129:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12047f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843708.141434:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134493312 00000100:00100000:2.0:1788843708.141441:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134493312 00000100:00100000:2.0:1788843708.141485:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788843708.141493:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+9:17129:x1875738134493312:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843708.141503:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843708.141518:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d21e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d21d9 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843708.141540:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d21e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d21d9 expref: 10 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843708.141551:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d21e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d21d9 expref: 10 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843708.141560:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007946a00, rc 0) 00000100:00100000:2.0:1788843708.141603:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+10:17129:x1875738134493312:12345-0@lo:101:mount.lustre.0 Request processed in 111us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843708.141609:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788843708.141804:0:17129:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17129:1875738134493312:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788843708.141818:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd13fbea000/0xa762dfcbd58d21d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d21e0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843708.141826:0:17129:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd13fbea000/0xa762dfcbd58d21d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d21e0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843708.142425:0:17129:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17129:1875738134493440:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788843708.142486:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843708.142513:0:17129:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12047f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843708.142580:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134493440 00000100:00100000:2.0:1788843708.142587:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134493440 00000100:00100000:2.0:1788843708.142617:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788843708.142623:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+10:17129:x1875738134493440:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788843708.142637:0:17142:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788843708.142643:0:17142:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788843708.142715:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+10:17129:x1875738134493440:12345-0@lo:256:mount.lustre.0 Request processed in 91us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843708.142721:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788843708.142846:0:17129:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17129:1875738134493440:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788843708.143521:0:17129:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788843708.143790:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fbea000/0xa762dfcbd58d21d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d21e0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843708.143803:0:17129:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd13fbea000/0xa762dfcbd58d21d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d21e0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843708.143811:0:17129:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd137acd000 from 1 10000000:01000000:1.0:1788843708.143813:0:17129:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788843708.143844:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fbebc00/0xa762dfcbd58d21e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843708.143862:0:17129:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd13fbebc00/0xa762dfcbd58d21e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843708.143871:0:17129:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd13fbebc00/0xa762dfcbd58d21e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843708.143886:0:17129:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17129:1875738134493568:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788843708.143925:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843708.143955:0:17129:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12047f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843708.144012:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134493568 00000100:00100000:2.0:1788843708.144018:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134493568 00000100:00100000:2.0:1788843708.144060:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788843708.144068:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+10:17129:x1875738134493568:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843708.144079:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843708.144092:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007946c00/0xa762dfcbd58d21ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d21e7 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843708.144126:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007946c00/0xa762dfcbd58d21ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d21e7 expref: 11 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843708.144137:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007946c00/0xa762dfcbd58d21ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d21e7 expref: 11 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843708.144175:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007946c00, rc 0) 00000100:00100000:2.0:1788843708.144209:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+11:17129:x1875738134493568:12345-0@lo:101:mount.lustre.0 Request processed in 141us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843708.144215:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788843708.144378:0:17129:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17129:1875738134493568:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788843708.144391:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd13fbebc00/0xa762dfcbd58d21e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d21ee expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843708.144399:0:17129:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd13fbebc00/0xa762dfcbd58d21e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d21ee expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843708.144464:0:17129:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17129:1875738134493696:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788843708.144489:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843708.144513:0:17129:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12047f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843708.144555:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134493696 00000100:00100000:3.0:1788843708.144560:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134493696 00000100:00100000:3.0:1788843708.144598:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788843708.144606:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+11:17129:x1875738134493696:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843708.144734:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+11:17129:x1875738134493696:12345-0@lo:501:mount.lustre.0 Request processed in 128us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843708.144740:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788843708.144808:0:17129:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17129:1875738134493696:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788843708.144834:0:17129:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17129:1875738134493824:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788843708.144873:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843708.144893:0:17129:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12047f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843708.144934:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134493824 00000100:00100000:3.0:1788843708.144938:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134493824 00000100:00100000:3.0:1788843708.144966:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788843708.144973:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+11:17129:x1875738134493824:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788843708.145045:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+11:17129:x1875738134493824:12345-0@lo:503:mount.lustre.0 Request processed in 73us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843708.145051:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788843708.145132:0:17129:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17129:1875738134493824:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788843708.145584:0:17177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20b96c6c-8494-483a-b913-89dfc06b1440:17177:1875738134493952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843708.145623:0:17177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843708.145654:0:17177:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12047f480 going to sleep for 11 seconds 00000100:00100000:3.0:1788843708.145699:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134493952 00000100:00100000:3.0:1788843708.145704:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134493952 00000100:00100000:3.0:1788843708.145736:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788843708.145743:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+11:17177:x1875738134493952:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843708.146466:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+11:17177:x1875738134493952:12345-0@lo:502:llog_process_th.0 Request processed in 722us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843708.146475:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788843708.146558:0:17177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20b96c6c-8494-483a-b913-89dfc06b1440:17177:1875738134493952:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788843708.146584:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843708.146592:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843708.146595:0:17177:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788843708.146601:0:17177:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd137acd000 00000020:00000080:1.0:1788843708.146603:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788843708.146610:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843708.146613:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843708.146614:0:17177:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788843708.146617:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843708.146619:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843708.146620:0:17177:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788843708.146623:0:17177:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd137acd000 00000020:00000080:1.0:1788843708.146625:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788843708.146676:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843708.146678:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843708.146680:0:17177:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788843708.146682:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843708.146684:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843708.146685:0:17177:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788843708.146688:0:17177:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd137acd000 00000020:00000080:1.0:1788843708.146691:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788843708.146705:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843708.146707:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843708.146709:0:17177:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788843708.146711:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843708.146713:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843708.146714:0:17177:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788843708.146718:0:17177:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd137acd000 00000020:00000080:1.0:1788843708.146719:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788843708.146759:0:17177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20b96c6c-8494-483a-b913-89dfc06b1440:17177:1875738134494080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843708.146792:0:17177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843708.146823:0:17177:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12047f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788843708.146885:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134494080 00000100:00100000:2.0:1788843708.146890:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134494080 00000100:00100000:2.0:1788843708.146928:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788843708.146936:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+11:17177:x1875738134494080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843708.147019:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+11:17177:x1875738134494080:12345-0@lo:502:llog_process_th.0 Request processed in 84us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843708.147026:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788843708.147106:0:17177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20b96c6c-8494-483a-b913-89dfc06b1440:17177:1875738134494080:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788843708.147134:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843708.147169:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843708.147171:0:17177:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788843708.147175:0:17177:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788843708.147427:0:17129:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788843708.147446:0:17129:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788843708.154157:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fbebc00/0xa762dfcbd58d21e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d21ee expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843708.154175:0:17129:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd13fbebc00/0xa762dfcbd58d21e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d21ee expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843708.154249:0:17129:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788843708.154253:0:17129:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bd137acd000 10000000:01000000:2.0:1788843708.154256:0:17129:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bd137acd000 10000000:01000000:2.0:1788843708.154261:0:17129:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788843708.154266:0:17129:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd137acd000 from 1 10000000:01000000:2.0:1788843708.154269:0:17129:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788843708.154313:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007947000/0xa762dfcbd58d21f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843708.154322:0:17129:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd007947000/0xa762dfcbd58d21f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843708.154333:0:17129:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd007947000/0xa762dfcbd58d21f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843708.154359:0:17129:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fbaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17129:1875738134494208:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788843708.154431:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843708.154496:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134494208 00000100:00100000:2.0:1788843708.154505:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134494208 00000100:00100000:2.0:1788843708.154556:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788843708.154572:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+11:17129:x1875738134494208:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843708.154587:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843708.154608:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007947600/0xa762dfcbd58d21fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d21f5 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843708.154635:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007947600/0xa762dfcbd58d21fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d21f5 expref: 12 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843708.154647:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007947600/0xa762dfcbd58d21fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d21f5 expref: 12 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843708.154656:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007947600, rc 0) 00000100:00100000:2.0:1788843708.154693:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+12:17129:x1875738134494208:12345-0@lo:101:mount.lustre.0 Request processed in 128us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843708.154699:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788843708.154746:0:17129:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788843708.154768:0:17129:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fbaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17129:1875738134494208:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843708.154783:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd007947000/0xa762dfcbd58d21f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d21fc expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843708.154793:0:17129:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd007947000/0xa762dfcbd58d21f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d21fc expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843708.154849:0:17129:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fbaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17129:1875738134494336:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843708.154875:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843708.154898:0:17129:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788843708.155786:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134494336 00000100:00100000:3.0:1788843708.155794:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134494336 00000100:00100000:3.0:1788843708.155828:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788843708.155835:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+12:17129:x1875738134494336:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843708.155959:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+12:17129:x1875738134494336:12345-0@lo:501:mount.lustre.0 Request processed in 124us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843708.155966:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788843708.156214:0:17129:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fbaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17129:1875738134494336:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843708.156253:0:17129:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fbaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17129:1875738134494464:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788843708.156297:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843708.156329:0:17129:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788843708.156343:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134494464 00000100:00100000:2.0:1788843708.156346:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134494464 00000100:00100000:2.0:1788843708.156371:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788843708.156377:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+12:17129:x1875738134494464:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788843708.156463:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+12:17129:x1875738134494464:12345-0@lo:503:mount.lustre.0 Request processed in 85us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843708.156470:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788843708.156514:0:17129:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fbaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17129:1875738134494464:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788843708.161776:0:17181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20b96c6c-8494-483a-b913-89dfc06b1440:17181:1875738134494592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843708.161857:0:17181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843708.161898:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134494592 00000100:00100000:3.0:1788843708.161906:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134494592 00000100:00100000:3.0:1788843708.161946:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788843708.161954:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+12:17181:x1875738134494592:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843708.162060:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+12:17181:x1875738134494592:12345-0@lo:502:llog_process_th.0 Request processed in 106us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843708.162068:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788843708.162134:0:17181:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007722d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788843708.162177:0:17181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20b96c6c-8494-483a-b913-89dfc06b1440:17181:1875738134494592:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788843708.162235:0:17181:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788843708.162250:0:17181:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9bd0078bcd28) 00000020:00000080:3.0:1788843708.162269:0:17181:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1788843708.162337:0:17181:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd137acd000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788843708.162340:0:17181:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd137acd000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788843708.162343:0:17181:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd137acd000 4 00010000:00080000:3.0:1788843708.162368:0:17181:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd007220800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.133@tcp at head 00010000:00010000:3.0:1788843708.163903:0:17181:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1788843708.164096:0:17181:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788843708.164135:0:17181:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788843708.164177:0:17181:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa762dfcbd58d220a 00000100:00080000:3.0:1788843708.164188:0:17181:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788843708.164194:0:17181:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9bd007220800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:3.0:1788843708.164233:0:17181:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd141b6bb80 x1875738134494720/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788843708.164256:0:17181:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788843708.166223:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875738134494720:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788843708.166304:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843708.166392:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134494720 00000100:00100000:0.0:1788843708.166401:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134494720 00000100:00100000:0.0:1788843708.166435:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788843708.166441:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3629:x1875738134494720:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788843708.166511:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3629:x1875738134494720:12345-0@lo:38:llog_process_th.0 Request processed in 68us (206us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788843708.166519:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788843708.166559:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788843708.166568:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd007220800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788843708.166572:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788843708.166576:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875738134494720:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788843708.171243:0:17181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b68700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20b96c6c-8494-483a-b913-89dfc06b1440:17181:1875738134494848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843708.171336:0:17181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843708.171381:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134494848 00000100:00100000:3.0:1788843708.171389:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134494848 00000100:00100000:3.0:1788843708.171437:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788843708.171459:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+12:17181:x1875738134494848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843708.171580:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+12:17181:x1875738134494848:12345-0@lo:502:llog_process_th.0 Request processed in 133us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843708.171587:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788843708.171639:0:17181:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd102919780 going to sleep for 11 seconds 00000100:00100000:3.0:1788843708.171661:0:17181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b68700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20b96c6c-8494-483a-b913-89dfc06b1440:17181:1875738134494848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843708.171703:0:17181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b68700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20b96c6c-8494-483a-b913-89dfc06b1440:17181:1875738134494976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843708.171734:0:17181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843708.171754:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134494976 00000100:00100000:3.0:1788843708.171758:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134494976 00000100:00100000:3.0:1788843708.171779:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788843708.171785:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+12:17181:x1875738134494976:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843708.171848:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+12:17181:x1875738134494976:12345-0@lo:502:llog_process_th.0 Request processed in 62us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843708.171854:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788843708.171883:0:17181:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007722d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788843708.171894:0:17181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b68700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:20b96c6c-8494-483a-b913-89dfc06b1440:17181:1875738134494976:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788843708.171912:0:17181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788843708.173076:0:17129:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788843708.173112:0:17129:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788843708.173214:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007947000/0xa762dfcbd58d21f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d21fc expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843708.173227:0:17129:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007947000/0xa762dfcbd58d21f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d21fc expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788843708.173274:0:17129:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788843708.173276:0:17129:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788843708.173278:0:17129:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843708.173279:0:17129:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843708.173280:0:17129:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843708.173282:0:17129:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843708.173283:0:17129:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788843708.173285:0:17129:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788843708.173286:0:17129:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843708.173287:0:17129:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788843708.173290:0:17129:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788843708.173292:0:17129:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788843708.173294:0:17129:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788843708.173295:0:17129:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843708.173296:0:17129:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843708.173301:0:17129:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843708.173302:0:17129:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843708.173303:0:17129:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788843708.173304:0:17129:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788843708.173305:0:17129:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843708.173306:0:17129:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788843708.173327:0:17129:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788843708.173342:0:17129:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fbaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17129:1875738134495104:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788843708.173394:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843708.173414:0:17129:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007893000 going to sleep for 11 seconds 00000100:00100000:3.0:1788843708.173511:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134495104 00000100:00100000:3.0:1788843708.173519:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134495104 00000100:00100000:3.0:1788843708.173576:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788843708.173585:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+12:17129:x1875738134495104:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788843708.173612:0:17142:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788843708.173626:0:17142:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788843708.178520:0:17142:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788843708.178540:0:17142:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788843708.178770:0:17165:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788843708.178776:0:17165:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788843708.178805:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd10fa3ca00/0xa762dfcbd58d2211 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843708.178823:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d21e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d21d9 expref: 12 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843708.178832:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd10fa3ca00/0xa762dfcbd58d2211 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843708.178875:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d21e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d21d9 expref: 12 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843708.178891:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d21e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d21d9 expref: 12 pid: 17144 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843708.178906:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e0380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17165:1875738134495232:0@lo:104: 00000100:00100000:0.0:1788843708.178978:0:17165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843708.179020:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd11195f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788843708.179073:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134495232 00000100:00100000:0.0:1788843708.179082:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134495232 00000100:00100000:3.0:1788843708.180366:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+12:17129:x1875738134495104:12345-0@lo:253:mount.lustre.0 Request processed in 6776us (6965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843708.180379:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788843708.180521:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788843708.180535:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20b96c6c-8494-483a-b913-89dfc06b1440+3:17165:x1875738134495232:12345-0@lo:104: 00010000:00010000:0.0:1788843708.180552:0:17133:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd13fbea000/0xa762dfcbd58d21d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d21e0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843708.180611:0:17133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788843708.180617:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20b96c6c-8494-483a-b913-89dfc06b1440+3:17165:x1875738134495232:12345-0@lo:104: Request processed in 87us (1639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843708.180623:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788843708.180665:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e0380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17165:1875738134495232:0@lo:104: 00010000:00010000:0.0:1788843708.180697:0:17165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd10fa3ca00/0xa762dfcbd58d2211 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843708.180716:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843708.180723:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd13fbea000/0xa762dfcbd58d21d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d21e0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843708.180730:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbea000 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:0.0:1788843708.180735:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd13fbea000/0xa762dfcbd58d21d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d21e0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843708.180744:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd13fbea000/0xa762dfcbd58d21d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d21e0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843708.180751:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd13fbea000/0xa762dfcbd58d21d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d21e0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843708.180757:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788843708.180791:0:17139:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd13fbea000/0xa762dfcbd58d21d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d21e0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843708.180797:0:17139:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843708.180817:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd13fbea000/0xa762dfcbd58d21d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d21e0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843708.180824:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd13fbea000/0xa762dfcbd58d21d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d21e0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843708.180841:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843708.180843:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843708.180845:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843708.180901:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20b96c6c-8494-483a-b913-89dfc06b1440:3630:1875738134495360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788843708.180938:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843708.181024:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134495360 00000100:00100000:0.0:1788843708.181030:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134495360 00010000:00010000:0.0:1788843708.181053:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d21e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d21d9 expref: 12 pid: 17144 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843708.181076:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788843708.181082:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20b96c6c-8494-483a-b913-89dfc06b1440+12:3630:x1875738134495360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788843708.181094:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843708.181099:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d21e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d21d9 expref: 12 pid: 17144 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843708.181110:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d21e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d21d9 expref: 12 pid: 17144 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843708.181330:0:17129:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fbaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17129:1875738134495104:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788843708.181342:0:17129:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788843708.181345:0:17129:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788843708.181347:0:17129:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788843708.181348:0:17129:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843708.181349:0:17129:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843708.181351:0:17129:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843708.181352:0:17129:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843708.181354:0:17129:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788843708.181355:0:17129:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788843708.181357:0:17129:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843708.181358:0:17129:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788843708.181368:0:17129:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788843708.183251:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d21e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d21d9 expref: 12 pid: 17144 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843708.183274:0:17135:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd10fa3ca00/0xa762dfcbd58d2211 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843708.183285:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd10fa3ca00/0xa762dfcbd58d2211 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788843708.183305:0:17135:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004529583s 00010000:00010000:0.0:1788843708.183310:0:17135:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd10fa3ca00/0xa762dfcbd58d2211 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843708.183317:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd10fa3ca00/0xa762dfcbd58d2211 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843708.183331:0:17135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd10fa3ca00/0xa762dfcbd58d2211 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843708.183338:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd10fa3ca00/0xa762dfcbd58d2211 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843708.183344:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3ca00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843708.183348:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd10fa3ca00/0xa762dfcbd58d2211 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843708.183356:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd10fa3ca00/0xa762dfcbd58d2211 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843708.183376:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd10fa3ca00/0xa762dfcbd58d2211 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843708.183386:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843708.184291:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20b96c6c-8494-483a-b913-89dfc06b1440+11:3630:x1875738134495360:12345-0@lo:103:ldlm_bl.0 Request processed in 3201us (3345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843708.184302:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788843708.184350:0:17165:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd10fa3ca00/0xa762dfcbd58d2211 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843708.184360:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd10fa3ca00/0xa762dfcbd58d2211 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843708.184367:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd10fa3ca00/0xa762dfcbd58d2211 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843708.184417:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20b96c6c-8494-483a-b913-89dfc06b1440:3630:1875738134495360:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788843708.198388:0:17129:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1788843708.204382:0:17129:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788843708.204462:0:17188:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788843708.204466:0:17188:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1788843708.204858:0:17190:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1788843708.208690:0:17190:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788843708.210790:0:17190:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788843708.210876:0:17190:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:3.0:1788843708.211515:0:17129:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:2.0:1788843708.212025:0:17191:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9bd102fbaa00 x1875738134495488/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843708.212038:0:17191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e9c4b40 going to sleep for 0 seconds 00000040:01000000:3.0:1788843708.212651:0:17129:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788843708.212695:0:17129:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788843708.213213:0:17129:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788843708.213221:0:17129:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788843708.213260:0:17129:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788843708.214511:0:17129:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788843708.215045:0:17129:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788843708.215279:0:17129:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1788843708.217014:0:17129:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:3.0:1788843708.220552:0:17129:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788843708.222686:0:17129:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788843708.222781:0:17129:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb2dcc1c5f988 00100000:10000000:0.0:1788843708.222789:0:17129:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788843708.223583:0:17129:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788843708.223601:0:17129:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.133@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788843708.223618:0:17129:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788843708.223636:0:17129:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788843708.224573:0:17129:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788843708.224764:0:17129:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788843708.762325:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788843709.210947:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788843709.276416:0:17191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e9c4b40 going to sleep for 0 seconds 10000000:01000000:1.0:1788843709.277640:0:17147:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788843709.277646:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd137acd000 from 7 10000000:01000000:1.0:1788843709.277651:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788843709.277704:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeae00/0xa762dfcbd58d2218 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843709.277716:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeae00/0xa762dfcbd58d2218 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843709.277739:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeae00/0xa762dfcbd58d2218 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843709.277766:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134495616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788843709.277840:0:17147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843709.277954:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12e003c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788843709.279757:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134495616 00000100:00100000:3.0:1788843709.279772:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134495616 00000100:00100000:3.0:1788843709.279846:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788843709.280159:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd105a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+11:17147:x1875738134495616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843709.280177:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843709.280199:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007be2c00/0xa762dfcbd58d221f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2218 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843709.280230:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007be2c00/0xa762dfcbd58d221f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2218 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843709.280242:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007be2c00/0xa762dfcbd58d221f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2218 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843709.280252:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be2c00, rc 0) 00000100:00100000:3.0:1788843709.280404:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd105a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+12:17147:x1875738134495616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 266us (2562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843709.280412:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788843709.283010:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134495616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843709.283045:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeae00/0xa762dfcbd58d2218 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d221f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843709.283121:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeae00/0xa762dfcbd58d2218 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d221f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843709.284661:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134495744:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788843709.284887:0:17147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843709.285059:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd104963a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788843709.285183:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134495744 00000100:00100000:3.0:1788843709.285192:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134495744 00000100:00100000:3.0:1788843709.285311:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788843709.285323:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1037cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+12:17147:x1875738134495744:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788843709.285347:0:17142:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788843709.285363:0:17142:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788843709.285367:0:17142:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788843709.285480:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1037cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+12:17147:x1875738134495744:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 157us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843709.285488:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788843709.285620:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134495744:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788843709.285678:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788843709.285689:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeae00/0xa762dfcbd58d2218 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d221f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843709.285708:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeae00/0xa762dfcbd58d2218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d221f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843709.786375:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788843710.239503:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788843710.299511:0:17191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e9c4b40 going to sleep for 0 seconds 00010000:00010000:1.0:1788843710.812001:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843711.322233:0:17191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e9c4b40 going to sleep for 0 seconds 00010000:00010000:0.0:1788843711.837157:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843712.346310:0:17191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e9c4b40 going to sleep for 0 seconds 00000001:02000400:3.0:1788843712.796598:0:17433:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg333-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788843712.867950:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843713.370263:0:17191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e9c4b40 going to sleep for 0 seconds 00000100:00100000:3.0:1788843713.434743:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20b96c6c-8494-483a-b913-89dfc06b1440:3631:1875738134495872:0@lo:400:kworker.0 00000100:00100000:3.0:1788843713.434819:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788843713.436657:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788843713.436665:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788843713.436669:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bd12e2ab000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788843713.436684:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 486 00000100:00080000:2.0:1788843713.436690:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788843713.436697:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9bd12e2ab000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:2.0:1788843713.436734:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd102fb8e00 x1875738134496000/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788843713.436751:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788843713.436755:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788843713.436758:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788843713.436761:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788843713.436764:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788843713.436767:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788843713.436768:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bd007220800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788843713.436772:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9bd007220800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:2.0:1788843713.436780:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd102fbb800 x1875738134496128/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788843713.437276:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134496000:0@lo:38:kworker.0 00000100:00100000:1.0:1788843713.437361:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843713.437401:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875738134496128:0@lo:38:kworker.0 00000100:00100000:1.0:1788843713.437440:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843713.438298:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134496128 00000100:00100000:2.0:1788843713.438310:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134496128 00000100:00100000:2.0:1788843713.438358:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788843713.438366:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3629:x1875738134496128:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788843713.438405:0:17151:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 491 last 0 00000020:00000080:2.0:1788843713.438450:0:17151:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa762dfcbd58d2226 00000004:00100000:2.0:1788843713.438467:0:17151:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788843713.438601:0:17151:0:(import.c:65:import_set_state_nolock()) ffff9bd10f7bc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788843713.438678:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1875738134496128:12345-0@lo:38:kworker.0 Request processed in 310us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843713.438695:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788843713.438750:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bd102fbb800 x1875738134496128/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788843723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788843713.438765:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788843713.438773:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788843713.438778:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788843713.438780:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd007220800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788843713.438786:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875738134496128:0@lo:38:kworker.0 00000100:00100000:2.0:1788843713.440447:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134495872 00000100:00100000:2.0:1788843713.440462:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134495872 00000100:00100000:2.0:1788843713.440523:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788843713.440533:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd114f16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+12:3631:x1875738134495872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843713.440831:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134496000 00000100:00100000:0.0:1788843713.440836:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134496000 00000100:00100000:0.0:1788843713.440857:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788843713.440862:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3629:x1875738134496000:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788843713.440878:0:17155:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788843713.449246:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd114f16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+12:3631:x1875738134495872:12345-0@lo:400:kworker.0 Request processed in 8704us (14417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843713.449263:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788843713.452750:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20b96c6c-8494-483a-b913-89dfc06b1440:3631:1875738134495872:0@lo:400:kworker.0 00000100:00100000:0.0:1788843713.472329:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3629:x1875738134496000:12345-0@lo:38:kworker.0 Request processed in 31447us (34949us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788843713.472361:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788843713.473102:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd12e2ab000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788843713.473111:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788843713.473116:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134496000:0@lo:38:kworker.0 00010000:00010000:0.0:1788843713.883861:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788843713.947529:0:17486:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788843713.947810:0:17486:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788843714.395619:0:17191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e9c4b40 going to sleep for 0 seconds 00000020:00000004:3.0:1788843714.788619:0:17536:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788843714.788870:0:17536:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788843714.917774:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843715.418294:0:17191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e9c4b40 going to sleep for 0 seconds 00010000:00010000:1.0:1788843715.931039:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843716.443006:0:17191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e9c4b40 going to sleep for 0 seconds 00010000:00010000:0.0:1788843716.954337:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843717.467199:0:17191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e9c4b40 going to sleep for 0 seconds 00010000:00010000:0.0:1788843717.979813:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843718.492209:0:17191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e9c4b40 going to sleep for 0 seconds 00000100:00100000:2.0:1788843718.557870:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20b96c6c-8494-483a-b913-89dfc06b1440:3632:1875738134496256:0@lo:400:kworker.0 00000100:00100000:2.0:1788843718.557951:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843718.558045:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134496256 00000100:00100000:0.0:1788843718.558055:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134496256 00000100:00100000:0.0:1788843718.558110:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788843718.558120:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd114f17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+12:3632:x1875738134496256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843718.563063:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd114f17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+12:3632:x1875738134496256:12345-0@lo:400:kworker.0 Request processed in 4933us (5101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843718.563080:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788843718.563390:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788843718.563395:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788843718.563401:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bd12e2ab000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788843718.563406:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 491 00000100:00080000:3.0:1788843718.563412:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788843718.563419:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9bd12e2ab000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:3.0:1788843718.563460:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd141b6b100 x1875738134496384/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788843718.563516:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134496384:0@lo:38:kworker.0 00000100:00100000:0.0:1788843718.563579:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788843718.563623:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788843718.563628:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788843718.563631:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788843718.563634:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788843718.563690:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134496512:0@lo:400:kworker.0 00000100:00100000:3.0:1788843718.563725:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843718.563765:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134496512 00000100:00100000:3.0:1788843718.563772:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134496512 00000100:00100000:3.0:1788843718.563815:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788843718.563824:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134496512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843718.563872:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134496512:12345-0@lo:400:kworker.0 Request processed in 49us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843718.563879:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788843718.563910:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bd141b6a300 x1875738134496512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843718.563924:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134496512:0@lo:400:kworker.0 00000100:00100000:2.0:1788843718.564489:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20b96c6c-8494-483a-b913-89dfc06b1440:3632:1875738134496256:0@lo:400:kworker.0 00000100:00100000:2.0:1788843718.565288:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134496384 00000100:00100000:2.0:1788843718.565297:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134496384 00000100:00100000:2.0:1788843718.565328:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788843718.565340:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3629:x1875738134496384:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788843718.565358:0:17154:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788843718.590576:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3629:x1875738134496384:12345-0@lo:38:kworker.0 Request processed in 25225us (26987us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788843718.590592:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788843718.599270:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd12e2ab000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788843718.599283:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788843718.599289:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134496384:0@lo:38:kworker.0 00010000:00010000:1.0:1788843719.009620:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843719.514268:0:17191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e9c4b40 going to sleep for 0 seconds 00000100:00100000:2.0:1788843719.585889:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843708/real 1788843708] req@ffff9bd141b68a80 x1875738134493056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843718 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843719.585921:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd141b68a80 x1875738134493056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843718 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843719.585933:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843708/real 1788843708] req@ffff9bd0084e1180 x1875738134492928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843718 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843719.585945:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd0084e1180 x1875738134492928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843718 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788843719.585965:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd13e8a4000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788843719.585986:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788843719.585990:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134493056:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788843719.585997:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd118910000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788843719.586002:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788843719.586005:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134492928:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788843719.586200:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788843719.586205:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788843719.586208:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bd12e2ab000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788843719.586214:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 496 00000100:00080000:1.0:1788843719.586220:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788843719.586227:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9bd12e2ab000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:1.0:1788843719.586252:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd00776bb80 x1875738134496768/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788843719.586266:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843719.586269:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788843719.586271:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bd118910000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788843719.586273:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 486 00000100:00080000:1.0:1788843719.586276:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788843719.586279:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bd118910000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:1.0:1788843719.586289:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd00776aa00 x1875738134496896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788843719.586309:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843719.586311:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788843719.586313:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bd13e8a4000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788843719.586316:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 486 00000100:00080000:1.0:1788843719.586318:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788843719.586321:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bd13e8a4000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:1.0:1788843719.586333:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd007769f80 x1875738134497024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788843719.586444:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20b96c6c-8494-483a-b913-89dfc06b1440:3630:1875738134496640:0@lo:400:kworker.0 00000100:00100000:0.0:1788843719.586526:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843719.586584:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788843719.586589:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134497152:0@lo:400:kworker.0 00000100:00100000:0.0:1788843719.586615:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843719.586645:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134497152 00000100:00100000:0.0:1788843719.586652:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134497152 00000100:00100000:0.0:1788843719.586703:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788843719.586711:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134497152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843719.586755:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134497152:12345-0@lo:400:kworker.0 Request processed in 45us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843719.586762:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788843719.586798:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bd007768e00 x1875738134497152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843719.586808:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134497152:0@lo:400:kworker.0 00000100:00100000:1.0:1788843719.586908:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134496640 00000100:00100000:1.0:1788843719.586913:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134496640 00000100:00100000:1.0:1788843719.586948:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788843719.586956:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd114f16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+12:3630:x1875738134496640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843719.586995:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd114f16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+12:3630:x1875738134496640:12345-0@lo:400:kworker.0 Request processed in 39us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843719.587000:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788843719.587256:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134496768:0@lo:38:kworker.0 00000100:00100000:1.0:1788843719.587283:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843719.587300:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134496896:0@lo:8:kworker.0 00000400:00000100:1.0:1788843719.587318:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875738134496896 offset 0 length 520: 4 00000100:00100000:1.0:1788843719.587329:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134497024:0@lo:8:kworker.0 00000400:00000100:1.0:1788843719.587384:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875738134497024 offset 0 length 520: 4 00000100:00100000:0.0:1788843719.587533:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134496768 00000100:00100000:0.0:1788843719.587539:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134496768 00000100:00100000:0.0:1788843719.587560:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788843719.587565:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3629:x1875738134496768:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788843719.587582:0:17155:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788843719.587617:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3629:x1875738134496768:12345-0@lo:38:kworker.0 Request processed in 51us (333us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788843719.587623:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788843719.587647:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20b96c6c-8494-483a-b913-89dfc06b1440:3630:1875738134496640:0@lo:400:kworker.0 00000100:00080000:0.0:1788843719.587668:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd12e2ab000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788843719.587671:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788843719.587674:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134496768:0@lo:38:kworker.0 00010000:00010000:1.0:1788843720.026868:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788843720.477997:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788843720.538575:0:17191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e9c4b40 going to sleep for 0 seconds 00010000:00010000:1.0:1788843721.052258:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843721.564927:0:17191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e9c4b40 going to sleep for 0 seconds 00000020:01000004:2.0:1788843721.709746:0:17881:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788843721.709750:0:17881:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788843721.709751:0:17881:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788843721.709933:0:17881:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bd10f7b9800 00000020:01000004:2.0:1788843721.709950:0:17881:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1788843721.709962:0:17881:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788843721.709981:0:17881:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9bd133398000) 00000020:00000080:2.0:1788843721.709998:0:17881:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788843721.852384:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788843721.852891:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1788843721.854089:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1788843721.854664:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1788843721.854987:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788843721.855513:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788843721.855755:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788843721.856049:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788843721.856447:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1788843721.856643:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1788843721.856888:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1788843721.857091:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788843721.857587:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1788843721.857939:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788843721.860876:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788843721.861284:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788843721.861526:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788843721.861710:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788843721.862009:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1788843721.862387:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1788843721.862622:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788843721.862886:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1788843721.863092:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1788843721.863592:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788843721.863831:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788843721.864032:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1788843721.864353:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1788843721.864620:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1788843721.864866:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1788843721.865064:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788843721.865783:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1788843721.866220:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788843721.866522:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1788843721.866835:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788843721.867087:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788843721.867744:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788843721.868094:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788843721.868484:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788843721.868693:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1788843721.869100:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788843721.871012:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1788843721.871603:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788843721.872574:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788843721.876002:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788843721.876683:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1788843721.877399:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00080000:01000000:2.0:1788843721.879316:0:17881:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788843721.879632:0:17881:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788843721.879648:0:17881:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788843721.879666:0:17881:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa762dfcbd58d2234 00000020:01000004:2.0:1788843721.879675:0:17881:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788843721.879705:0:17881:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.133@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788843721.879710:0:17881:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.133@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788843721.879718:0:17881:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788843721.879758:0:17881:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788843721.879764:0:17881:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.133@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788843721.905216:0:17881:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.133@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788843721.905285:0:17881:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.133@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1788843721.905291:0:17881:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788843721.905293:0:17881:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788843721.905295:0:17881:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843721.905296:0:17881:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843721.905303:0:17881:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843721.905304:0:17881:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843721.905306:0:17881:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788843721.905308:0:17881:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843721.905309:0:17881:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788843721.905314:0:17881:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1788843721.905316:0:17881:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788843721.905317:0:17881:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788843721.905318:0:17881:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843721.905319:0:17881:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843721.905320:0:17881:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843721.905321:0:17881:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843721.905322:0:17881:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788843721.905323:0:17881:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843721.905324:0:17881:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788843721.905362:0:17881:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788843721.905386:0:17881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fb8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134497280:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788843721.905475:0:17881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843721.905597:0:17881:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0077bb900 going to sleep for 11 seconds 00000100:00100000:0.0:1788843721.906857:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134497280 00000100:00100000:0.0:1788843721.906873:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134497280 00000100:00100000:0.0:1788843721.911986:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788843721.912016:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+12:17881:x1875738134497280:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788843721.912365:0:17142:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788843721.912370:0:17142:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1788843721.912382:0:17142:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788843721.913743:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+12:17881:x1875738134497280:12345-0@lo:253:mount.lustre.0 Request processed in 1736us (8260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843721.913756:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788843721.914424:0:17881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fb8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134497280:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788843721.914443:0:17881:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788843721.914447:0:17881:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788843721.914449:0:17881:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788843721.914451:0:17881:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843721.914452:0:17881:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843721.914453:0:17881:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843721.914455:0:17881:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843721.914456:0:17881:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788843721.914458:0:17881:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843721.914460:0:17881:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788843721.914540:0:17881:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bd10f7b9800 from lustre-MDT0001 10000000:01000000:2.0:1788843721.914715:0:17881:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788843721.914720:0:17881:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788843721.914728:0:17881:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bd10fbb0000 local copy 00010000:00010000:2.0:1788843721.914742:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d212a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2131 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843721.914965:0:17881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fb8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134497408:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843721.915014:0:17881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843721.915327:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134497408 00000100:00100000:0.0:1788843721.915335:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134497408 00000100:00100000:0.0:1788843721.915394:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788843721.915405:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+12:17881:x1875738134497408:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788843721.915490:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+12:17881:x1875738134497408:12345-0@lo:501:mount.lustre.0 Request processed in 87us (474us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788843721.915497:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788843721.915600:0:17881:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0077bb180 going to sleep for 11 seconds 00000100:00100000:2.0:1788843721.915617:0:17881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fb8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134497408:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788843721.915633:0:17881:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.133@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788843721.915654:0:17881:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.133@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788843721.915661:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d212a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2131 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843721.915671:0:17881:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d212a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2131 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843721.915703:0:17881:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bd10f7b9800 10000000:01000000:2.0:1788843721.915709:0:17881:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788843721.915714:0:17881:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9bd10fbb0000 10000000:01000000:2.0:1788843721.915717:0:17881:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788843721.915721:0:17881:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9bd10fbb0000 from 1 10000000:01000000:2.0:1788843721.915725:0:17881:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788843721.915748:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007947200/0xa762dfcbd58d223b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843721.915757:0:17881:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd007947200/0xa762dfcbd58d223b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843721.915828:0:17881:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd007947200/0xa762dfcbd58d223b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843721.915857:0:17881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fb8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134497536:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788843721.915882:0:17881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843721.915947:0:17881:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0077bb180 going to sleep for 11 seconds 00000100:00100000:1.0:1788843721.915991:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134497536 00000100:00100000:1.0:1788843721.915996:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134497536 00000100:00100000:1.0:1788843721.916109:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788843721.916128:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+12:17881:x1875738134497536:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788843721.916137:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843721.916178:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd13fbea600/0xa762dfcbd58d2242 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d223b expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843721.916215:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd13fbea600/0xa762dfcbd58d2242 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d223b expref: 13 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843721.916226:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd13fbea600/0xa762dfcbd58d2242 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d223b expref: 13 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843721.916234:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fbea600, rc 0) 00000100:00100000:1.0:1788843721.916277:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+13:17881:x1875738134497536:12345-0@lo:101:mount.lustre.0 Request processed in 151us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843721.916283:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788843721.916364:0:17881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fb8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134497536:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843721.916377:0:17881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd007947200/0xa762dfcbd58d223b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2242 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843721.916385:0:17881:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd007947200/0xa762dfcbd58d223b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2242 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843721.916401:0:17881:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788843721.916422:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007947200/0xa762dfcbd58d223b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2242 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843721.916430:0:17881:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007947200/0xa762dfcbd58d223b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2242 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843721.916439:0:17881:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9bd10f7b9800 10000000:01000000:2.0:1788843721.916443:0:17881:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788843721.916446:0:17881:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9bd10f7b9800 from 1 10000000:01000000:2.0:1788843721.916449:0:17881:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788843721.916463:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946e00/0xa762dfcbd58d2249 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843721.916471:0:17881:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd007946e00/0xa762dfcbd58d2249 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843721.916478:0:17881:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd007946e00/0xa762dfcbd58d2249 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843721.916502:0:17881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fb8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134497664:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788843721.916528:0:17881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843721.916894:0:17881:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0077bb180 going to sleep for 11 seconds 00000100:00100000:0.0:1788843721.916932:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134497664 00000100:00100000:0.0:1788843721.916937:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134497664 00000100:00100000:1.0:1788843721.916976:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788843721.916985:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+13:17881:x1875738134497664:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788843721.916994:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843721.917005:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd13fbeb800/0xa762dfcbd58d2250 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2249 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843721.917020:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd13fbeb800/0xa762dfcbd58d2250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2249 expref: 14 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843721.917041:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd13fbeb800/0xa762dfcbd58d2250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2249 expref: 14 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843721.917061:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fbeb800, rc 0) 00000100:00100000:1.0:1788843721.917272:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+14:17881:x1875738134497664:12345-0@lo:101:mount.lustre.0 Request processed in 127us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843721.917279:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788843721.917363:0:17881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fb8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134497664:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843721.917376:0:17881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd007946e00/0xa762dfcbd58d2249 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2250 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843721.917384:0:17881:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd007946e00/0xa762dfcbd58d2249 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2250 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843721.917397:0:17881:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788843721.917413:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946e00/0xa762dfcbd58d2249 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2250 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843721.917419:0:17881:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007946e00/0xa762dfcbd58d2249 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2250 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843721.917425:0:17881:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788843721.917429:0:17881:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788843721.917434:0:17881:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9bd10f7b9800 10000000:01000000:2.0:1788843721.917437:0:17881:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788843721.917440:0:17881:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1788843721.917443:0:17881:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788843721.917458:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d2257 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843721.917464:0:17881:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d2257 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843721.917479:0:17881:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d2257 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843721.917492:0:17881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fb8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134497792:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788843721.917521:0:17881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843721.918313:0:17881:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0077bb180 going to sleep for 11 seconds 00000100:00100000:3.0:1788843721.918391:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134497792 00000100:00100000:3.0:1788843721.918399:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134497792 00000100:00100000:3.0:1788843721.918450:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788843721.918459:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+14:17881:x1875738134497792:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788843721.918474:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843721.918488:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007be2800/0xa762dfcbd58d225e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2257 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843721.918511:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007be2800/0xa762dfcbd58d225e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2257 expref: 15 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843721.918521:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007be2800/0xa762dfcbd58d225e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2257 expref: 15 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843721.918544:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be2800, rc 0) 00000100:00100000:3.0:1788843721.918601:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+15:17881:x1875738134497792:12345-0@lo:101:mount.lustre.0 Request processed in 143us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843721.918608:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788843721.918708:0:17881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fb8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134497792:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843721.918722:0:17881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d2257 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d225e expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843721.918731:0:17881:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d2257 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d225e expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788843721.920628:0:17881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:2.0:1788843721.921718:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788843721.927761:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788843721.927927:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1788843721.927945:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1788843721.927961:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1788843721.927975:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1788843721.927988:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1788843721.928001:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1788843721.928017:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1788843721.928350:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1788843721.928384:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1788843721.928400:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1788843721.928414:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1788843721.928430:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1788843721.928445:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1788843721.928459:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1788843721.928474:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1788843721.928491:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1788843721.928510:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1788843721.928525:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1788843721.928537:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1788843721.928551:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1788843721.928566:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1788843721.928581:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1788843721.928616:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1788843721.928625:0:17881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1788843721.928857:0:17881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134497920:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843721.928960:0:17881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843721.929190:0:17881:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13dffcc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788843721.929377:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134497920 00000100:00100000:0.0:1788843721.929387:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134497920 00000100:00100000:0.0:1788843721.929505:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788843721.929516:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+15:17881:x1875738134497920:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788843721.929740:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+15:17881:x1875738134497920:12345-0@lo:501:mount.lustre.0 Request processed in 223us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843721.929748:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788843721.929844:0:17881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134497920:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843721.929889:0:17881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134498048:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788843721.929941:0:17881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843721.930176:0:17881:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13dffcc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788843721.930333:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134498048 00000100:00100000:1.0:1788843721.930340:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134498048 00000100:00100000:1.0:1788843721.930384:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788843721.930393:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+15:17881:x1875738134498048:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788843721.931511:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+15:17881:x1875738134498048:12345-0@lo:503:mount.lustre.0 Request processed in 1112us (1562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843721.931523:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788843721.931750:0:17881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134498048:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788843721.932996:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788843721.933344:0:17881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134498176:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788843721.933449:0:17881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843721.933559:0:17881:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13dffcc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788843721.933607:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134498176 00000100:00100000:0.0:1788843721.933615:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134498176 00000100:00100000:0.0:1788843721.933704:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788843721.933715:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+15:17881:x1875738134498176:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788843721.934606:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+15:17881:x1875738134498176:12345-0@lo:502:mount.lustre.0 Request processed in 887us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843721.934617:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788843721.934705:0:17881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134498176:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788843721.935003:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788843721.935044:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1788843721.935057:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1788843721.935068:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1788843721.935079:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1788843721.935090:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1788843721.935101:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1788843721.935121:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1788843721.935133:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1788843721.935182:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1788843721.935199:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1788843721.935211:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1788843721.935222:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1788843721.935233:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1788843721.935244:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1788843721.935264:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1788843721.935275:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1788843721.935286:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1788843721.935297:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1788843721.935309:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1788843721.935319:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1788843721.935330:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1788843721.935341:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1788843721.935352:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1788843721.935378:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1788843721.935392:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1788843721.935405:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1788843721.935417:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1788843721.935428:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1788843721.935439:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1788843721.935450:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1788843721.935461:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1788843721.935472:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1788843721.935483:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1788843721.935495:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1788843721.935506:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1788843721.935517:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1788843721.935528:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1788843721.935539:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1788843721.935551:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1788843721.935562:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1788843721.935573:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1788843721.935584:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1788843721.935595:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1788843721.935634:0:17881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134498304:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788843721.935704:0:17881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843721.936584:0:17881:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13dffcc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788843721.936672:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134498304 00000100:00100000:1.0:1788843721.936681:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134498304 00000100:00100000:1.0:1788843721.936732:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788843721.936742:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+15:17881:x1875738134498304:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843721.937039:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+15:17881:x1875738134498304:12345-0@lo:502:mount.lustre.0 Request processed in 297us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843721.937047:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788843721.937434:0:17881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134498304:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788843721.937532:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1788843721.937548:0:17881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1788843721.938660:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843721.938677:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843721.938679:0:17885:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788843721.938687:0:17885:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788843721.938690:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788843721.938708:0:17885:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9bd13eb14d28) 00000020:00000080:1.0:1788843721.938734:0:17885:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1788843721.938740:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788843721.938928:0:17885:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788843721.938937:0:17885:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa762dfcbd58d226c 00000020:00000080:1.0:1788843721.939500:0:17885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788843721.939508:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843721.939512:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843721.939514:0:17885:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788843721.939517:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843721.939522:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843721.939523:0:17885:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788843721.939526:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788843721.939537:0:17885:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9bd13eb13370) 00000020:00000080:1.0:1788843721.939552:0:17885:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1788843721.939557:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788843721.939559:0:17885:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788843721.939562:0:17885:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788843721.939569:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788843721.939627:0:17885:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd10f7b9800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788843721.939642:0:17885:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9bd13eb10000) 00000020:00000080:1.0:1788843721.939651:0:17885:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1788843721.939714:0:17885:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788843721.939721:0:17885:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa762dfcbd58d2281 00000020:00000080:1.0:1788843721.939956:0:17885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788843721.939965:0:17885:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788843721.939970:0:17885:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xa762dfcbd58d2288 00080000:01000000:1.0:1788843721.939977:0:17885:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788843721.939980:0:17885:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa762dfcbd58d228f 00010000:00010000:1.0:1788843722.074662:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843722.107495:0:17885:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1788843722.108206:0:17885:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:1.0:1788843722.109453:0:17885:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788843722.111731:0:17885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788843722.111750:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843722.111759:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843722.111769:0:17885:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788843722.111773:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843722.111781:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843722.111782:0:17885:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788843722.111785:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788843722.111792:0:17885:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.133@tcp to nid 0x20000c0a8cb85 (192.168.203.133@tcp) 00000020:00000080:1.0:1788843722.111822:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788843722.112508:0:17885:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9bd13df30000) 00000020:00000080:1.0:1788843722.112547:0:17885:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1788843722.112558:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788843722.112661:0:17885:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788843722.112670:0:17885:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788843722.112679:0:17885:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa762dfcbd58d229d 00010000:00080000:1.0:1788843722.112737:0:17885:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd00644e000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.133@tcp at head 00010000:00010000:1.0:1788843722.123089:0:17885:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1788843722.142424:0:17885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788843722.142442:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788843722.142486:0:17885:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788843722.142509:0:17885:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa762dfcbd58d22a4 00000100:00080000:0.0:1788843722.142521:0:17885:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788843722.142527:0:17885:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9bd00644e000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:0.0:1788843722.142571:0:17885:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd0084e3b80 x1875738134498432/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788843722.142604:0:17885:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1788843722.142668:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843722.142673:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843722.142676:0:17885:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788843722.142679:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788843722.142682:0:17885:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788843722.142684:0:17885:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788843722.142686:0:17885:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788843722.142688:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788843722.142691:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843722.142704:0:17885:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788843722.142708:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843722.142713:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843722.142714:0:17885:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1788843722.142718:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788843722.142755:0:17885:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788843722.142772:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843722.142775:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843722.142777:0:17885:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1788843722.142780:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788843722.142782:0:17885:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1788843722.142783:0:17885:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788843722.142786:0:17885:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788843722.142787:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788843722.142789:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:1.0:1788843722.142972:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134498432:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788843722.143051:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843722.143128:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134498432 00000100:00100000:1.0:1788843722.143136:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134498432 00000100:00100000:1.0:1788843722.143200:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788843722.143208:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3629:x1875738134498432:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788843722.143246:0:17155:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 500 last 0 00000020:00000080:1.0:1788843722.143279:0:17155:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa762dfcbd58d22ab 00000004:00100000:1.0:1788843722.143293:0:17155:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788843722.143301:0:17155:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000020:00000080:0.0:1788843722.143498:0:17885:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788843722.143506:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788843722.143510:0:17885:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788843722.143516:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843722.143518:0:17885:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788843722.143522:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788843722.143527:0:17885:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.133@tcp to nid 0x20000c0a8cb85 (192.168.203.133@tcp) 00000020:01000000:0.0:1788843722.143550:0:17885:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788843722.143553:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788843722.143568:0:17885:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9bd13e918000) 00000020:00000080:0.0:1788843722.143583:0:17885:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788843722.143590:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788843722.143681:0:17885:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1788843722.143688:0:17885:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788843722.143696:0:17885:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa762dfcbd58d22b9 00010000:00080000:0.0:1788843722.143730:0:17885:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd104818000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.133@tcp at head 00000100:00080000:3.0:1788843722.144225:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788843722.144241:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788843722.144245:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bd12e2ab000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788843722.144251:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 497 00000100:00080000:3.0:1788843722.144255:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788843722.144260:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9bd12e2ab000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:3.0:1788843722.144282:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd141b69880 x1875738134498688/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788843722.144301:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788843722.144306:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788843722.144310:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788843722.144313:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788843722.144388:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20b96c6c-8494-483a-b913-89dfc06b1440:3632:1875738134498560:0@lo:400:kworker.0 00000100:00100000:3.0:1788843722.144454:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843722.144507:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788843722.144516:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134498816:0@lo:400:kworker.0 00000100:00100000:3.0:1788843722.144556:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843722.144623:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134498560 00000100:00100000:3.0:1788843722.144635:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134498560 00000100:00100000:3.0:1788843722.144687:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788843722.144698:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+15:3632:x1875738134498560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843722.144768:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+15:3632:x1875738134498560:12345-0@lo:400:kworker.0 Request processed in 71us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843722.144777:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788843722.144832:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134498816 00000100:00100000:3.0:1788843722.144837:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134498816 00000100:00100000:3.0:1788843722.144868:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788843722.144873:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134498816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843722.144907:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134498816:12345-0@lo:400:kworker.0 Request processed in 33us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843722.144915:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788843722.144945:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134498688:0@lo:38:kworker.0 00000100:00100000:3.0:1788843722.144979:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843722.145050:0:17154:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788843722.145058:0:17154:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00010000:00010000:0.0:1788843722.145579:0:17885:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:0.0:1788843722.150009:0:17885:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788843722.150547:0:17885:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:3.0:1788843722.154565:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134498688 00000100:00100000:3.0:1788843722.154578:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134498688 00010000:00080000:2.0:1788843722.156470:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bd141b69180 x1875738134498816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843722.156506:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134498816:0@lo:400:kworker.0 00000100:00100000:2.0:1788843722.156581:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20b96c6c-8494-483a-b913-89dfc06b1440:3632:1875738134498560:0@lo:400:kworker.0 00000100:00080000:0.0:1788843722.157535:0:17155:0:(import.c:65:import_set_state_nolock()) ffff9bd10481e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788843722.157671:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3629:x1875738134498432:12345-0@lo:38:llog_process_th.0 Request processed in 14458us (14616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843722.157682:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788843722.157712:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788843722.157723:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3629:x1875738134498688:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788843722.157781:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3629:x1875738134498688:12345-0@lo:38:kworker.0 Request processed in 61us (12806us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788843722.157871:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788843722.158494:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788843722.158504:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd12e2ab000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788843722.158510:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788843722.158514:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134498688:0@lo:38:kworker.0 00000100:00100000:3.0:1788843722.158534:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788843722.158540:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788843722.158550:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788843722.158556:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788843722.158559:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd00644e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788843722.158569:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134498432:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788843722.160651:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788843722.160674:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134498944:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788843722.160749:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788843722.160939:0:17885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788843722.168078:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788843722.168410:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00100000:1.0:1788843722.169440:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134498944 00000100:00100000:1.0:1788843722.169457:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134498944 00000100:00100000:2.0:1788843722.170420:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788843722.170447:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3631:x1875738134498944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788843722.170498:0:17154:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788843722.170775:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3631:x1875738134498944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 331us (10015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843722.170783:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788843722.172384:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134498944:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1788843722.178538:0:17891:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788843722.178550:0:17891:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788843722.184974:0:17885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788843722.184995:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788843722.185055:0:17885:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788843722.185084:0:17885:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa762dfcbd58d22c0 00000100:00080000:2.0:1788843722.185097:0:17885:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788843722.185103:0:17885:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9bd104818000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:2.0:1788843722.185426:0:17885:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd102fb8e00 x1875738134499072/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788843722.185458:0:17885:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1788843722.185581:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134499072:0@lo:8:llog_process_th.0 00000020:01000000:2.0:1788843722.185597:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843722.185604:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843722.185606:0:17885:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788843722.185610:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788843722.185614:0:17885:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1788843722.185616:0:17885:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788843722.185618:0:17885:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788843722.185620:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788843722.185623:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843722.185625:0:17885:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788843722.185628:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788843722.185633:0:17885:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788843722.185639:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843722.185641:0:17885:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788843722.185644:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788843722.185651:0:17885:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.133@tcp to nid 0x20000c0a8cb85 (192.168.203.133@tcp) 00000400:00000100:3.0:1788843722.185669:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875738134499072 offset 0 length 520: 4 00000100:00080000:0.0:1788843722.190390:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788843722.190405:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788843722.190408:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788843722.190411:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1788843722.191360:0:17885:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788843722.191391:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788843722.191416:0:17885:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9bd1203f0000) 00000020:00000080:2.0:1788843722.191913:0:17885:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1788843722.191991:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788843722.192258:0:17885:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788843722.192267:0:17885:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788843722.192393:0:17885:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa762dfcbd58d22ce 00010000:00080000:3.0:1788843722.192435:0:17885:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd141b67000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.133@tcp at head 00010000:00010000:3.0:1788843722.192710:0:17885:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1788843722.192784:0:17885:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788843722.192937:0:17885:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788843722.195314:0:17885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788843722.195838:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788843722.195968:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788843722.196738:0:17893:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788843722.196746:0:17893:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788843722.197664:0:17885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788843722.197676:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788843722.197713:0:17885:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788843722.197736:0:17885:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa762dfcbd58d22d5 00000100:00080000:3.0:1788843722.197748:0:17885:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788843722.197754:0:17885:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9bd141b67000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:3.0:1788843722.197806:0:17885:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd141b6a300 x1875738134499200/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788843722.197838:0:17885:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1788843722.197927:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134499200:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788843722.197984:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875738134499200 offset 0 length 520: 4 00000020:01000000:3.0:1788843722.198251:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843722.198265:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843722.198267:0:17885:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788843722.198271:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788843722.198286:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843722.198288:0:17885:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788843722.198291:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788843722.198293:0:17885:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788843722.198296:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843722.198298:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843722.198299:0:17885:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788843722.198302:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788843722.198304:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843722.198305:0:17885:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788843722.198307:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788843722.198336:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843722.198339:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843722.198340:0:17885:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788843722.198343:0:17885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:2.0:1788843722.198988:0:17881:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1788843722.199038:0:17881:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788843722.199062:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d2257 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d225e expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843722.199082:0:17881:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007946600/0xa762dfcbd58d2257 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d225e expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843722.199091:0:17881:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd10f7b9800 from 1 10000000:01000000:2.0:1788843722.199094:0:17881:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788843722.199129:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d22dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843722.199138:0:17881:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d22dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843722.199179:0:17881:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d22dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843722.199200:0:17881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fbb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134499328:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788843722.199252:0:17881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843722.199299:0:17881:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd105f55240 going to sleep for 11 seconds 00000100:00100000:1.0:1788843722.199481:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134499328 00000100:00100000:1.0:1788843722.199490:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134499328 00000100:00100000:1.0:1788843722.199546:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788843722.199556:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+15:17881:x1875738134499328:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788843722.199571:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843722.199586:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd13fbeb600/0xa762dfcbd58d22e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d22dc expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843722.199614:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd13fbeb600/0xa762dfcbd58d22e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d22dc expref: 16 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843722.199625:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd13fbeb600/0xa762dfcbd58d22e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d22dc expref: 16 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843722.199634:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fbeb600, rc 0) 00000100:00100000:1.0:1788843722.199693:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+16:17881:x1875738134499328:12345-0@lo:101:mount.lustre.0 Request processed in 138us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843722.199701:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788843722.201683:0:17881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fbb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134499328:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843722.201715:0:17881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d22dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d22e3 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843722.201728:0:17881:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d22dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d22e3 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788843722.203632:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788843722.203642:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788843722.203646:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788843722.203649:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788843722.205221:0:17881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134499456:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788843722.205558:0:17881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843722.205652:0:17881:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd104a356c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843722.208904:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134499456 00000100:00100000:3.0:1788843722.208921:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134499456 00000100:00100000:3.0:1788843722.209041:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788843722.209053:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+16:17881:x1875738134499456:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788843722.209618:0:17145:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788843722.209646:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788843722.209649:0:17145:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788843722.209894:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+16:17881:x1875738134499456:12345-0@lo:256:mount.lustre.0 Request processed in 842us (4336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843722.209904:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788843722.210026:0:17881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134499456:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788843722.211250:0:17881:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788843722.211412:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d22dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d22e3 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.211428:0:17881:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d22dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d22e3 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843722.211447:0:17881:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd10f7b9800 from 1 10000000:01000000:0.0:1788843722.211450:0:17881:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788843722.211492:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3c600/0xa762dfcbd58d22ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.211501:0:17881:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3c600/0xa762dfcbd58d22ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.211511:0:17881:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3c600/0xa762dfcbd58d22ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843722.211536:0:17881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134499584:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788843722.211593:0:17881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843722.212117:0:17881:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd110decb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788843722.212416:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134499584 00000100:00100000:2.0:1788843722.212426:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134499584 00000100:00100000:2.0:1788843722.212477:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788843722.212485:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+16:17881:x1875738134499584:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843722.212500:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843722.212516:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007946000/0xa762dfcbd58d22f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d22ea expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843722.212545:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007946000/0xa762dfcbd58d22f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d22ea expref: 17 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843722.212555:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007946000/0xa762dfcbd58d22f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d22ea expref: 17 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843722.212564:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007946000, rc 0) 00000100:00100000:2.0:1788843722.212611:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+17:17881:x1875738134499584:12345-0@lo:101:mount.lustre.0 Request processed in 126us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843722.212617:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788843722.212714:0:17881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134499584:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788843722.212730:0:17881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3c600/0xa762dfcbd58d22ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d22f1 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.212739:0:17881:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3c600/0xa762dfcbd58d22ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d22f1 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788843722.214632:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788843722.214686:0:17881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134499712:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788843722.214744:0:17881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843722.214788:0:17881:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd110dec180 going to sleep for 11 seconds 00000100:00100000:2.0:1788843722.214935:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134499712 00000100:00100000:2.0:1788843722.214943:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134499712 00000100:00100000:2.0:1788843722.215000:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788843722.215010:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+17:17881:x1875738134499712:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843722.215239:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+17:17881:x1875738134499712:12345-0@lo:501:mount.lustre.0 Request processed in 230us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843722.215247:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788843722.215555:0:17881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134499712:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788843722.215598:0:17881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134499840:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788843722.215645:0:17881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843722.215687:0:17881:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd104a356c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843722.215746:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134499840 00000100:00100000:2.0:1788843722.215750:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134499840 00000100:00100000:2.0:1788843722.215788:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788843722.215904:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+17:17881:x1875738134499840:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788843722.216000:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+17:17881:x1875738134499840:12345-0@lo:503:mount.lustre.0 Request processed in 205us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843722.216008:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788843722.216265:0:17881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134499840:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788843722.217316:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788843722.217422:0:17881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134499968:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843722.217486:0:17881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843722.217524:0:17881:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1011ca3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843722.217694:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134499968 00000100:00100000:0.0:1788843722.217701:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134499968 00000100:00100000:0.0:1788843722.217752:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788843722.217761:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+17:17881:x1875738134499968:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788843722.217874:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+17:17881:x1875738134499968:12345-0@lo:502:mount.lustre.0 Request processed in 114us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843722.217882:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788843722.218040:0:17881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134499968:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788843722.218413:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788843722.218443:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1788843722.218459:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1788843722.218475:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1788843722.218488:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1788843722.218499:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1788843722.218513:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1788843722.218542:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1788843722.218556:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788843722.218569:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1788843722.218582:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1788843722.218611:0:17881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134500096:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843722.218654:0:17881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843722.218684:0:17881:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1011ca3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843722.218809:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134500096 00000100:00100000:0.0:1788843722.218814:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134500096 00000100:00100000:0.0:1788843722.218846:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788843722.218853:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+17:17881:x1875738134500096:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788843722.218922:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+17:17881:x1875738134500096:12345-0@lo:502:mount.lustre.0 Request processed in 69us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843722.218929:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788843722.219048:0:17881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134500096:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788843722.219170:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1788843722.219178:0:17881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788843722.219959:0:17895:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788843722.219969:0:17895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843722.219971:0:17895:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788843722.219979:0:17895:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd10f7b9800 00000020:00000080:2.0:1788843722.219982:0:17895:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788843722.219989:0:17895:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843722.219992:0:17895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843722.219994:0:17895:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788843722.219996:0:17895:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788843722.219998:0:17895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843722.219999:0:17895:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788843722.220002:0:17895:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd10f7b9800 00000020:00000080:2.0:1788843722.220004:0:17895:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788843722.220204:0:17895:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843722.220209:0:17895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843722.220210:0:17895:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788843722.220213:0:17895:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788843722.220215:0:17895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843722.220217:0:17895:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788843722.220220:0:17895:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd10f7b9800 00000020:00000080:2.0:1788843722.220222:0:17895:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788843722.220244:0:17895:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843722.220247:0:17895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843722.220248:0:17895:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788843722.220250:0:17895:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788843722.220252:0:17895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843722.220254:0:17895:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788843722.220264:0:17895:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd10f7b9800 00000020:00000080:2.0:1788843722.220266:0:17895:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788843722.220380:0:17895:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843722.220384:0:17895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843722.220386:0:17895:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788843722.220389:0:17895:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:1.0:1788843722.221285:0:17881:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788843722.221323:0:17881:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788843722.221346:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3c600/0xa762dfcbd58d22ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d22f1 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843722.221381:0:17881:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3c600/0xa762dfcbd58d22ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d22f1 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843722.221437:0:17881:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788843722.221441:0:17881:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bd10f7b9800 10000000:01000000:1.0:1788843722.221444:0:17881:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bd10f7b9800 10000000:01000000:1.0:1788843722.221448:0:17881:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788843722.221454:0:17881:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd10f7b9800 from 1 10000000:01000000:1.0:1788843722.221457:0:17881:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788843722.221497:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeaa00/0xa762dfcbd58d22f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843722.221504:0:17881:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeaa00/0xa762dfcbd58d22f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843722.221515:0:17881:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeaa00/0xa762dfcbd58d22f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843722.221540:0:17881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134500224:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788843722.221606:0:17881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843722.221655:0:17881:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1011ca600 going to sleep for 11 seconds 00000100:00100000:0.0:1788843722.222404:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134500224 00000100:00100000:0.0:1788843722.222415:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134500224 00000100:00100000:0.0:1788843722.222471:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788843722.222480:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+17:17881:x1875738134500224:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788843722.222494:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843722.222509:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd10fa3c400/0xa762dfcbd58d22ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d22f8 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.222536:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd10fa3c400/0xa762dfcbd58d22ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d22f8 expref: 18 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.222547:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd10fa3c400/0xa762dfcbd58d22ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d22f8 expref: 18 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.222557:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3c400, rc 0) 00000100:00100000:0.0:1788843722.222615:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+18:17881:x1875738134500224:12345-0@lo:101:mount.lustre.0 Request processed in 136us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843722.222630:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788843722.222685:0:17881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134500224:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788843722.222702:0:17881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeaa00/0xa762dfcbd58d22f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d22ff expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.222712:0:17881:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeaa00/0xa762dfcbd58d22f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d22ff expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788843722.236595:0:17881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1788843722.236935:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788843722.237244:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788843722.238010:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:0.0:1788843722.238048:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:0.0:1788843722.238130:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:0.0:1788843722.239409:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:0.0:1788843722.239434:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:0.0:1788843722.239450:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:0.0:1788843722.239466:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:0.0:1788843722.239481:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:0.0:1788843722.239492:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:0.0:1788843722.239507:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:0.0:1788843722.239523:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:0.0:1788843722.239556:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:0.0:1788843722.239572:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:0.0:1788843722.239584:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:0.0:1788843722.239600:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:0.0:1788843722.239612:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:0.0:1788843722.239626:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:0.0:1788843722.239640:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:0.0:1788843722.239656:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:0.0:1788843722.239680:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:0.0:1788843722.239694:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:0.0:1788843722.239709:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:0.0:1788843722.239724:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:0.0:1788843722.239740:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:0.0:1788843722.239752:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:0.0:1788843722.239766:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:0.0:1788843722.239779:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:0.0:1788843722.243203:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:0.0:1788843722.243224:0:17881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1788843722.244670:0:17881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134500352:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788843722.244752:0:17881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843722.244834:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134500352 00000100:00100000:0.0:1788843722.244843:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134500352 00000100:00100000:0.0:1788843722.244899:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788843722.244910:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+18:17881:x1875738134500352:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788843722.245046:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+18:17881:x1875738134500352:12345-0@lo:501:mount.lustre.0 Request processed in 138us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843722.245055:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788843722.247420:0:17881:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd110dec600 going to sleep for 11 seconds 00000100:00100000:0.0:1788843722.247467:0:17881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134500352:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788843722.247915:0:17881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134500480:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788843722.247992:0:17881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843722.248043:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134500480 00000100:00100000:0.0:1788843722.248051:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134500480 00000100:00100000:3.0:1788843722.249250:0:17881:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd110dec600 going to sleep for 11 seconds 00000100:00100000:0.0:1788843722.249289:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788843722.249303:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+18:17881:x1875738134500480:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788843722.249473:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+18:17881:x1875738134500480:12345-0@lo:503:mount.lustre.0 Request processed in 173us (1480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843722.249487:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788843722.249531:0:17881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134500480:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788843722.250162:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788843722.250248:0:17881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b69180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134500608:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788843722.250379:0:17881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843722.258840:0:17881:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13dffc480 going to sleep for 11 seconds 00000100:00100000:2.0:1788843722.258900:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134500608 00000100:00100000:2.0:1788843722.258912:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134500608 00000100:00100000:2.0:1788843722.258974:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788843722.258985:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+18:17881:x1875738134500608:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843722.259634:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+18:17881:x1875738134500608:12345-0@lo:502:mount.lustre.0 Request processed in 648us (9252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843722.259644:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788843722.259657:0:17881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b69180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134500608:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788843722.260280:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788843722.260400:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:3.0:1788843722.260418:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:3.0:1788843722.260432:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:3.0:1788843722.260448:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:3.0:1788843722.260462:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:3.0:1788843722.260477:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:3.0:1788843722.260491:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:3.0:1788843722.260506:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:3.0:1788843722.260539:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:3.0:1788843722.260557:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:3.0:1788843722.260572:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:3.0:1788843722.260585:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:3.0:1788843722.260597:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:3.0:1788843722.260612:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:3.0:1788843722.260626:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:3.0:1788843722.260642:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:3.0:1788843722.260656:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:3.0:1788843722.260670:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:3.0:1788843722.260684:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:3.0:1788843722.260699:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:3.0:1788843722.260714:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:3.0:1788843722.260729:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:3.0:1788843722.260745:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:3.0:1788843722.260762:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:3.0:1788843722.260793:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:3.0:1788843722.260810:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:3.0:1788843722.263193:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:3.0:1788843722.263240:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:3.0:1788843722.263257:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:3.0:1788843722.263271:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:3.0:1788843722.263284:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:3.0:1788843722.263474:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:3.0:1788843722.263488:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1788843722.263501:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1788843722.263514:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1788843722.263528:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1788843722.263542:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1788843722.263557:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1788843722.263570:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1788843722.263584:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1788843722.263620:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1788843722.263638:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1788843722.263652:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1788843722.263666:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1788843722.263680:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1788843722.263695:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1788843722.263711:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1788843722.264551:0:17881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b69180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134500736:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788843722.264648:0:17881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843722.264707:0:17881:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13dffc480 going to sleep for 11 seconds 00000100:00100000:0.0:1788843722.264809:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134500736 00000100:00100000:0.0:1788843722.264817:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134500736 00000100:00100000:0.0:1788843722.264880:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788843722.264890:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+18:17881:x1875738134500736:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788843722.265049:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+18:17881:x1875738134500736:12345-0@lo:502:mount.lustre.0 Request processed in 159us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843722.265068:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788843722.265532:0:17881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b69180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134500736:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788843722.265754:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:0.0:1788843722.265782:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:0.0:1788843722.265815:0:17881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134500864:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788843722.265874:0:17881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843722.265890:0:17881:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd110dec300 going to sleep for 11 seconds 00000100:00100000:1.0:1788843722.266489:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134500864 00000100:00100000:1.0:1788843722.266498:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134500864 00000100:00100000:1.0:1788843722.266555:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788843722.266565:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+18:17881:x1875738134500864:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843722.266686:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+18:17881:x1875738134500864:12345-0@lo:502:mount.lustre.0 Request processed in 122us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843722.266707:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788843722.266817:0:17881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134500864:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788843722.266881:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:0.0:1788843722.266891:0:17881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788843722.267771:0:17900:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1788843722.267788:0:17900:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9bd13e91cd28) 00000020:00000080:0.0:1788843722.267809:0:17900:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1788843722.267902:0:17900:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd10f7b9800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788843722.267907:0:17900:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd10f7b9800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788843722.267909:0:17900:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd10f7b9800 3 00010000:00080000:0.0:1788843722.267945:0:17900:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd13fab9800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.133@tcp at head 00010000:00010000:1.0:1788843722.270785:0:17900:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1788843722.271166:0:17900:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788843722.271217:0:17900:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788843722.271230:0:17900:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xa762dfcbd58d230d 00000100:00080000:1.0:1788843722.271242:0:17900:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788843722.271247:0:17900:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9bd13fab9800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:1.0:1788843722.271302:0:17900:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd00776a680 x1875738134500992/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788843722.271329:0:17900:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788843722.271668:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875738134500992:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788843722.271758:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788843722.271815:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788843722.271819:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788843722.271822:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788843722.271836:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788843722.272104:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134500992 00000100:00100000:1.0:1788843722.272113:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134500992 00000100:00100000:1.0:1788843722.272176:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788843722.272185:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3629:x1875738134500992:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788843722.272210:0:17150:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 500 last 0 00000020:00000080:1.0:1788843722.272409:0:17150:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xa762dfcbd58d2314 00000004:00100000:1.0:1788843722.272423:0:17150:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788843722.272457:0:17150:0:(import.c:65:import_set_state_nolock()) ffff9bd0059c6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843722.272518:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1875738134500992:12345-0@lo:38:llog_process_th.0 Request processed in 332us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843722.272525:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788843722.272638:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bd00776a680 x1875738134500992/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788843732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843722.272648:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788843722.272656:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788843722.272665:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788843722.272670:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788843722.272672:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd13fab9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788843722.272678:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875738134500992:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788843722.275662:0:17900:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:1.0:1788843722.276391:0:17881:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788843722.276420:0:17881:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788843722.276477:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeaa00/0xa762dfcbd58d22f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d22ff expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843722.276492:0:17881:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeaa00/0xa762dfcbd58d22f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d22ff expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788843722.276556:0:17881:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788843722.276559:0:17881:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788843722.276560:0:17881:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788843722.276562:0:17881:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788843722.276563:0:17881:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788843722.276564:0:17881:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788843722.276566:0:17881:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788843722.276568:0:17881:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788843722.276569:0:17881:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788843722.276573:0:17881:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1788843722.276576:0:17881:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788843722.276577:0:17881:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788843722.276578:0:17881:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788843722.276579:0:17881:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788843722.276580:0:17881:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788843722.276581:0:17881:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788843722.276583:0:17881:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788843722.276584:0:17881:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788843722.276585:0:17881:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788843722.276612:0:17881:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788843722.276633:0:17881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134501120:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788843722.276703:0:17881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843722.276751:0:17881:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd136c603c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843722.276919:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134501120 00000100:00100000:0.0:1788843722.276927:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134501120 00000100:00100000:0.0:1788843722.276977:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788843722.276987:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+18:17881:x1875738134501120:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788843722.277024:0:17144:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788843722.277080:0:17144:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1788843722.285069:0:17130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788843722.285108:0:17144:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788843722.285117:0:17144:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1788843722.285191:0:17165:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788843722.285196:0:17165:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788843722.285231:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd10fa3c200/0xa762dfcbd58d231b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.285251:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd007be2c00/0xa762dfcbd58d221f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2218 expref: 18 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.285259:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd13fbeb600/0xa762dfcbd58d22e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d22dc expref: 18 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.285266:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd10fa3c200/0xa762dfcbd58d231b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.285319:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd13fbeb600/0xa762dfcbd58d22e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d22dc expref: 18 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.285336:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd13fbeb600/0xa762dfcbd58d22e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d22dc expref: 18 pid: 17142 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843722.285362:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17165:1875738134501248:0@lo:104: 00000100:00100000:0.0:1788843722.285433:0:17165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788843722.285486:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd007be2c00/0xa762dfcbd58d221f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d2218 expref: 18 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.285494:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd007be2c00/0xa762dfcbd58d221f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d2218 expref: 18 pid: 17145 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843722.285503:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17165:1875738134501376:0@lo:104: 00000100:00100000:0.0:1788843722.285524:0:17165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843722.285541:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd110dec600 going to sleep for 11 seconds 00000100:00100000:0.0:1788843722.285577:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134501248 00000100:00100000:0.0:1788843722.285585:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134501248 00000100:00100000:0.0:1788843722.285627:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134501376 00000100:00100000:0.0:1788843722.285631:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134501376 00000100:00100000:0.0:1788843722.285646:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788843722.285656:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20b96c6c-8494-483a-b913-89dfc06b1440+4:17165:x1875738134501248:12345-0@lo:104: 00010000:00010000:0.0:1788843722.285669:0:17134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d22dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d22e3 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.285723:0:17134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788843722.285729:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20b96c6c-8494-483a-b913-89dfc06b1440+4:17165:x1875738134501248:12345-0@lo:104: Request processed in 75us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843722.285736:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788843722.285753:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788843722.285759:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20b96c6c-8494-483a-b913-89dfc06b1440+3:17165:x1875738134501376:12345-0@lo:104: 00010000:00010000:0.0:1788843722.285766:0:17134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeae00/0xa762dfcbd58d2218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d221f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.285796:0:17134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788843722.285801:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20b96c6c-8494-483a-b913-89dfc06b1440+3:17165:x1875738134501376:12345-0@lo:104: Request processed in 44us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843722.285806:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788843722.285853:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17165:1875738134501248:0@lo:104: 00000100:00100000:0.0:1788843722.285863:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17165:1875738134501376:0@lo:104: 00010000:00010000:0.0:1788843722.285884:0:17165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd10fa3c200/0xa762dfcbd58d231b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.285904:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788843722.285911:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d22dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d22e3 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.285929:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946200 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:0.0:1788843722.285933:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d22dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d22e3 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.285942:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d22dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d22e3 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843722.285949:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d22dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d22e3 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843722.285955:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788843722.285985:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d22dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d22e3 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.285992:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843722.286010:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d22dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d22e3 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.286017:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d22dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d22e3 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.286029:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843722.286033:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeae00/0xa762dfcbd58d2218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d221f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.286038:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbeae00 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:0.0:1788843722.286041:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeae00/0xa762dfcbd58d2218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d221f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.286058:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeae00/0xa762dfcbd58d2218 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d221f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843722.286063:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeae00/0xa762dfcbd58d2218 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d221f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843722.286068:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788843722.286081:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeae00/0xa762dfcbd58d2218 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d221f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.286086:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843722.286102:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeae00/0xa762dfcbd58d2218 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d221f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.286109:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeae00/0xa762dfcbd58d2218 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d221f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.286122:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843722.286124:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843722.286125:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843722.286131:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843722.286167:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20b96c6c-8494-483a-b913-89dfc06b1440:3631:1875738134501504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788843722.286198:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843722.286233:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20b96c6c-8494-483a-b913-89dfc06b1440:3632:1875738134501632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788843722.286256:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843722.286284:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134501504 00000100:00100000:0.0:1788843722.286288:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134501504 00010000:00010000:0.0:1788843722.286306:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd13fbeb600/0xa762dfcbd58d22e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d22dc expref: 19 pid: 17142 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843722.286332:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134501632 00000100:00100000:0.0:1788843722.286335:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134501632 00010000:00010000:0.0:1788843722.286346:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd007be2c00/0xa762dfcbd58d221f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2218 expref: 20 pid: 17145 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843722.286368:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788843722.286374:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20b96c6c-8494-483a-b913-89dfc06b1440+20:3631:x1875738134501504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788843722.286385:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843722.286389:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd13fbeb600/0xa762dfcbd58d22e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d22dc expref: 20 pid: 17142 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.286399:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd13fbeb600/0xa762dfcbd58d22e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d22dc expref: 20 pid: 17142 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.286412:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd13fbeb600/0xa762dfcbd58d22e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d22dc expref: 20 pid: 17142 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.286424:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843722.286448:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20b96c6c-8494-483a-b913-89dfc06b1440+19:3631:x1875738134501504:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843722.286454:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788843722.286464:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788843722.286470:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20b96c6c-8494-483a-b913-89dfc06b1440+18:3632:x1875738134501632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788843722.286476:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843722.286479:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd007be2c00/0xa762dfcbd58d221f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2218 expref: 18 pid: 17145 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.286488:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd007be2c00/0xa762dfcbd58d221f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d2218 expref: 18 pid: 17145 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.286504:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd007be2c00/0xa762dfcbd58d221f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d2218 expref: 18 pid: 17145 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.286515:0:17135:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd10fa3c200/0xa762dfcbd58d231b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.286523:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd10fa3c200/0xa762dfcbd58d231b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788843722.286534:0:17135:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004529583s 00010000:00010000:0.0:1788843722.286539:0:17135:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd10fa3c200/0xa762dfcbd58d231b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.286546:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd10fa3c200/0xa762dfcbd58d231b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.286553:0:17135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd10fa3c200/0xa762dfcbd58d231b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.286559:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd10fa3c200/0xa762dfcbd58d231b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.286565:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3c200 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843722.286569:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd10fa3c200/0xa762dfcbd58d231b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.286577:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd10fa3c200/0xa762dfcbd58d231b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.286587:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd10fa3c200/0xa762dfcbd58d231b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.286599:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843722.286619:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20b96c6c-8494-483a-b913-89dfc06b1440+17:3632:x1875738134501632:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843722.286626:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788843722.286651:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20b96c6c-8494-483a-b913-89dfc06b1440:3631:1875738134501504:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788843722.286665:0:17165:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd10fa3c200/0xa762dfcbd58d231b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.286673:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd10fa3c200/0xa762dfcbd58d231b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843722.286679:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd10fa3c200/0xa762dfcbd58d231b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843722.286702:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20b96c6c-8494-483a-b913-89dfc06b1440:3632:1875738134501632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788843722.287446:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+16:17881:x1875738134501120:12345-0@lo:253:mount.lustre.0 Request processed in 10458us (10740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843722.287456:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788843722.287498:0:17881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:17881:1875738134501120:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788843722.287508:0:17881:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788843722.287511:0:17881:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788843722.287512:0:17881:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788843722.287514:0:17881:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788843722.287515:0:17881:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788843722.287517:0:17881:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788843722.287518:0:17881:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788843722.287520:0:17881:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788843722.287522:0:17881:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788843722.287528:0:17881:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788843722.287538:0:17881:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:0.0:1788843722.293973:0:17881:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1788843722.294071:0:17904:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1788843722.294074:0:17904:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788843722.298982:0:17905:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1788843722.299635:0:17905:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788843722.301854:0:17905:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788843722.301937:0:17905:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:01000000:1.0:1788843722.302517:0:17881:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1788843722.307562:0:17907:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fbb800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17907:1875738134501760:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788843722.307640:0:17907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843722.307690:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134501760 00000100:00100000:2.0:1788843722.307698:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134501760 00000100:00100000:2.0:1788843722.307747:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788843722.307757:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17907:x1875738134501760:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788843722.307852:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17907:x1875738134501760:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 96us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843722.307860:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788843722.307884:0:17907:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1330af900 going to sleep for 11 seconds 00000100:00100000:2.0:1788843722.307909:0:17907:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fbb800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17907:1875738134501760:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1788843722.307947:0:17907:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788843722.307970:0:17907:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fbb800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17907:1875738134501888:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788843722.307999:0:17907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843722.308020:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134501888 00000100:00100000:2.0:1788843722.308024:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134501888 00000100:00100000:2.0:1788843722.308046:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788843722.308053:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17907:x1875738134501888:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788843722.308180:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17907:x1875738134501888:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 127us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843722.308187:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788843722.308205:0:17907:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13df3e900 going to sleep for 11 seconds 00000100:00100000:2.0:1788843722.308218:0:17907:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fbb800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17907:1875738134501888:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788843722.308264:0:17907:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fbb800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17907:1875738134502016:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788843722.308418:0:17907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843722.308444:0:17907:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13df3e840 going to sleep for 11 seconds 00000040:01000000:1.0:1788843722.308742:0:17881:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788843722.308780:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788843722.309441:0:17881:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788843722.309451:0:17881:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788843722.309493:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788843722.312981:0:17881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:3.0:1788843722.314441:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134502016 00000100:00100000:3.0:1788843722.314457:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134502016 00000040:00080000:1.0:1788843722.314794:0:17881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788843722.314859:0:17881:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1788843722.314996:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788843722.316099:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788843722.316116:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17907:x1875738134502016:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788843722.316250:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17907:x1875738134502016:12345-0@lo:900:lod0001_rec0000.0 Request processed in 140us (7831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843722.316259:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00080000:10000000:1.0:1788843722.316736:0:17881:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00010000:00080000:0.0:1788843722.317571:0:17907:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bd102fbb800 x1875738134502016/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788843738 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843722.317588:0:17907:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fbb800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17907:1875738134502016:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788843722.317665:0:17907:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e0a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17907:1875738134502144:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788843722.317723:0:17907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843722.317756:0:17907:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd111699b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788843722.319562:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134502144 00000100:00100000:2.0:1788843722.319576:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134502144 00000100:00100000:2.0:1788843722.319635:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788843722.319645:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17907:x1875738134502144:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788843722.319761:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17907:x1875738134502144:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 117us (2037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843722.319770:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788843722.319818:0:17907:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e0a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17907:1875738134502144:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1788843722.319882:0:17907:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00000004:3.0:1788843722.323544:0:17881:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000040:00080000:2.0:1788843722.324537:0:17907:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788843722.324620:0:17907:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788843722.324625:0:17907:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:3.0:1788843722.336800:0:17881:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788843722.336841:0:17881:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb2dcc198f988 00100000:10000000:3.0:1788843722.336849:0:17881:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1788843722.337886:0:17881:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788843722.337936:0:17881:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.133@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788843722.337954:0:17881:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788843722.337972:0:17881:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1788843722.338736:0:17881:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788843722.338928:0:17881:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788843722.586328:0:17191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e9c4b40 going to sleep for 0 seconds 00010000:00010000:0.0:1788843723.111418:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788843723.355740:0:17908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1788843723.418551:0:17147:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788843723.418560:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd10f7b9800 from 8 10000000:01000000:3.0:1788843723.418565:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788843723.418623:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007be3c00/0xa762dfcbd58d2322 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843723.418635:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd007be3c00/0xa762dfcbd58d2322 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843723.418648:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd007be3c00/0xa762dfcbd58d2322 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843723.418677:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b68a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134502272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788843723.418754:0:17147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843723.418826:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e9363c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843723.419164:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134502272 00000100:00100000:2.0:1788843723.419174:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134502272 00000100:00100000:2.0:1788843723.419242:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788843723.419255:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+16:17147:x1875738134502272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843723.419270:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843723.419286:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007947c00/0xa762dfcbd58d2329 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2322 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843723.419313:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007947c00/0xa762dfcbd58d2329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2322 expref: 17 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843723.419325:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007947c00/0xa762dfcbd58d2329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2322 expref: 17 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843723.419336:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007947c00, rc 0) 00000100:00100000:2.0:1788843723.419405:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+17:17147:x1875738134502272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843723.419412:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788843723.419481:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b68a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134502272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843723.419502:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd007be3c00/0xa762dfcbd58d2322 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2329 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843723.419513:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd007be3c00/0xa762dfcbd58d2322 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2329 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843723.419574:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134502400:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788843723.419610:0:17147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843723.419643:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd111590a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788843723.419752:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134502400 00000100:00100000:1.0:1788843723.419757:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134502400 00000100:00100000:1.0:1788843723.419789:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788843723.419796:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12eb04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+17:17147:x1875738134502400:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788843723.419810:0:17144:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788843723.419825:0:17144:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788843723.419828:0:17144:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788843723.419920:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12eb04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+17:17147:x1875738134502400:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 124us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843723.419927:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788843723.421163:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134502400:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788843723.421220:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788843723.421230:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007be3c00/0xa762dfcbd58d2322 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2329 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843723.421241:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007be3c00/0xa762dfcbd58d2322 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2329 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843723.421254:0:17147:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788843723.421263:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd137acd000 from 8 10000000:01000000:2.0:1788843723.421267:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788843723.421299:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d2330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843723.421308:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d2330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843723.421317:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d2330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843723.421335:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fbb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134502528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788843723.421390:0:17147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843723.421436:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13df3ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843723.421489:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134502528 00000100:00100000:3.0:1788843723.421496:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134502528 00000100:00100000:3.0:1788843723.421543:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788843723.421554:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12eb05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+17:17147:x1875738134502528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843723.421565:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843723.421585:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007be2600/0xa762dfcbd58d2337 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2330 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843723.421609:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007be2600/0xa762dfcbd58d2337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2330 expref: 18 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843723.421619:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007be2600/0xa762dfcbd58d2337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2330 expref: 18 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843723.421629:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be2600, rc 0) 00000100:00100000:3.0:1788843723.421675:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12eb05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+18:17147:x1875738134502528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843723.421682:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788843723.421754:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fbb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134502528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843723.421767:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d2330 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2337 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843723.421775:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d2330 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2337 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843723.421822:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fbb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134502656:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788843723.421857:0:17147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843723.421887:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13df3ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843723.422080:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134502656 00000100:00100000:1.0:1788843723.422085:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134502656 00000100:00100000:1.0:1788843723.422133:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788843723.422816:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12eb06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+18:17147:x1875738134502656:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788843723.422838:0:17145:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788843723.422853:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788843723.422856:0:17145:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788843723.422951:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12eb06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+18:17147:x1875738134502656:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 144us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843723.422959:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788843723.423006:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fbb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134502656:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788843723.423051:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788843723.423061:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d2330 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2337 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843723.423071:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d2330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2337 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843723.617699:0:17191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e9c4b40 going to sleep for 0 seconds 00010000:00010000:0.0:1788843724.124392:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788843724.378980:0:17908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788843724.635219:0:17191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e9c4b40 going to sleep for 0 seconds 00010000:00010000:3.0:1788843725.148635:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843725.658326:0:17191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e9c4b40 going to sleep for 0 seconds 00010000:00010000:0.0:1788843726.171282:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843726.686725:0:17191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e9c4b40 going to sleep for 0 seconds 00000001:02000400:2.0:1788843727.007191:0:18150:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg333-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788843727.194658:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843727.258630:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134502784:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788843727.258706:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843727.258780:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134502784 00000100:00100000:1.0:1788843727.258788:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134502784 00000100:00100000:1.0:1788843727.258838:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788843727.258848:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134502784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788843727.258885:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788843727.258934:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134502784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843727.258942:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788843727.258990:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134502784:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788843727.709211:0:17191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e9c4b40 going to sleep for 0 seconds 00000100:00080000:2.0:1788843727.772432:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788843727.772439:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788843727.772443:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bd12e2ab000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788843727.772471:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9bd12e2ab000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:2.0:1788843727.772502:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd102fbbb80 x1875738134503040/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788843727.772520:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788843727.772524:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788843727.772527:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788843727.772530:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788843727.772541:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788843727.772545:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788843727.772547:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788843727.772549:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788843727.772672:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1875738134503168:0@lo:400:kworker.0 00000100:00100000:3.0:1788843727.772746:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843727.772817:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788843727.772824:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20b96c6c-8494-483a-b913-89dfc06b1440:3631:1875738134502912:0@lo:400:kworker.0 00000100:00100000:3.0:1788843727.772852:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843727.773070:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134503040:0@lo:38:kworker.0 00000100:00100000:1.0:1788843727.773100:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843727.773170:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134503296:0@lo:400:kworker.0 00000100:00100000:1.0:1788843727.773197:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843727.773236:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134502912 00000100:00100000:1.0:1788843727.773244:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134502912 00000100:00100000:1.0:1788843727.773294:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788843727.773304:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12eb06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+18:3631:x1875738134502912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843727.773446:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134503168 00000100:00100000:0.0:1788843727.773450:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134503168 00000100:00100000:0.0:1788843727.773478:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134503296 00000100:00100000:0.0:1788843727.773481:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134503296 00000100:00100000:0.0:1788843727.773496:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788843727.773503:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1875738134503168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843727.773550:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1875738134503168:12345-0@lo:400:kworker.0 Request processed in 48us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843727.773557:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788843727.773576:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788843727.773581:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134503296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843727.773610:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134503296:12345-0@lo:400:kworker.0 Request processed in 29us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843727.773616:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788843727.773724:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134503040 00000100:00100000:3.0:1788843727.773727:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134503040 00000100:00100000:3.0:1788843727.773757:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788843727.773762:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3629:x1875738134503040:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788843727.773787:0:17890:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 505 last 0 00000020:00000080:3.0:1788843727.773943:0:17890:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa762dfcbd58d233e 00000004:00100000:3.0:1788843727.773964:0:17890:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788843727.773977:0:17890:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00080000:3.0:1788843727.774081:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd102fba300 x1875738134503168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843727.774100:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1875738134503168:0@lo:400:kworker.0 00000100:00100000:1.0:1788843727.774401:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12eb06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+18:3631:x1875738134502912:12345-0@lo:400:kworker.0 Request processed in 1097us (1546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843727.774409:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1788843727.774687:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd102fb9f80 x1875738134503296/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843727.774710:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134503296:0@lo:400:kworker.0 00000100:00100000:3.0:1788843727.775330:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20b96c6c-8494-483a-b913-89dfc06b1440:3631:1875738134502912:0@lo:400:kworker.0 00000100:00080000:3.0:1788843727.789401:0:17890:0:(import.c:65:import_set_state_nolock()) ffff9bd13fab8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788843727.789512:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3629:x1875738134503040:12345-0@lo:38:kworker.0 Request processed in 15745us (16407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843727.789525:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788843727.789613:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788843727.789630:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788843727.789638:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788843727.789642:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd12e2ab000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788843727.789680:0:3629:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000004b20b390): req@ffff9bd102fbaa00 x1875738134495488/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843727.789704:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134503040:0@lo:38:kworker.0 00000100:00100000:1.0:1788843727.789934:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134503424:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788843727.789940:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843727.790064:0:17191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e9c4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788843727.790130:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843727.796430:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134495488 00000100:00100000:2.0:1788843727.796449:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134495488 00000100:00100000:0.0:1788843727.796506:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134503424 00000100:00100000:0.0:1788843727.796512:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134503424 00000100:00100000:2.0:1788843727.796728:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788843727.796740:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17191:x1875738134495488:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788843727.796885:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17191:x1875738134495488:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 148us (6950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843727.796892:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788843727.796910:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788843727.796916:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3633:x1875738134503424:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788843727.797657:0:17191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fbaa00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17191:1875738134495488:0@lo:1000:lod0000_rec0001.0 00000004:00000024:2.0:1788843727.797699:0:17154:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000040:01000000:1.0:1788843727.797709:0:17191:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788843727.797761:0:17191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776ad80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17191:1875738134503552:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788843727.797768:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3633:x1875738134503424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 849us (7637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843727.797806:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843727.797914:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788843727.800714:0:17191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd104a35000 going to sleep for 11 seconds 00000100:00100000:0.0:1788843727.804696:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134503552 00000100:00100000:0.0:1788843727.804712:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134503552 00000100:00100000:2.0:1788843727.804975:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134503424:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788843727.805576:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788843727.805587:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17191:x1875738134503552:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788843727.805765:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17191:x1875738134503552:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 178us (7958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843727.805773:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788843727.806046:0:17191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776ad80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17191:1875738134503552:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788843727.806168:0:17191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776ad80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17191:1875738134503680:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788843727.806205:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843727.806236:0:17191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd104a35000 going to sleep for 11 seconds 00000100:00100000:3.0:1788843727.806586:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134503680 00000100:00100000:3.0:1788843727.806594:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134503680 00000100:00100000:3.0:1788843727.806631:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788843727.806640:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17191:x1875738134503680:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788843727.806710:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17191:x1875738134503680:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 71us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843727.806716:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788843727.807044:0:17191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776ad80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17191:1875738134503680:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788843727.807095:0:17191:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788843727.809546:0:17191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788843727.809647:0:17191:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:1.0:1788843727.809653:0:17191:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:1.0:1788843728.005510:0:18203:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788843728.005714:0:18203:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788843728.223931:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788843728.922955:0:18254:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788843728.923618:0:18254:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788843729.243005:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788843730.033713:0:18302:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe5bc47630 20000000:00000080:1.0:1788843730.033732:0:18302:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bd124e06000 uarg=0000000000000000 20000000:01000000:1.0:1788843730.033771:0:18302:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788843730.033779:0:18302:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788843730.033784:0:18302:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788843730.034655:0:18303:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1788843730.034830:0:18302:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788843730.041866:0:18302:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788843730.041899:0:18302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd13fbea800/0xa762dfcbd58d2345 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843730.041921:0:18302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd007946c00/0xa762dfcbd58d21ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d21e7 expref: 17 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843730.041928:0:18302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd007946000/0xa762dfcbd58d22f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d22ea expref: 17 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843730.041936:0:18302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd13fbea800/0xa762dfcbd58d2345 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843730.042054:0:18302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd007946000/0xa762dfcbd58d22f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d22ea expref: 17 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843730.042073:0:18302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd007946000/0xa762dfcbd58d22f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d22ea expref: 17 pid: 17142 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843730.042088:0:18302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18302:1875738134503808:0@lo:104: 00000100:00100000:1.0:1788843730.042471:0:18302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788843730.042546:0:18302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd007946c00/0xa762dfcbd58d21ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d21e7 expref: 17 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843730.042556:0:18302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd007946c00/0xa762dfcbd58d21ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d21e7 expref: 17 pid: 17142 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843730.042565:0:18302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18302:1875738134503936:0@lo:104: 00000100:00100000:1.0:1788843730.042591:0:18302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843730.042615:0:18302:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd104a35000 going to sleep for 11 seconds 00000100:00100000:3.0:1788843730.042671:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134503808 00000100:00100000:3.0:1788843730.042679:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134503808 00000100:00100000:3.0:1788843730.042720:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134503936 00000100:00100000:3.0:1788843730.042723:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134503936 00000100:00100000:3.0:1788843730.042738:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788843730.042747:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007768a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20b96c6c-8494-483a-b913-89dfc06b1440+4:18302:x1875738134503808:12345-0@lo:104: 00010000:00010000:3.0:1788843730.042770:0:17134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3c600/0xa762dfcbd58d22ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d22f1 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843730.042842:0:17134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788843730.042849:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007768a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20b96c6c-8494-483a-b913-89dfc06b1440+4:18302:x1875738134503808:12345-0@lo:104: Request processed in 103us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843730.042856:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788843730.042875:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788843730.042882:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20b96c6c-8494-483a-b913-89dfc06b1440+3:18302:x1875738134503936:12345-0@lo:104: 00010000:00010000:3.0:1788843730.042889:0:17134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd13fbebc00/0xa762dfcbd58d21e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d21ee expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843730.042919:0:17134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788843730.042924:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20b96c6c-8494-483a-b913-89dfc06b1440+3:18302:x1875738134503936:12345-0@lo:104: Request processed in 44us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843730.042930:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788843730.042946:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788843730.042953:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3c600/0xa762dfcbd58d22ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d22f1 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843730.042961:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3c600 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:3.0:1788843730.042977:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3c600/0xa762dfcbd58d22ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d22f1 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843730.042987:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3c600/0xa762dfcbd58d22ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d22f1 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843730.042995:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3c600/0xa762dfcbd58d22ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d22f1 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843730.043010:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788843730.043045:0:17139:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3c600/0xa762dfcbd58d22ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d22f1 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843730.043051:0:17139:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843730.043071:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3c600/0xa762dfcbd58d22ea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d22f1 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843730.043078:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3c600/0xa762dfcbd58d22ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d22f1 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843730.043093:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843730.043097:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd13fbebc00/0xa762dfcbd58d21e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d21ee expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843730.043103:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbebc00 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:3.0:1788843730.043106:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd13fbebc00/0xa762dfcbd58d21e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d21ee expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843730.043113:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd13fbebc00/0xa762dfcbd58d21e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d21ee expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843730.043120:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd13fbebc00/0xa762dfcbd58d21e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d21ee expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843730.043125:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788843730.043136:0:17139:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd13fbebc00/0xa762dfcbd58d21e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d21ee expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843730.043170:0:17139:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843730.043184:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd13fbebc00/0xa762dfcbd58d21e7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d21ee expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843730.043191:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd13fbebc00/0xa762dfcbd58d21e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d21ee expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843730.043205:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843730.043207:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843730.043209:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843730.043230:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20b96c6c-8494-483a-b913-89dfc06b1440:3631:1875738134504192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843730.043261:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843730.043287:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788843730.043293:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20b96c6c-8494-483a-b913-89dfc06b1440:3631:1875738134504064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843730.043336:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843730.043583:0:18302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18302:1875738134503808:0@lo:104: 00000100:00100000:1.0:1788843730.043592:0:18302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18302:1875738134503936:0@lo:104: 00010000:00010000:1.0:1788843730.043616:0:18302:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd13fbea800/0xa762dfcbd58d2345 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843730.043688:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843730.043718:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134504192 00000100:00100000:0.0:1788843730.043724:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134504192 00010000:00010000:0.0:1788843730.043752:0:17136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd007946c00/0xa762dfcbd58d21ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d21e7 expref: 18 pid: 17142 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843730.043784:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134504064 00000100:00100000:0.0:1788843730.043788:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134504064 00010000:00010000:0.0:1788843730.043798:0:17136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd007946000/0xa762dfcbd58d22f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d22ea expref: 19 pid: 17142 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843730.043809:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788843730.043816:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20b96c6c-8494-483a-b913-89dfc06b1440+19:3631:x1875738134504192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788843730.043828:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843730.043834:0:17136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd007946c00/0xa762dfcbd58d21ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d21e7 expref: 19 pid: 17142 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843730.043843:0:17136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd007946c00/0xa762dfcbd58d21ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d21e7 expref: 19 pid: 17142 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843730.043857:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd007946c00/0xa762dfcbd58d21ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d21e7 expref: 19 pid: 17142 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843730.043870:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843730.043907:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20b96c6c-8494-483a-b913-89dfc06b1440+18:3631:x1875738134504192:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843730.043914:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788843730.043928:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788843730.043934:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20b96c6c-8494-483a-b913-89dfc06b1440+17:3631:x1875738134504064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788843730.043940:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843730.043945:0:17136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd007946000/0xa762dfcbd58d22f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d22ea expref: 17 pid: 17142 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843730.044026:0:17136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd007946000/0xa762dfcbd58d22f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d22ea expref: 17 pid: 17142 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843730.044040:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd007946000/0xa762dfcbd58d22f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d22ea expref: 17 pid: 17142 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843730.044051:0:17136:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd13fbea800/0xa762dfcbd58d2345 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843730.044059:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd13fbea800/0xa762dfcbd58d2345 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843730.044074:0:17136:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd13fbea800/0xa762dfcbd58d2345 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843730.044081:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd13fbea800/0xa762dfcbd58d2345 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843730.044087:0:17136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd13fbea800/0xa762dfcbd58d2345 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843730.044093:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd13fbea800/0xa762dfcbd58d2345 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843730.044098:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbea800 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843730.044102:0:17136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd13fbea800/0xa762dfcbd58d2345 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843730.044109:0:17136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd13fbea800/0xa762dfcbd58d2345 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843730.044131:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd13fbea800/0xa762dfcbd58d2345 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843730.044167:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843730.044193:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20b96c6c-8494-483a-b913-89dfc06b1440+16:3631:x1875738134504064:12345-0@lo:103:ldlm_bl.0 Request processed in 259us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843730.044200:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788843730.044230:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20b96c6c-8494-483a-b913-89dfc06b1440:3631:1875738134504064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788843730.044238:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20b96c6c-8494-483a-b913-89dfc06b1440:3631:1875738134504192:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788843730.044317:0:18302:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd13fbea800/0xa762dfcbd58d2345 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843730.044335:0:18302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd13fbea800/0xa762dfcbd58d2345 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843730.044341:0:18302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd13fbea800/0xa762dfcbd58d2345 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843730.267915:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788843730.725259:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788843731.290546:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788843731.738386:0:17147:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788843731.738394:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd10f7b9800 from 13 10000000:01000000:3.0:1788843731.738399:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788843731.738457:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007be2e00/0xa762dfcbd58d234c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843731.738470:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd007be2e00/0xa762dfcbd58d234c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843731.738482:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd007be2e00/0xa762dfcbd58d234c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843731.738510:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134504320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788843731.738585:0:17147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843731.738633:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd132a2c600 going to sleep for 11 seconds 00000100:00100000:0.0:1788843731.738754:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134504320 00000100:00100000:0.0:1788843731.738763:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134504320 00000100:00100000:0.0:1788843731.738827:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788843731.738838:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12eb04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+16:17147:x1875738134504320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843731.738852:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843731.738866:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd10fa3c200/0xa762dfcbd58d2353 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d234c expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843731.738894:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd10fa3c200/0xa762dfcbd58d2353 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d234c expref: 17 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843731.738904:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd10fa3c200/0xa762dfcbd58d2353 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d234c expref: 17 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843731.738914:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3c200, rc 0) 00000100:00100000:0.0:1788843731.739116:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12eb04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+17:17147:x1875738134504320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 278us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843731.739160:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788843731.744134:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134504320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843731.744194:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd007be2e00/0xa762dfcbd58d234c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2353 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843731.744208:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd007be2e00/0xa762dfcbd58d234c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2353 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843731.744446:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134504448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843731.744648:0:17147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843731.744702:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd132a2c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788843731.744863:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134504448 00000100:00100000:2.0:1788843731.744870:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134504448 00000100:00100000:2.0:1788843731.746090:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788843731.746110:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12eb07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+17:17147:x1875738134504448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843731.746428:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12eb07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+17:17147:x1875738134504448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 323us (1778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843731.746557:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134504448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843731.746608:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134504576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788843731.746662:0:17147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843731.746693:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd132a2c600 going to sleep for 11 seconds 00000100:00100000:1.0:1788843731.747033:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134504576 00000100:00100000:1.0:1788843731.747041:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134504576 00000100:00100000:2.0:1788843731.747975:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788843731.751510:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788843731.751535:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12eb04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+17:17147:x1875738134504576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788843731.751717:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12eb04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+17:17147:x1875738134504576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 194us (5054us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843731.751794:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134504576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788843731.754468:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000040:00080000:0.0:1788843731.756160:0:18371:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788843731.757360:0:17147:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788843731.757390:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788843731.757403:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007be2e00/0xa762dfcbd58d234c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2353 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843731.757416:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007be2e00/0xa762dfcbd58d234c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2353 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843731.757426:0:17147:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788843731.757429:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd137acd000 from 13 10000000:01000000:2.0:1788843731.757431:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788843731.757471:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946000/0xa762dfcbd58d235a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843731.757480:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd007946000/0xa762dfcbd58d235a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843731.757503:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd007946000/0xa762dfcbd58d235a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843731.757528:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fb9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134504704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788843731.757594:0:17147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843731.757646:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007babe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788843731.757858:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134504704 00000100:00100000:1.0:1788843731.757868:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134504704 00000100:00100000:1.0:1788843731.757933:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788843731.757945:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12eb05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+17:17147:x1875738134504704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843731.757959:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843731.757974:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd13fbeac00/0xa762dfcbd58d2361 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d235a expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843731.758003:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd13fbeac00/0xa762dfcbd58d2361 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d235a expref: 18 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843731.758014:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd13fbeac00/0xa762dfcbd58d2361 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d235a expref: 18 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843731.758024:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fbeac00, rc 0) 00000100:00100000:1.0:1788843731.758076:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12eb05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+18:17147:x1875738134504704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843731.758084:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788843731.759161:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fb9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134504704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843731.759189:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd007946000/0xa762dfcbd58d235a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2361 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843731.759202:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd007946000/0xa762dfcbd58d235a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2361 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843731.759282:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134504832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843731.759339:0:17147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843731.759376:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0077bbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788843731.759461:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134504832 00000100:00100000:1.0:1788843731.759468:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134504832 00000100:00100000:1.0:1788843731.759515:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788843731.759523:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12eb07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+18:17147:x1875738134504832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788843731.759640:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12eb07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+18:17147:x1875738134504832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843731.759648:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788843731.760197:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134504832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843731.760230:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134504960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843731.760274:0:17147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843731.760307:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0077bbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788843731.761322:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134504960 00000100:00100000:3.0:1788843731.761332:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134504960 00000100:00100000:3.0:1788843731.761383:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788843731.761391:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12eb05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+18:17147:x1875738134504960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788843731.761529:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12eb05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+18:17147:x1875738134504960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843731.761536:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788843731.763072:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134504960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788843731.765862:0:18373:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788843731.766229:0:17147:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788843731.766255:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788843731.766267:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946000/0xa762dfcbd58d235a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2361 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843731.766280:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007946000/0xa762dfcbd58d235a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2361 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843732.316483:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843732.380355:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788843732.380383:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134505088:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788843732.380460:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843732.384854:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134505088 00000100:00100000:0.0:1788843732.385063:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134505088 00000100:00100000:0.0:1788843732.385604:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788843732.385616:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134505088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788843732.385652:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788843732.385739:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134505088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (5279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843732.385762:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788843732.385818:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134505088:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788843732.890315:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843722/real 1788843722] req@ffff9bd141b6a300 x1875738134499200/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843732 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843732.890350:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd141b6a300 x1875738134499200/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843732 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843732.890361:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843722/real 1788843722] req@ffff9bd102fb8e00 x1875738134499072/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843732 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843732.890374:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd102fb8e00 x1875738134499072/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843732 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788843732.890393:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd141b67000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788843732.890404:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788843732.890408:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134499200:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788843732.890413:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd104818000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788843732.890418:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788843732.890421:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134499072:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788843732.890685:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843732.890698:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788843732.890701:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843732.890704:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788843732.890720:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843732.890723:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788843732.890726:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bd104818000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788843732.890731:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 500 00000100:00080000:1.0:1788843732.890736:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788843732.890744:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9bd104818000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:1.0:1788843732.890777:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd00776b480 x1875738134505600/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788843732.890792:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843732.890795:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788843732.890796:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bd141b67000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788843732.890799:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 500 00000100:00080000:1.0:1788843732.890801:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788843732.890805:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9bd141b67000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:1.0:1788843732.890816:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd008625180 x1875738134505728/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788843732.890850:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20b96c6c-8494-483a-b913-89dfc06b1440:3633:1875738134505216:0@lo:400:kworker.0 00000100:00100000:1.0:1788843732.890917:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843732.890961:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788843732.890967:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008627100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134505856:0@lo:400:kworker.0 00000100:00100000:1.0:1788843732.891021:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843732.891053:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134505344:0@lo:400:kworker.0 00000100:00100000:1.0:1788843732.891081:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843732.891100:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843732.891105:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134505472:0@lo:400:kworker.0 00000100:00100000:1.0:1788843732.891128:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843732.891185:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134505216 00000100:00100000:1.0:1788843732.891193:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134505216 00000100:00100000:1.0:1788843732.891244:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788843732.891254:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007745450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+18:3633:x1875738134505216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843732.891316:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007745450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+18:3633:x1875738134505216:12345-0@lo:400:kworker.0 Request processed in 63us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843732.891324:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788843732.891358:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134505856 00000100:00100000:1.0:1788843732.891362:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134505856 00000100:00100000:1.0:1788843732.891383:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134505472 00000100:00100000:1.0:1788843732.891386:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134505472 00000100:00100000:1.0:1788843732.891399:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788843732.891405:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008625f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134505856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843732.891435:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008625f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134505856:12345-0@lo:400:kworker.0 Request processed in 30us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843732.891442:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788843732.891455:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788843732.891461:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008625880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134505472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843732.891492:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008625880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134505472:12345-0@lo:400:kworker.0 Request processed in 32us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843732.891507:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788843732.891528:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134505344 00000100:00100000:1.0:1788843732.891532:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134505344 00000100:00100000:1.0:1788843732.891558:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788843732.891564:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008624a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3630:x1875738134505344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843732.891597:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008624a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3630:x1875738134505344:12345-0@lo:400:kworker.0 Request processed in 33us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843732.891603:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788843732.891648:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd00776b100 x1875738134505472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843732.891660:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134505472:0@lo:400:kworker.0 00000100:00100000:1.0:1788843732.891672:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134505344:0@lo:400:kworker.0 00000100:00100000:1.0:1788843732.891695:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134505600:0@lo:8:kworker.0 00000400:00000100:1.0:1788843732.891720:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875738134505600 offset 0 length 520: 4 00000100:00100000:1.0:1788843732.891736:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008625180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134505728:0@lo:8:kworker.0 00000400:00000100:1.0:1788843732.891749:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875738134505728 offset 0 length 520: 4 00010000:00080000:1.0:1788843732.891774:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd008627100 x1875738134505856/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843732.891783:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008627100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134505856:0@lo:400:kworker.0 00000100:00100000:1.0:1788843732.891791:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20b96c6c-8494-483a-b913-89dfc06b1440:3633:1875738134505216:0@lo:400:kworker.0 00000100:00100000:1.0:1788843732.893337:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788843732.893357:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008627100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134505984:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788843732.893428:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843732.893475:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134505984 00000100:00100000:1.0:1788843732.893483:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134505984 00000100:00100000:1.0:1788843732.893524:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788843732.893533:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008625c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3632:x1875738134505984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788843732.893565:0:17154:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788843732.893611:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008625c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3632:x1875738134505984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843732.893619:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788843732.893664:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008627100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134505984:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788843733.341529:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788843733.924256:0:17882:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788843734.363084:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788843734.618840:0:17908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788843734.939598:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843719/real 1788843719] req@ffff9bd00776aa00 x1875738134496896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843734 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843734.939642:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd00776aa00 x1875738134496896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843734 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843734.939652:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843719/real 1788843719] req@ffff9bd007769f80 x1875738134497024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843734 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843734.939663:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd007769f80 x1875738134497024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843734 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788843734.939684:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd118910000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788843734.943316:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788843734.943330:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134496896:0@lo:8:kworker.0 00000100:00080000:3.0:1788843734.943343:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd13e8a4000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788843734.943351:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788843734.943355:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134497024:0@lo:8:kworker.0 00000100:00080000:2.0:1788843734.944233:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788843734.944238:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788843734.944242:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bd118910000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788843734.944249:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 497 00000100:00080000:2.0:1788843734.944256:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788843734.944263:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bd118910000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:2.0:1788843734.944298:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd102fb8380 x1875738134506368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788843734.944328:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788843734.944331:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788843734.944333:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bd13e8a4000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788843734.944336:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 497 00000100:00080000:2.0:1788843734.944340:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788843734.944344:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bd13e8a4000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:2.0:1788843734.944357:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd102fbb100 x1875738134506496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788843734.944388:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788843734.944391:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788843734.944394:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788843734.944398:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788843734.944552:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134506368:0@lo:8:kworker.0 00000400:00000100:2.0:1788843734.944610:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875738134506368 offset 0 length 520: 4 00000100:00100000:2.0:1788843734.944652:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134506496:0@lo:8:kworker.0 00000400:00000100:2.0:1788843734.944669:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875738134506496 offset 0 length 520: 4 00000100:00100000:3.0:1788843734.944905:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20b96c6c-8494-483a-b913-89dfc06b1440:3630:1875738134506112:0@lo:400:kworker.0 00000100:00100000:3.0:1788843734.944955:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843734.944983:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134506880:0@lo:400:kworker.0 00000100:00100000:3.0:1788843734.945012:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843734.945035:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788843734.945042:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134506240:0@lo:400:kworker.0 00000100:00100000:3.0:1788843734.945065:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843734.945262:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134506112 00000100:00100000:2.0:1788843734.945280:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134506112 00000100:00100000:2.0:1788843734.945328:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788843734.945337:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007746850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+18:3630:x1875738134506112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843734.945390:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007746850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+18:3630:x1875738134506112:12345-0@lo:400:kworker.0 Request processed in 54us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843734.945410:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788843734.945460:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20b96c6c-8494-483a-b913-89dfc06b1440:3630:1875738134506112:0@lo:400:kworker.0 00000100:00100000:2.0:1788843734.945706:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134506752:0@lo:400:kworker.0 00000100:00100000:2.0:1788843734.945736:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843734.945840:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788843734.945846:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134506624:0@lo:400:kworker.0 00000100:00100000:2.0:1788843734.945870:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843734.945916:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134506880 00000100:00100000:2.0:1788843734.945921:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134506880 00000100:00100000:0.0:1788843734.946019:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134506240 00000100:00100000:0.0:1788843734.946024:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134506240 00000100:00100000:0.0:1788843734.946054:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134506752 00000100:00100000:0.0:1788843734.946057:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134506752 00000100:00100000:0.0:1788843734.946071:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788843734.946078:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134506240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843734.946134:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134506240:12345-0@lo:400:kworker.0 Request processed in 56us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843734.946163:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788843734.946242:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788843734.946250:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134506752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843734.946297:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134506752:12345-0@lo:400:kworker.0 Request processed in 47us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843734.946303:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788843734.946331:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134506752:0@lo:400:kworker.0 00000100:00100000:0.0:1788843734.946352:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134506240:0@lo:400:kworker.0 00000100:00100000:3.0:1788843734.946450:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134506624 00000100:00100000:3.0:1788843734.946454:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134506624 00000100:00100000:2.0:1788843734.946526:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788843734.946535:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134506880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843734.946571:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134506880:12345-0@lo:400:kworker.0 Request processed in 37us (1558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843734.946576:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788843734.946627:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd102fb8e00 x1875738134506880/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843734.946638:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134506880:0@lo:400:kworker.0 00000100:00100000:3.0:1788843734.947034:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788843734.947044:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134506624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843734.947104:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134506624:12345-0@lo:400:kworker.0 Request processed in 63us (1232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843734.947111:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788843734.947189:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd102fb9c00 x1875738134506624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843734.947200:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134506624:0@lo:400:kworker.0 00010000:00010000:2.0:1788843735.386523:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788843736.198597:0:18650:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788843736.198601:0:18650:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788843736.198603:0:18650:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788843736.198821:0:18650:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bd137ae8800 00000020:01000004:3.0:1788843736.198838:0:18650:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788843736.198852:0:18650:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788843736.198878:0:18650:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9bd0078b8000) 00000020:00000080:3.0:1788843736.199004:0:18650:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788843736.239808:0:18650:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788843736.242333:0:18650:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788843736.242648:0:18650:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788843736.242878:0:18650:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788843736.243428:0:18650:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788843736.243634:0:18650:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788843736.243847:0:18650:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:1.0:1788843736.245012:0:18650:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788843736.245539:0:18650:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788843736.245552:0:18650:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788843736.245562:0:18650:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa762dfcbd58d236f 00000020:01000004:2.0:1788843736.245570:0:18650:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788843736.245590:0:18650:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.133@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788843736.245594:0:18650:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.133@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788843736.245600:0:18650:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788843736.245604:0:18650:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788843736.245615:0:18650:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9bd1203f4d28) 00000020:00000080:2.0:1788843736.245625:0:18650:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1788843736.247814:0:18650:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788843736.248046:0:18650:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788843736.248061:0:18650:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788843736.248706:0:18650:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788843736.248713:0:18650:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788843736.249273:0:18650:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788843736.249283:0:18650:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788843736.250703:0:18650:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788843736.250906:0:18650:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788843736.250912:0:18650:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788843736.263280:0:18650:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788843736.263301:0:18650:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788843736.295288:0:18650:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788843736.295578:0:18650:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788843736.295585:0:18650:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788843736.297699:0:18650:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788843736.297714:0:18650:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788843736.299331:0:18650:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788843736.299345:0:18650:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788843736.302487:0:18650:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788843736.302735:0:18650:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788843736.302742:0:18650:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788843736.307451:0:18650:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788843736.307600:0:18650:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788843736.366533:0:18650:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788843736.366815:0:18650:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788843736.366830:0:18650:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788843736.369605:0:18650:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788843736.369618:0:18650:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788843736.370701:0:18650:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788843736.370729:0:18650:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788843736.370735:0:18650:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.133@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788843736.396309:0:18650:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.133@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788843736.396364:0:18650:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.133@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788843736.396369:0:18650:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788843736.396371:0:18650:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788843736.396372:0:18650:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843736.396373:0:18650:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843736.396375:0:18650:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843736.396376:0:18650:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843736.396377:0:18650:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788843736.396379:0:18650:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843736.396380:0:18650:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788843736.396384:0:18650:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788843736.396386:0:18650:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788843736.396387:0:18650:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788843736.396388:0:18650:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843736.396389:0:18650:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843736.396390:0:18650:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843736.396396:0:18650:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843736.396397:0:18650:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788843736.396398:0:18650:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843736.396399:0:18650:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788843736.396444:0:18650:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788843736.396470:0:18650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fbaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134507008:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788843736.396548:0:18650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843736.396662:0:18650:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1106d09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843736.398775:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134507008 00000100:00100000:1.0:1788843736.398791:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134507008 00000100:00100000:2.0:1788843736.398970:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788843736.398982:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007745c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+18:18650:x1875738134507008:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788843736.399020:0:17142:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788843736.399023:0:17142:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788843736.399027:0:17142:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788843736.399543:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007745c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+18:18650:x1875738134507008:12345-0@lo:253:mount.lustre.0 Request processed in 562us (2993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843736.399553:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788843736.400039:0:18650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fbaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134507008:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788843736.400055:0:18650:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788843736.400059:0:18650:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788843736.400061:0:18650:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788843736.400062:0:18650:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788843736.400064:0:18650:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788843736.400065:0:18650:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788843736.400066:0:18650:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788843736.400067:0:18650:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788843736.400069:0:18650:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788843736.400070:0:18650:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788843736.400094:0:18650:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bd137ae8800 from lustre-OST0000 10000000:01000000:0.0:1788843736.402404:0:18650:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788843736.402413:0:18650:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788843736.402423:0:18650:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bd10fbb0000 local copy 00010000:00010000:0.0:1788843736.402435:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d212a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2131 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843736.402570:0:18650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134507136:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788843736.402644:0:18650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843736.402733:0:18650:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13308b180 going to sleep for 11 seconds 00000100:00100000:3.0:1788843736.406101:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134507136 00000100:00100000:3.0:1788843736.406119:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134507136 00000100:00100000:3.0:1788843736.406203:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788843736.406215:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007745850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+18:18650:x1875738134507136:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843736.406778:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007745850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+18:18650:x1875738134507136:12345-0@lo:501:mount.lustre.0 Request processed in 564us (4132us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788843736.406788:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788843736.406876:0:18650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134507136:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788843736.406902:0:18650:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.133@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788843736.406938:0:18650:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.133@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788843736.406949:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d212a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2131 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843736.406960:0:18650:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d212a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2131 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843736.407198:0:18650:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bd137ae8800 10000000:01000000:2.0:1788843736.407203:0:18650:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788843736.407210:0:18650:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788843736.407212:0:18650:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788843736.407590:0:18650:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788843736.407593:0:18650:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788843736.407630:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946c00/0xa762dfcbd58d237d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843736.407639:0:18650:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd007946c00/0xa762dfcbd58d237d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843736.407720:0:18650:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd007946c00/0xa762dfcbd58d237d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843736.407745:0:18650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134507264:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788843736.407791:0:18650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843736.407841:0:18650:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12e118b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788843736.408017:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134507264 00000100:00100000:0.0:1788843736.408026:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134507264 00000100:00100000:0.0:1788843736.408074:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788843736.408091:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007747c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+18:18650:x1875738134507264:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788843736.408104:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843736.408117:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd10fa3d400/0xa762dfcbd58d2384 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d237d expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843736.408171:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd10fa3d400/0xa762dfcbd58d2384 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d237d expref: 19 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843736.408184:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd10fa3d400/0xa762dfcbd58d2384 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d237d expref: 19 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843736.408194:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3d400, rc 0) 00000100:00100000:0.0:1788843736.408231:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007747c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+19:18650:x1875738134507264:12345-0@lo:101:mount.lustre.0 Request processed in 141us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843736.408238:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788843736.408567:0:18650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134507264:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843736.408584:0:18650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd007946c00/0xa762dfcbd58d237d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2384 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843736.408594:0:18650:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd007946c00/0xa762dfcbd58d237d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2384 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843736.410520:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788843736.410778:0:18650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788843736.411487:0:18650:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788843736.415614:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788843736.415671:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788843736.415684:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788843736.415695:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788843736.415705:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788843736.415716:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788843736.415755:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788843736.415761:0:18650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788843736.415878:0:18650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134507392:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788843736.415947:0:18650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843736.416006:0:18650:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd136c60f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788843736.416173:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134507392 00000100:00100000:2.0:1788843736.416182:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134507392 00000100:00100000:2.0:1788843736.416237:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788843736.416247:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007747450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+19:18650:x1875738134507392:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843736.416562:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007747450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+19:18650:x1875738134507392:12345-0@lo:501:mount.lustre.0 Request processed in 315us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843736.416571:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788843736.417001:0:18650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134507392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843736.417428:0:18650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134507520:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788843736.417481:0:18650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843736.417552:0:18650:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12e1183c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843736.417591:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134507520 00000100:00100000:1.0:1788843736.417598:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134507520 00000100:00100000:1.0:1788843736.417669:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788843736.417678:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007744c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+19:18650:x1875738134507520:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788843736.419096:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007744c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+19:18650:x1875738134507520:12345-0@lo:503:mount.lustre.0 Request processed in 1413us (1609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843736.419107:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788843736.419651:0:18650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134507520:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788843736.423327:0:18650:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788843736.423456:0:18650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134507648:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843736.423542:0:18650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843736.423640:0:18650:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12e118b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788843736.423779:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134507648 00000100:00100000:1.0:1788843736.423787:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134507648 00000100:00100000:1.0:1788843736.423844:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788843736.423856:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007745050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+19:18650:x1875738134507648:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843736.424516:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007745050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+19:18650:x1875738134507648:12345-0@lo:502:mount.lustre.0 Request processed in 659us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843736.424525:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788843736.424664:0:18650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134507648:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788843736.424878:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788843736.424904:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788843736.424918:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788843736.424942:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788843736.424956:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788843736.424970:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788843736.424982:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788843736.424993:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788843736.425004:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788843736.425015:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788843736.425027:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788843736.425041:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1788843736.426334:0:18650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134507776:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843736.426412:0:18650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843736.426506:0:18650:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12e118b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788843736.426711:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134507776 00000100:00100000:1.0:1788843736.426728:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134507776 00000100:00100000:1.0:1788843736.426783:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788843736.426792:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007747850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+19:18650:x1875738134507776:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843736.426914:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007747850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+19:18650:x1875738134507776:12345-0@lo:502:mount.lustre.0 Request processed in 122us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843736.426930:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788843736.427080:0:18650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134507776:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788843736.427181:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788843736.427193:0:18650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1788843736.428366:0:18667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788843736.428377:0:18667:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788843736.428388:0:18667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843736.428391:0:18667:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788843736.428397:0:18667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788843736.428412:0:18667:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9bd0078bb370) 00000020:00000080:3.0:1788843736.428436:0:18667:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788843736.428443:0:18667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788843736.428521:0:18667:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd137ae8800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788843736.428530:0:18667:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788843736.428537:0:18667:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa762dfcbd58d2392 00010000:00010000:3.0:1788843736.435870:0:18667:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1788843736.436564:0:18667:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:3.0:1788843736.437857:0:18667:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1788843736.439625:0:18667:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788843736.439640:0:18667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843736.439647:0:18667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843736.439649:0:18667:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788843736.439652:0:18667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788843736.439655:0:18667:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1788843736.439657:0:18667:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788843736.439658:0:18667:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788843736.439659:0:18667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788843736.439662:0:18667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843736.439663:0:18667:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788843736.439665:0:18667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843736.439668:0:18667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843736.439669:0:18667:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788843736.439672:0:18667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788843736.439674:0:18667:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788843736.439676:0:18667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843736.439679:0:18667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843736.439680:0:18667:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788843736.439682:0:18667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843736.439684:0:18667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843736.439685:0:18667:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788843736.439688:0:18667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788843736.439717:0:18667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843736.439720:0:18667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843736.439721:0:18667:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788843736.439724:0:18667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1788843736.439898:0:18650:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788843736.439942:0:18650:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788843736.439965:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946c00/0xa762dfcbd58d237d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2384 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843736.439989:0:18650:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007946c00/0xa762dfcbd58d237d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2384 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843736.439998:0:18650:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd137ae8800 from 1 10000000:01000000:2.0:1788843736.440001:0:18650:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788843736.440043:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946800/0xa762dfcbd58d2399 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843736.440060:0:18650:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd007946800/0xa762dfcbd58d2399 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843736.440073:0:18650:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd007946800/0xa762dfcbd58d2399 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843736.440101:0:18650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134507904:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788843736.440212:0:18650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843736.440253:0:18650:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12e118180 going to sleep for 11 seconds 00000100:00100000:0.0:1788843736.440436:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134507904 00000100:00100000:0.0:1788843736.440449:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134507904 00000100:00100000:0.0:1788843736.440494:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788843736.440503:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007746050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+19:18650:x1875738134507904:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788843736.440517:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843736.440529:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd10fa3ca00/0xa762dfcbd58d23a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2399 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843736.440555:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd10fa3ca00/0xa762dfcbd58d23a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2399 expref: 20 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843736.440565:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd10fa3ca00/0xa762dfcbd58d23a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2399 expref: 20 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843736.440575:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3ca00, rc 0) 00000100:00100000:0.0:1788843736.440614:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007746050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+20:18650:x1875738134507904:12345-0@lo:101:mount.lustre.0 Request processed in 111us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843736.440620:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788843736.440743:0:18650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134507904:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843736.440758:0:18650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd007946800/0xa762dfcbd58d2399 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d23a0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843736.440767:0:18650:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd007946800/0xa762dfcbd58d2399 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d23a0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788843736.443584:0:18650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788843736.443859:0:18650:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788843736.444037:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788843736.444072:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788843736.444102:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788843736.444108:0:18650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788843736.445576:0:18650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134508032:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843736.445646:0:18650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843736.445725:0:18650:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12e118d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788843736.448503:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134508032 00000100:00100000:0.0:1788843736.448517:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134508032 00000100:00100000:0.0:1788843736.448566:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788843736.448575:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+20:18650:x1875738134508032:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788843736.448737:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+20:18650:x1875738134508032:12345-0@lo:501:mount.lustre.0 Request processed in 162us (3089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843736.448744:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788843736.448874:0:18650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134508032:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843736.448933:0:18650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134508160:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788843736.448980:0:18650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843736.449013:0:18650:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd106ae1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843736.449204:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134508160 00000100:00100000:0.0:1788843736.449209:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134508160 00000100:00100000:0.0:1788843736.449273:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788843736.449281:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+20:18650:x1875738134508160:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788843736.449372:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+20:18650:x1875738134508160:12345-0@lo:503:mount.lustre.0 Request processed in 91us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843736.449379:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788843736.449468:0:18650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134508160:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788843736.449845:0:18650:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788843736.449916:0:18650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134508288:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788843736.449965:0:18650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843736.455437:0:18650:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1054f9300 going to sleep for 11 seconds 00000100:00100000:1.0:1788843736.455512:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134508288 00000100:00100000:1.0:1788843736.455523:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134508288 00000100:00100000:1.0:1788843736.455575:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788843736.455587:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+20:18650:x1875738134508288:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843736.455761:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+20:18650:x1875738134508288:12345-0@lo:502:mount.lustre.0 Request processed in 175us (5793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843736.455769:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788843736.455887:0:18650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134508288:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788843736.456201:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788843736.456228:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788843736.456241:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788843736.456266:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788843736.456283:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788843736.456296:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788843736.456319:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788843736.456333:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1788843736.456362:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788843736.456378:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1788843736.456391:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1788843736.456428:0:18650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134508416:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788843736.456476:0:18650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843736.456498:0:18650:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd106ae1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843736.456747:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134508416 00000100:00100000:1.0:1788843736.456753:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134508416 00000100:00100000:1.0:1788843736.456780:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788843736.456788:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+20:18650:x1875738134508416:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843736.456884:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+20:18650:x1875738134508416:12345-0@lo:502:mount.lustre.0 Request processed in 97us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843736.456892:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788843736.457136:0:18650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134508416:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788843736.457217:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1788843736.457225:0:18650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788843736.457819:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843736.457830:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843736.457833:0:18671:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788843736.457839:0:18671:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd137ae8800 00000020:00000080:0.0:1788843736.457841:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788843736.457849:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843736.457852:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843736.457853:0:18671:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788843736.457856:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843736.457858:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843736.457859:0:18671:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788843736.457863:0:18671:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd137ae8800 00000020:00000080:0.0:1788843736.457865:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788843736.457934:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843736.457938:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843736.457940:0:18671:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788843736.457942:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843736.457945:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843736.457946:0:18671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788843736.457950:0:18671:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd137ae8800 00000020:00000080:0.0:1788843736.457952:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788843736.457971:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843736.457974:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843736.457975:0:18671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788843736.457978:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843736.457980:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843736.457981:0:18671:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788843736.457984:0:18671:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd137ae8800 00000020:00000080:0.0:1788843736.457986:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788843736.458019:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843736.458023:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843736.458024:0:18671:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788843736.458027:0:18671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1788843736.458387:0:18650:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788843736.458410:0:18650:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788843736.458433:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007946800/0xa762dfcbd58d2399 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d23a0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843736.458445:0:18650:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007946800/0xa762dfcbd58d2399 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d23a0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843736.458492:0:18650:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788843736.458494:0:18650:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bd137ae8800 10000000:01000000:1.0:1788843736.458497:0:18650:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bd137ae8800 10000000:01000000:1.0:1788843736.458501:0:18650:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788843736.458506:0:18650:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd137ae8800 from 1 10000000:01000000:1.0:1788843736.458508:0:18650:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788843736.458539:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fbea200/0xa762dfcbd58d23a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843736.458554:0:18650:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd13fbea200/0xa762dfcbd58d23a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843736.458565:0:18650:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd13fbea200/0xa762dfcbd58d23a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843736.458585:0:18650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008627100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134508544:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788843736.458634:0:18650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843736.458665:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134508544 00000100:00100000:1.0:1788843736.458671:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134508544 00000100:00100000:1.0:1788843736.458705:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788843736.458711:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+20:18650:x1875738134508544:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788843736.458722:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843736.458733:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd13fbeb600/0xa762dfcbd58d23ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d23a7 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843736.458756:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd13fbeb600/0xa762dfcbd58d23ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d23a7 expref: 21 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843736.458767:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd13fbeb600/0xa762dfcbd58d23ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d23a7 expref: 21 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843736.458776:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fbeb600, rc 0) 00000100:00100000:1.0:1788843736.458801:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+21:18650:x1875738134508544:12345-0@lo:101:mount.lustre.0 Request processed in 90us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843736.458807:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788843736.458844:0:18650:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd132a2ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1788843736.458864:0:18650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008627100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134508544:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788843736.458878:0:18650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd13fbea200/0xa762dfcbd58d23a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d23ae expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843736.458887:0:18650:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd13fbea200/0xa762dfcbd58d23a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d23ae expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788843736.460762:0:18650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1788843736.461333:0:18650:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788843736.461542:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788843736.461568:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788843736.461582:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788843736.461596:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788843736.461608:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788843736.461621:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788843736.461634:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788843736.461646:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788843736.461658:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788843736.461670:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788843736.461698:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788843736.461713:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788843736.461725:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788843736.461736:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788843736.461747:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788843736.461759:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788843736.461770:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788843736.461781:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788843736.461794:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788843736.461806:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788843736.461818:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788843736.461831:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788843736.461846:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788843736.461870:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788843736.461884:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1788843736.461899:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1788843736.468766:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1788843736.468824:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1788843736.468840:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1788843736.468854:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1788843736.468868:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1788843736.468884:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1788843736.468899:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1788843736.468912:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1788843736.468986:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1788843736.469007:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1788843736.469022:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1788843736.469049:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1788843736.469056:0:18650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1788843736.469332:0:18650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008627100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134508672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788843736.469408:0:18650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843736.470292:0:18650:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1106d09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843736.475403:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134508672 00000100:00100000:0.0:1788843736.475418:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134508672 00000100:00100000:1.0:1788843736.475565:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788843736.475576:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+21:18650:x1875738134508672:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788843736.475759:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+21:18650:x1875738134508672:12345-0@lo:501:mount.lustre.0 Request processed in 185us (6350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843736.475767:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788843736.475828:0:18650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008627100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134508672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788843736.475882:0:18650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008627100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134508800:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788843736.475949:0:18650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843736.475985:0:18650:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1106d09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843736.476229:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134508800 00000100:00100000:0.0:1788843736.476235:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134508800 00000100:00100000:0.0:1788843736.476275:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788843736.476284:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+21:18650:x1875738134508800:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788843736.476365:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+21:18650:x1875738134508800:12345-0@lo:503:mount.lustre.0 Request processed in 82us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843736.476371:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788843736.476438:0:18650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008627100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134508800:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788843736.476769:0:18650:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788843736.476828:0:18650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008627100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134508928:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843736.476860:0:18650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843736.476889:0:18650:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0077bbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788843736.477046:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134508928 00000100:00100000:0.0:1788843736.477051:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134508928 00000100:00100000:0.0:1788843736.477075:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788843736.477081:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+21:18650:x1875738134508928:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788843736.477175:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+21:18650:x1875738134508928:12345-0@lo:502:mount.lustre.0 Request processed in 93us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843736.477182:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788843736.487100:0:18650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008627100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134508928:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788843736.487637:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788843736.487666:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788843736.487696:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788843736.487708:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788843736.487719:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788843736.487729:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788843736.487740:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788843736.487751:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788843736.487762:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788843736.487773:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788843736.487785:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788843736.487796:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788843736.487808:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788843736.487819:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788843736.487831:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788843736.487842:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788843736.487853:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788843736.487864:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788843736.487889:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788843736.487905:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788843736.487918:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788843736.489065:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788843736.489089:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788843736.489112:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788843736.489165:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1788843736.489185:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1788843736.489198:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1788843736.489210:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1788843736.489221:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1788843736.489233:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1788843736.489246:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1788843736.489270:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1788843736.489286:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1788843736.489300:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1788843736.489330:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1788843736.489345:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1788843736.489358:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1788843736.489369:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1788843736.489381:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1788843736.489392:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1788843736.489403:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1788843736.489415:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1788843736.489426:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1788843736.489438:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1788843736.489451:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1788843736.489463:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1788843736.489477:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1788843736.489490:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1788843736.489550:0:18650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008627100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134509056:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843736.489633:0:18650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843736.489680:0:18650:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0077bbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788843736.492117:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134509056 00000100:00100000:0.0:1788843736.492134:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134509056 00000100:00100000:0.0:1788843736.492213:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788843736.492224:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+21:18650:x1875738134509056:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788843736.492390:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+21:18650:x1875738134509056:12345-0@lo:502:mount.lustre.0 Request processed in 166us (2755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843736.492398:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788843736.493307:0:18650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008627100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134509056:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788843736.493513:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1788843736.493552:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1788843736.493589:0:18650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008627100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134509184:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843736.493647:0:18650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843736.493688:0:18650:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0077bbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788843736.494013:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134509184 00000100:00100000:0.0:1788843736.494027:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134509184 00000100:00100000:0.0:1788843736.494082:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788843736.494092:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+21:18650:x1875738134509184:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788843736.494215:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+21:18650:x1875738134509184:12345-0@lo:502:mount.lustre.0 Request processed in 123us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843736.494223:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788843736.494327:0:18650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008627100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134509184:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788843736.494376:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1788843736.494385:0:18650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788843736.497629:0:18676:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788843736.497648:0:18676:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9bd13df319b8) 00000020:00000080:1.0:1788843736.497671:0:18676:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1788843736.497763:0:18676:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd137ae8800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788843736.497767:0:18676:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd137ae8800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788843736.497771:0:18676:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd137ae8800 3 00010000:00080000:1.0:1788843736.497802:0:18676:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd006525800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.133@tcp at head 00010000:00010000:1.0:1788843736.499405:0:18676:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1788843736.499624:0:18676:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788843736.499669:0:18676:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788843736.499682:0:18676:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa762dfcbd58d23bc 00000100:00080000:1.0:1788843736.499694:0:18676:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788843736.499700:0:18676:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bd006525800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:1.0:1788843736.499744:0:18676:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd008627100 x1875738134509312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788843736.499775:0:18676:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788843736.499831:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843736.499835:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788843736.499838:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843736.499841:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788843736.499877:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843736.499883:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788843736.499886:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843736.499889:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788843736.499927:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008624700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134509824:0@lo:400:kworker.0 00000100:00100000:1.0:1788843736.499998:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843736.500039:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843736.500045:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008627b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134509440:0@lo:400:kworker.0 00000100:00100000:1.0:1788843736.500072:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843736.500102:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008626d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134509696:0@lo:400:kworker.0 00000100:00100000:1.0:1788843736.500162:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843736.500182:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788843736.500188:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134509568:0@lo:400:kworker.0 00000100:00100000:1.0:1788843736.500210:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843736.500246:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134509824 00000100:00100000:1.0:1788843736.500253:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134509824 00000100:00100000:2.0:1788843736.500527:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008627100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3629:1875738134509312:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788843736.500560:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843736.500612:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134509568 00000100:00100000:2.0:1788843736.500616:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134509568 00000100:00100000:2.0:1788843736.500649:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134509312 00000100:00100000:2.0:1788843736.500652:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134509312 00000100:00100000:2.0:1788843736.500666:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788843736.500675:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134509568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843736.500739:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134509568:12345-0@lo:400:kworker.0 Request processed in 65us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843736.500747:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788843736.500763:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788843736.500768:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3629:x1875738134509312:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788843736.500789:0:17150:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:2.0:1788843736.500818:0:17150:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa762dfcbd58d23c3 00000004:00100000:2.0:1788843736.500831:0:17150:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788843736.500861:0:17150:0:(import.c:65:import_set_state_nolock()) ffff9bd132a9c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788843736.500899:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1875738134509312:12345-0@lo:38:llog_process_th.0 Request processed in 130us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843736.500906:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788843736.501015:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd008627480 x1875738134509568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843752 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843736.501029:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134509568:0@lo:400:kworker.0 00010000:00080000:2.0:1788843736.501091:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd008627100 x1875738134509312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788843746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843736.501112:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788843736.501118:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1788843736.501126:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788843736.501131:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788843736.501133:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd006525800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788843736.501164:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008627100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3629:1875738134509312:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788843736.502245:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134509440 00000100:00100000:0.0:1788843736.502268:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134509440 00000100:00100000:0.0:1788843736.502317:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134509696 00000100:00100000:0.0:1788843736.502320:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134509696 00000100:00100000:0.0:1788843736.502337:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788843736.502345:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008626a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134509440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843736.502417:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008626a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134509440:12345-0@lo:400:kworker.0 Request processed in 72us (2343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843736.502424:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788843736.502438:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788843736.502444:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008624380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134509696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843736.502477:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008624380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134509696:12345-0@lo:400:kworker.0 Request processed in 33us (2338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843736.502483:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788843736.502520:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008626d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134509696:0@lo:400:kworker.0 00000100:00100000:1.0:1788843736.504372:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788843736.504383:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134509824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843736.504467:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134509824:12345-0@lo:400:kworker.0 Request processed in 85us (4469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843736.504475:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788843736.504538:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008627b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134509440:0@lo:400:kworker.0 00010000:00080000:1.0:1788843736.504557:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd008624700 x1875738134509824/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843752 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843736.504567:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008624700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134509824:0@lo:400:kworker.0 00000020:01000004:3.0:1788843736.506561:0:18676:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788843736.506590:0:18676:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9bd005b64d28) 00000020:00000080:3.0:1788843736.506615:0:18676:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1788843736.506699:0:18676:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd137ae8800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788843736.506703:0:18676:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd137ae8800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788843736.506705:0:18676:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd137ae8800 3 00010000:00080000:3.0:1788843736.506747:0:18676:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd008711000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.133@tcp at head 00010000:00010000:3.0:1788843736.510045:0:18676:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1788843736.513021:0:18676:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788843736.513074:0:18676:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788843736.513088:0:18676:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xa762dfcbd58d23d1 00000100:00080000:3.0:1788843736.513100:0:18676:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788843736.513107:0:18676:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9bd008711000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:3.0:1788843736.513241:0:18676:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd141b6aa00 x1875738134509952/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788843736.513278:0:18676:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788843736.514010:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843736.514017:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788843736.514020:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843736.514023:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788843736.514027:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843736.514029:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788843736.514032:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843736.514035:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788843736.514152:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3629:1875738134509952:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788843736.514230:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843736.514310:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134509952 00000100:00100000:2.0:1788843736.514318:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134509952 00000100:00100000:2.0:1788843736.514350:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788843736.514358:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3629:x1875738134509952:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788843736.514387:0:17151:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:2.0:1788843736.514431:0:17151:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xa762dfcbd58d23d8 00000004:00100000:2.0:1788843736.514447:0:17151:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788843736.514481:0:17151:0:(import.c:65:import_set_state_nolock()) ffff9bd132a9d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788843736.514544:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875738134509952:12345-0@lo:38:llog_process_th.0 Request processed in 184us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843736.514552:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788843736.515000:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd141b6aa00 x1875738134509952/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788843746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843736.515017:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788843736.515027:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788843736.515034:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788843736.515039:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788843736.515041:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd008711000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788843736.515048:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3629:1875738134509952:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788843736.515513:0:18676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1788843736.515589:0:18650:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788843736.515621:0:18650:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788843736.515645:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fbea200/0xa762dfcbd58d23a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d23ae expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843736.515656:0:18650:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd13fbea200/0xa762dfcbd58d23a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d23ae expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788843736.515708:0:18650:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788843736.515711:0:18650:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788843736.515712:0:18650:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788843736.515714:0:18650:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788843736.515715:0:18650:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788843736.515716:0:18650:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788843736.515718:0:18650:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788843736.515720:0:18650:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788843736.515721:0:18650:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788843736.515725:0:18650:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788843736.515727:0:18650:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788843736.515728:0:18650:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788843736.515729:0:18650:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788843736.515730:0:18650:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788843736.515731:0:18650:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788843736.515732:0:18650:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788843736.515733:0:18650:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788843736.515734:0:18650:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788843736.515735:0:18650:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788843736.515755:0:18650:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788843736.515772:0:18650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134510080:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788843736.515830:0:18650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843736.515871:0:18650:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007bab0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843736.515987:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134510080 00000100:00100000:2.0:1788843736.515995:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134510080 00000100:00100000:2.0:1788843736.516128:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788843736.516160:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+21:18650:x1875738134510080:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788843736.516189:0:17144:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788843736.516207:0:17144:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788843736.528731:0:17144:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788843736.528752:0:17144:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788843736.529020:0:17165:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788843736.529025:0:17165:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788843736.529049:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d23df lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843736.529068:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd007947c00/0xa762dfcbd58d2329 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2322 expref: 21 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843736.529076:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd007be2600/0xa762dfcbd58d2337 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2330 expref: 21 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843736.529084:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d23df lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843736.529125:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd007be2600/0xa762dfcbd58d2337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d2330 expref: 21 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843736.529158:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd007be2600/0xa762dfcbd58d2337 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d2330 expref: 21 pid: 17142 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843736.529175:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fbb800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17165:1875738134510208:0@lo:104: 00000100:00100000:2.0:1788843736.529245:0:17165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788843736.529304:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd007947c00/0xa762dfcbd58d2329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d2322 expref: 21 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843736.529312:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd007947c00/0xa762dfcbd58d2329 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d2322 expref: 21 pid: 17142 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843736.529321:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fbbb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17165:1875738134510336:0@lo:104: 00000100:00100000:2.0:1788843736.529344:0:17165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843736.529378:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12e118540 going to sleep for 11 seconds 00000100:00100000:3.0:1788843736.529427:0:17134:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788843736.529441:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134510208 00000100:00100000:3.0:1788843736.529449:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134510208 00000100:00100000:3.0:1788843736.529487:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134510336 00000100:00100000:3.0:1788843736.529490:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134510336 00000100:00100000:3.0:1788843736.529505:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788843736.529514:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20b96c6c-8494-483a-b913-89dfc06b1440+4:17165:x1875738134510208:12345-0@lo:104: 00010000:00010000:3.0:1788843736.529527:0:17134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d2330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d2337 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843736.529590:0:17134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788843736.529596:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20b96c6c-8494-483a-b913-89dfc06b1440+4:17165:x1875738134510208:12345-0@lo:104: Request processed in 82us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843736.529603:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788843736.529620:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788843736.529626:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0018c4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20b96c6c-8494-483a-b913-89dfc06b1440+3:17165:x1875738134510336:12345-0@lo:104: 00010000:00010000:3.0:1788843736.529633:0:17134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd007be3c00/0xa762dfcbd58d2322 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d2329 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843736.529649:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+21:18650:x1875738134510080:12345-0@lo:253:mount.lustre.0 Request processed in 13512us (13818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843736.529657:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00010000:3.0:1788843736.529669:0:17134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788843736.529674:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0018c4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20b96c6c-8494-483a-b913-89dfc06b1440+3:17165:x1875738134510336:12345-0@lo:104: Request processed in 49us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843736.529679:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788843736.529710:0:18650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:18650:1875738134510080:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788843736.529728:0:18650:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788843736.529731:0:18650:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788843736.529732:0:18650:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788843736.529734:0:18650:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788843736.529735:0:18650:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788843736.529736:0:18650:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788843736.529738:0:18650:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788843736.529739:0:18650:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788843736.529741:0:18650:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788843736.529743:0:18650:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788843736.529756:0:18650:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788843736.530002:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788843736.530010:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d2330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d2337 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843736.530018:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946200 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:2.0:1788843736.530021:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d2330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d2337 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843736.530030:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d2330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d2337 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843736.530037:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d2330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d2337 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843736.530043:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788843736.530083:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d2330 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2337 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843736.530089:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788843736.530108:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d2330 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2337 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843736.530114:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd007946200/0xa762dfcbd58d2330 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2337 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843736.530126:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843736.530129:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd007be3c00/0xa762dfcbd58d2322 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d2329 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843736.530135:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be3c00 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:2.0:1788843736.530162:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd007be3c00/0xa762dfcbd58d2322 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d2329 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843736.530170:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd007be3c00/0xa762dfcbd58d2322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d2329 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843736.530176:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd007be3c00/0xa762dfcbd58d2322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d2329 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843736.530181:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788843736.530196:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd007be3c00/0xa762dfcbd58d2322 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2329 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843736.530201:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788843736.530215:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd007be3c00/0xa762dfcbd58d2322 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2329 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843736.530221:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd007be3c00/0xa762dfcbd58d2322 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2329 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843736.530231:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843736.530233:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843736.530235:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843736.530241:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843736.530252:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20b96c6c-8494-483a-b913-89dfc06b1440:3631:1875738134510464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843736.530292:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843736.530311:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134510464 00000100:00100000:1.0:1788843736.530317:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134510464 00000100:00100000:2.0:1788843736.530329:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20b96c6c-8494-483a-b913-89dfc06b1440:3632:1875738134510592:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788843736.530336:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd007be2600/0xa762dfcbd58d2337 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2330 expref: 21 pid: 17142 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843736.530352:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843736.530517:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134510592 00000100:00100000:1.0:1788843736.530522:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134510592 00010000:00010000:1.0:1788843736.530536:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd007947c00/0xa762dfcbd58d2329 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2322 expref: 22 pid: 17142 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843736.530551:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788843736.530557:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20b96c6c-8494-483a-b913-89dfc06b1440+22:3631:x1875738134510464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788843736.530568:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843736.530572:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd007be2600/0xa762dfcbd58d2337 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2330 expref: 22 pid: 17142 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843736.530583:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd007be2600/0xa762dfcbd58d2337 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d2330 expref: 22 pid: 17142 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843736.530606:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843736.530681:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20b96c6c-8494-483a-b913-89dfc06b1440+22:3631:x1875738134510464:12345-0@lo:103:ldlm_bl.0 Request processed in 123us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843736.530688:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788843736.530702:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788843736.530707:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0013a9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20b96c6c-8494-483a-b913-89dfc06b1440+21:3632:x1875738134510592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788843736.530715:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843736.530719:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd007947c00/0xa762dfcbd58d2329 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2322 expref: 21 pid: 17142 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843736.530727:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd007947c00/0xa762dfcbd58d2329 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d2322 expref: 21 pid: 17142 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843736.530740:0:17137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d23df lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843736.530748:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d23df lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788843736.530760:0:17137:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004529583s 00010000:00010000:1.0:1788843736.530764:0:17137:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d23df lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843736.530771:0:17137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d23df lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843736.530777:0:17137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d23df lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843736.530793:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d23df lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843736.530797:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946a00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843736.530802:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d23df lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843736.530810:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d23df lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843736.530819:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d23df lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843736.530828:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843736.530858:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0013a9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20b96c6c-8494-483a-b913-89dfc06b1440+21:3632:x1875738134510592:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843736.530864:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788843736.531017:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20b96c6c-8494-483a-b913-89dfc06b1440:3631:1875738134510464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788843736.531412:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20b96c6c-8494-483a-b913-89dfc06b1440:3632:1875738134510592:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788843736.531665:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd007be2600/0xa762dfcbd58d2337 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d2330 expref: 20 pid: 17142 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843736.531687:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fbb800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17165:1875738134510208:0@lo:104: 00010000:00010000:2.0:1788843736.531697:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd007947c00/0xa762dfcbd58d2329 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d2322 expref: 19 pid: 17142 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843736.531704:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fbbb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17165:1875738134510336:0@lo:104: 00010000:00010000:2.0:1788843736.531717:0:17165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d23df lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843736.531726:0:17165:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d23df lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843736.531732:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d23df lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843736.531739:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd007946a00/0xa762dfcbd58d23df lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1788843736.534292:0:18650:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788843736.545066:0:18650:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788843736.545076:0:18650:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788843736.545114:0:18650:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788843736.545183:0:18650:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.133@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788843736.545206:0:18650:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788843736.545229:0:18650:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788843736.551373:0:18650:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788843736.552574:0:18650:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:3.0:1788843737.407461:0:18731:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788843737.407953:0:18731:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788843737.434575:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843737.501412:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008624700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134510720:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788843737.501489:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843737.501606:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134510720 00000100:00100000:1.0:1788843737.501616:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134510720 00000100:00100000:1.0:1788843737.501681:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788843737.501692:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134510720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788843737.501728:0:17154:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788843737.501790:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134510720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843737.501797:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788843737.501852:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008624700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134510720:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788843738.010359:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788843738.010395:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008627b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134510848:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788843738.010480:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843738.010667:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134510848 00000100:00100000:1.0:1788843738.010676:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134510848 00000100:00100000:1.0:1788843738.010747:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788843738.010757:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134510848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788843738.010791:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788843738.010845:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134510848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843738.010852:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788843738.010902:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008627b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134510848:0@lo:41:osp-pre-1-0.0 10000000:01000000:3.0:1788843738.394234:0:17147:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788843738.394259:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd10f7b9800 from 9 10000000:01000000:3.0:1788843738.394266:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788843738.394320:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007be3400/0xa762dfcbd58d23e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843738.394335:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd007be3400/0xa762dfcbd58d23e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843738.394347:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd007be3400/0xa762dfcbd58d23e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843738.394381:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134510976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788843738.394474:0:17147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843738.394533:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12e003540 going to sleep for 11 seconds 00000100:00100000:1.0:1788843738.394587:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134510976 00000100:00100000:1.0:1788843738.394596:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134510976 00000100:00100000:1.0:1788843738.394664:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788843738.394675:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+19:17147:x1875738134510976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843738.394690:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843738.394707:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd13fbea800/0xa762dfcbd58d23ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d23e6 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843738.394865:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd13fbea800/0xa762dfcbd58d23ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d23e6 expref: 20 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843738.394878:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd13fbea800/0xa762dfcbd58d23ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d23e6 expref: 20 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843738.394888:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd13fbea800, rc 0) 00000100:00100000:1.0:1788843738.395020:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+20:17147:x1875738134510976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 346us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843738.395028:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788843738.395184:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134510976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843738.395204:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd007be3400/0xa762dfcbd58d23e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d23ed expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843738.395214:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd007be3400/0xa762dfcbd58d23e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d23ed expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843738.395300:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134511104:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788843738.395335:0:17147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843738.395350:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12e003540 going to sleep for 11 seconds 00000100:00100000:0.0:1788843738.395411:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134511104 00000100:00100000:0.0:1788843738.395417:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134511104 00000100:00100000:0.0:1788843738.395452:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788843738.395459:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+20:17147:x1875738134511104:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788843738.395474:0:17144:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788843738.395494:0:17144:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788843738.395497:0:17144:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1788843738.395585:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+20:17147:x1875738134511104:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843738.395601:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788843738.395666:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134511104:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788843738.395814:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788843738.395822:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007be3400/0xa762dfcbd58d23e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d23ed expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843738.395831:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007be3400/0xa762dfcbd58d23e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d23ed expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843738.395843:0:17147:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788843738.395845:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd137acd000 from 9 10000000:01000000:3.0:1788843738.395849:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788843738.395872:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007be3e00/0xa762dfcbd58d23f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843738.395880:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd007be3e00/0xa762dfcbd58d23f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843738.395888:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd007be3e00/0xa762dfcbd58d23f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843738.395902:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134511232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788843738.396004:0:17147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843738.396074:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12e003540 going to sleep for 11 seconds 00000100:00100000:0.0:1788843738.399795:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134511232 00000100:00100000:0.0:1788843738.399814:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134511232 00000100:00100000:0.0:1788843738.399880:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788843738.399893:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+20:17147:x1875738134511232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843738.400076:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843738.400101:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd10fa3cc00/0xa762dfcbd58d23fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d23f4 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843738.400136:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd10fa3cc00/0xa762dfcbd58d23fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d23f4 expref: 21 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843738.400176:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd10fa3cc00/0xa762dfcbd58d23fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d23f4 expref: 21 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843738.400186:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3cc00, rc 0) 00000100:00100000:0.0:1788843738.400322:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+21:17147:x1875738134511232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 432us (4316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843738.400329:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788843738.400493:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134511232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843738.400533:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd007be3e00/0xa762dfcbd58d23f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d23fb expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843738.400543:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd007be3e00/0xa762dfcbd58d23f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d23fb expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843738.400619:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134511360:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788843738.400663:0:17147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843738.400694:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12e003540 going to sleep for 11 seconds 00000100:00100000:0.0:1788843738.400886:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134511360 00000100:00100000:0.0:1788843738.400892:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134511360 00000100:00100000:0.0:1788843738.401074:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788843738.401084:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd105a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+21:17147:x1875738134511360:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788843738.401113:0:17142:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788843738.401135:0:17142:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788843738.401475:0:17142:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1788843738.401598:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd105a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+21:17147:x1875738134511360:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 515us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843738.401614:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788843738.402028:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134511360:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788843738.402135:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788843738.402191:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007be3e00/0xa762dfcbd58d23f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d23fb expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843738.402202:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007be3e00/0xa762dfcbd58d23f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d23fb expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843738.459295:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843739.483823:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843740.506429:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788843740.972476:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788843741.530270:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788843741.600714:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788843741.600724:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788843741.600726:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788843741.600729:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788843741.600750:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788843741.600773:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788843741.600776:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788843741.600779:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788843741.600849:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134511872:0@lo:400:kworker.0 00000100:00100000:2.0:1788843741.600933:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843741.600987:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788843741.600993:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20b96c6c-8494-483a-b913-89dfc06b1440:3630:1875738134511488:0@lo:400:kworker.0 00000100:00100000:2.0:1788843741.601027:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843741.601056:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134512000:0@lo:400:kworker.0 00000100:00100000:2.0:1788843741.601085:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843741.601115:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134511616:0@lo:400:kworker.0 00000100:00100000:2.0:1788843741.601165:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843741.601184:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134512128:0@lo:400:kworker.0 00000100:00100000:2.0:1788843741.601206:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843741.601236:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788843741.601244:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134511744:0@lo:400:kworker.0 00000100:00100000:2.0:1788843741.601268:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843741.601287:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134512256:0@lo:400:kworker.0 00000100:00100000:2.0:1788843741.601305:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843741.601330:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134511872 00000100:00100000:2.0:1788843741.601343:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134511872 00000100:00100000:2.0:1788843741.601392:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134511616 00000100:00100000:2.0:1788843741.601395:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134511616 00000100:00100000:2.0:1788843741.601411:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788843741.601421:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141aea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134511872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843741.601489:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141aea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134511872:12345-0@lo:400:kworker.0 Request processed in 69us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843741.601496:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788843741.601515:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788843741.601521:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141aead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134511616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843741.601551:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141aead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134511616:12345-0@lo:400:kworker.0 Request processed in 30us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843741.601557:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788843741.601577:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134511488 00000100:00100000:2.0:1788843741.601580:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134511488 00000100:00100000:2.0:1788843741.601606:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788843741.601612:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1037cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+21:3630:x1875738134511488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843741.601641:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1037cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+21:3630:x1875738134511488:12345-0@lo:400:kworker.0 Request processed in 29us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843741.601646:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788843741.601675:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134512000 00000100:00100000:2.0:1788843741.601678:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134512000 00000100:00100000:2.0:1788843741.601697:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134512128 00000100:00100000:2.0:1788843741.601699:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134512128 00000100:00100000:2.0:1788843741.601729:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134511744 00000100:00100000:2.0:1788843741.601732:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134511744 00000100:00100000:2.0:1788843741.601744:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134512256 00000100:00100000:2.0:1788843741.601746:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134512256 00000100:00080000:3.0:1788843741.601752:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788843741.601756:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788843741.601759:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788843741.601765:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134512000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843741.601797:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134512000:12345-0@lo:400:kworker.0 Request processed in 32us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843741.601812:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788843741.601824:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788843741.601830:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134512128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843741.601858:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134512128:12345-0@lo:400:kworker.0 Request processed in 29us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843741.601864:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788843741.601875:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788843741.601880:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134511744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843741.601903:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134511744:12345-0@lo:400:kworker.0 Request processed in 23us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843741.601908:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788843741.601918:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788843741.601923:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134512256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843741.601949:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134512256:12345-0@lo:400:kworker.0 Request processed in 26us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843741.601954:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788843741.602011:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd102fb8700 x1875738134511744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843741.602027:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134511744:0@lo:400:kworker.0 00010000:00080000:2.0:1788843741.602039:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd102fba680 x1875738134512256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843741.602047:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134512256:0@lo:400:kworker.0 00000100:00100000:2.0:1788843741.602056:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134511616:0@lo:400:kworker.0 00010000:00080000:2.0:1788843741.602078:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd102fbaa00 x1875738134512128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843741.602086:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134512128:0@lo:400:kworker.0 00000100:00100000:2.0:1788843741.602172:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20b96c6c-8494-483a-b913-89dfc06b1440:3630:1875738134511488:0@lo:400:kworker.0 00010000:00080000:2.0:1788843741.602184:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd102fb8e00 x1875738134512000/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843741.602193:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134512000:0@lo:400:kworker.0 00000100:00100000:2.0:1788843741.602202:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134511872:0@lo:400:kworker.0 00010000:00010000:0.0:1788843742.556724:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843742.621666:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008627b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134512384:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788843742.621830:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843742.624596:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134512384 00000100:00100000:1.0:1788843742.624669:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134512384 00000100:00100000:1.0:1788843742.624799:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788843742.624811:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134512384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788843742.624857:0:17154:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788843742.624970:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134512384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 161us (3208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843742.624977:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788843742.626260:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008627b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134512384:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1788843742.826759:0:19021:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg333-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788843743.131422:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788843743.131454:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008624e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134512512:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788843743.131543:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843743.132974:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134512512 00000100:00100000:2.0:1788843743.132989:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134512512 00000100:00100000:2.0:1788843743.133174:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788843743.133186:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134512512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788843743.133242:0:17890:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788843743.133336:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134512512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 151us (1791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843743.133344:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788843743.133477:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008624e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134512512:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788843743.578280:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788843744.016657:0:19073:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788843744.017051:0:19073:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788843744.605976:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788843744.836939:0:19123:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788843744.837355:0:19123:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1788843744.863117:0:17908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788843745.630400:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843746.651941:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788843746.714474:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788843746.714480:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788843746.714483:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788843746.714486:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788843746.714519:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1788843746.714523:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20b96c6c-8494-483a-b913-89dfc06b1440:3632:1875738134512640:0@lo:400:kworker.0 00000100:00080000:3.0:1788843746.714524:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788843746.714529:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788843746.714535:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788843746.714581:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134513024:0@lo:400:kworker.0 00000100:00100000:2.0:1788843746.714623:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843746.715339:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843746.715468:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788843746.715477:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1875738134512896:0@lo:400:kworker.0 00000100:00100000:3.0:1788843746.715509:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843746.715534:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1875738134513408:0@lo:400:kworker.0 00000100:00100000:3.0:1788843746.715557:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843746.716127:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134513024 00000100:00100000:1.0:1788843746.716158:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134513024 00000100:00100000:1.0:1788843746.716228:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788843746.716240:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134513024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843746.716316:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134513024:12345-0@lo:400:kworker.0 Request processed in 79us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843746.716336:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788843746.716367:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134513024:0@lo:400:kworker.0 00000100:00100000:3.0:1788843746.718230:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134512640 00000100:00100000:3.0:1788843746.718244:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134512640 00000100:00100000:3.0:1788843746.718301:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788843746.718313:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd114f16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+21:3632:x1875738134512640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843746.718472:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd114f16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+21:3632:x1875738134512640:12345-0@lo:400:kworker.0 Request processed in 162us (3850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843746.718480:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788843746.718533:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134512768:0@lo:400:kworker.0 00000100:00100000:3.0:1788843746.718579:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843746.718630:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1875738134513280:0@lo:400:kworker.0 00000100:00100000:3.0:1788843746.718661:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843746.718694:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788843746.718701:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134513152:0@lo:400:kworker.0 00000100:00100000:3.0:1788843746.718728:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843746.719062:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134512768 00000100:00100000:2.0:1788843746.719068:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134512768 00000100:00100000:2.0:1788843746.719195:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788843746.719204:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134512768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843746.719309:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134512768:12345-0@lo:400:kworker.0 Request processed in 107us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843746.719317:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788843746.719339:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134512896 00000100:00100000:2.0:1788843746.719343:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134512896 00000100:00100000:2.0:1788843746.719361:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134513408 00000100:00100000:2.0:1788843746.719364:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134513408 00000100:00100000:2.0:1788843746.719558:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134513280 00000100:00100000:2.0:1788843746.719563:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134513280 00000100:00100000:2.0:1788843746.719580:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134513152 00000100:00100000:2.0:1788843746.719584:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134513152 00000100:00100000:2.0:1788843746.719717:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788843746.719728:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1875738134512896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843746.719784:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1875738134512896:12345-0@lo:400:kworker.0 Request processed in 58us (4273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843746.719793:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788843746.719811:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788843746.719820:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1875738134513408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843746.719827:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134512768:0@lo:400:kworker.0 00000100:00100000:2.0:1788843746.719855:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1875738134513408:12345-0@lo:400:kworker.0 Request processed in 35us (4295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843746.719864:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788843746.719878:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788843746.719888:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875738134513280:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788843746.719889:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd141b6b800 x1875738134512896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843746.719905:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1875738134512896:0@lo:400:kworker.0 00010000:00080000:0.0:1788843746.719923:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd141b6bb80 x1875738134513408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843746.719933:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1875738134513408:0@lo:400:kworker.0 00000100:00100000:2.0:1788843746.719997:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875738134513280:12345-0@lo:400:kworker.0 Request processed in 112us (1335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843746.720014:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788843746.720027:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788843746.720033:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f986a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134513152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843746.720061:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f986a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134513152:12345-0@lo:400:kworker.0 Request processed in 28us (1332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843746.720067:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788843746.720212:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788843746.720217:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788843746.720280:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd141b6a300 x1875738134513152/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843746.720290:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134513152:0@lo:400:kworker.0 00010000:00080000:3.0:1788843746.720313:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd141b69f80 x1875738134513280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843746.720324:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1875738134513280:0@lo:400:kworker.0 00000100:00100000:2.0:1788843746.721051:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20b96c6c-8494-483a-b913-89dfc06b1440:3632:1875738134512640:0@lo:400:kworker.0 00010000:00010000:1.0:1788843747.675396:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843747.738371:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788843747.738462:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134513536:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788843747.738539:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843747.739232:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134513536 00000100:00100000:3.0:1788843747.739243:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134513536 00000100:00100000:3.0:1788843747.739312:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788843747.739324:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141aea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134513536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788843747.739365:0:17154:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788843747.739442:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141aea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134513536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843747.739451:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788843747.739494:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134513536:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788843747.802594:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843732/real 1788843732] req@ffff9bd00776b480 x1875738134505600/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843747 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843747.802628:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd00776b480 x1875738134505600/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843747 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843747.802639:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843732/real 1788843732] req@ffff9bd008625180 x1875738134505728/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843747 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843747.802650:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd008625180 x1875738134505728/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843747 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788843747.802673:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd104818000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788843747.802700:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788843747.802704:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134505600:0@lo:8:kworker.0 00000100:00080000:1.0:1788843747.802710:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd141b67000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788843747.802716:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788843747.802719:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008625180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134505728:0@lo:8:kworker.0 00000100:00080000:0.0:1788843747.803026:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788843747.803032:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788843747.803035:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788843747.803037:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788843747.803072:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788843747.803076:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788843747.803079:0:36:0:(import.c:65:import_set_state_nolock()) ffff9bd104818000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788843747.803084:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 510 00000100:00080000:0.0:1788843747.803103:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788843747.803111:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9bd104818000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:0.0:1788843747.803134:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd0084e0000 x1875738134514048/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788843747.803171:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788843747.803174:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788843747.803176:0:36:0:(import.c:65:import_set_state_nolock()) ffff9bd141b67000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788843747.803191:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 510 00000100:00080000:0.0:1788843747.803194:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788843747.803197:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9bd141b67000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:0.0:1788843747.803210:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd0084e3480 x1875738134514176/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788843747.803263:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134514048:0@lo:8:kworker.0 00000100:00100000:0.0:1788843747.803335:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843747.803379:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134514176:0@lo:8:kworker.0 00000100:00100000:1.0:1788843747.803391:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134514048 00000100:00100000:0.0:1788843747.803409:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843747.803449:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134513920:0@lo:400:kworker.0 00000100:00100000:0.0:1788843747.803477:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843747.803498:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788843747.803503:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134514304:0@lo:400:kworker.0 00000100:00100000:0.0:1788843747.803525:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843747.803564:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134513920 00000100:00100000:0.0:1788843747.803570:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134513920 00000100:00100000:0.0:1788843747.803610:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134514304 00000100:00100000:0.0:1788843747.803613:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134514304 00000100:00100000:0.0:1788843747.803750:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788843747.803767:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134513920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843747.803820:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134513920:12345-0@lo:400:kworker.0 Request processed in 54us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843747.803827:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788843747.803908:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788843747.803916:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007aca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134514304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843747.803946:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007aca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875738134514304:12345-0@lo:400:kworker.0 Request processed in 32us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843747.803951:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788843747.803991:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd0084e0700 x1875738134514304/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843747.804004:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875738134514304:0@lo:400:kworker.0 00010000:00080000:0.0:1788843747.804015:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd0084e2300 x1875738134513920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843747.804023:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134513920:0@lo:400:kworker.0 00000100:00100000:0.0:1788843747.804064:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134514176 00000100:00100000:0.0:1788843747.804067:0:18655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134514176 00000100:00100000:0.0:1788843747.804086:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788843747.804091:0:18655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3629:x1875738134514176:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788843747.804110:0:18655:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788843747.804363:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134514048 00000100:00100000:3.0:1788843747.805117:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134513792:0@lo:400:kworker.0 00000100:00100000:3.0:1788843747.805216:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843747.805246:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1875738134514560:0@lo:400:kworker.0 00000100:00100000:3.0:1788843747.805269:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843747.805291:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788843747.805297:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20b96c6c-8494-483a-b913-89dfc06b1440:3633:1875738134513664:0@lo:400:kworker.0 00000100:00100000:3.0:1788843747.805325:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843747.805352:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1875738134514432:0@lo:400:kworker.0 00000100:00100000:3.0:1788843747.805372:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843747.805402:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134513664 00000100:00100000:3.0:1788843747.805408:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134513664 00000100:00100000:3.0:1788843747.805446:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788843747.805453:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd114f17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+21:3633:x1875738134513664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843747.805495:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd114f17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+21:3633:x1875738134513664:12345-0@lo:400:kworker.0 Request processed in 43us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843747.805512:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788843747.805905:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134514560 00000100:00100000:3.0:1788843747.805911:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134514560 00000100:00100000:3.0:1788843747.805944:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134514432 00000100:00100000:3.0:1788843747.805947:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134514432 00000100:00100000:3.0:1788843747.805962:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788843747.805969:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875738134514560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843747.806019:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1875738134514560:12345-0@lo:400:kworker.0 Request processed in 51us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843747.806026:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788843747.806038:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788843747.806044:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875738134514432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843747.806071:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875738134514432:12345-0@lo:400:kworker.0 Request processed in 28us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843747.806078:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788843747.806117:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20b96c6c-8494-483a-b913-89dfc06b1440:3633:1875738134513664:0@lo:400:kworker.0 00010000:00080000:3.0:1788843747.806132:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd0084e1500 x1875738134514432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843747.806167:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1875738134514432:0@lo:400:kworker.0 00010000:00080000:3.0:1788843747.806189:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd0084e1180 x1875738134514560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843747.806199:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1875738134514560:0@lo:400:kworker.0 00000100:00100000:1.0:1788843747.806793:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134513792 00000100:00100000:1.0:1788843747.806799:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134513792 00000100:00100000:1.0:1788843747.808966:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788843747.808994:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134513792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843747.809092:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134513792:12345-0@lo:400:kworker.0 Request processed in 111us (3875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843747.809209:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134513792:0@lo:400:kworker.0 00000100:00100000:1.0:1788843747.814931:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788843747.826686:0:18655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3629:x1875738134514176:12345-0@lo:8:kworker.0 Request processed in 22582us (23265us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788843747.826768:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788843747.826779:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd141b67000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788843747.826787:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788843747.826792:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134514176:0@lo:8:kworker.0 00000100:00100000:0.0:1788843747.826807:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788843747.826827:0:18655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3629:x1875738134514048:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788843747.826926:0:18655:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 525 last 0 00000020:00000080:0.0:1788843747.826962:0:18655:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa762dfcbd58d2402 00002000:00100000:0.0:1788843747.826977:0:18655:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9bd00706d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396f ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788843747.826981:0:18655:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1788843747.826984:0:18655:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788843747.828626:0:18655:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1788843747.828677:0:18655:0:(import.c:65:import_set_state_nolock()) ffff9bd007068800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788843747.828769:0:18655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3629:x1875738134514048:12345-0@lo:8:kworker.0 Request processed in 1940us (25431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843747.828778:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788843747.828833:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd0084e0000 x1875738134514048/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788843767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843747.828964:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788843747.828973:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788843747.828982:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788843747.828988:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788843747.828990:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd104818000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788843747.829007:0:3629:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788843747.829012:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134514048:0@lo:8:kworker.0 00000004:00080000:0.0:1788843747.829099:0:17892:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788843747.829105:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788843747.829123:0:17892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ac9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17892:1875738134514816:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1788843747.829131:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134514688:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788843747.829213:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843747.829215:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843747.829241:0:17892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1106d0180 going to sleep for 11 seconds 00000100:00100000:0.0:1788843747.829271:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134514688 00000100:00100000:0.0:1788843747.829276:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134514688 00000100:00100000:0.0:1788843747.829326:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788843747.829336:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f984380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3631:x1875738134514688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788843747.829359:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788843747.829406:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f984380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3631:x1875738134514688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843747.829412:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788843747.829418:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd007acaa00 x1875738134514688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843763 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788843747.829431:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843747.829437:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134514688:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788843747.829466:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134514816 00000100:00100000:0.0:1788843747.829470:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134514816 00000100:00100000:0.0:1788843747.829491:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788843747.829497:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17892:x1875738134514816:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788843747.829779:0:17891:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788843747.829931:0:17891:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 525882788860ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788843747.829937:0:17891:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1788843747.831985:0:17882:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:2.0:1788843747.833124:0:18654:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788843747.833131:0:18654:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1788843747.833258:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17892:x1875738134514816:12345-0@lo:7:osp-pre-0-1.0 Request processed in 3755us (4042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843747.833274:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788843747.833799:0:17892:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd007ac9f80 x1875738134514816/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788843763 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843747.833814:0:17892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ac9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17892:1875738134514816:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788843747.833830:0:17892:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788843747.833874:0:17892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ac9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17892:1875738134514944:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788843747.833913:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843747.833996:0:17892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1106d0180 going to sleep for 11 seconds 00000100:00100000:1.0:1788843747.834039:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134514944 00000100:00100000:1.0:1788843747.834047:0:18655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134514944 00000100:00100000:1.0:1788843747.834124:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788843747.834136:0:18655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17892:x1875738134514944:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788843747.834203:0:18655:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1788843747.834245:0:18655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17892:x1875738134514944:12345-0@lo:5:osp-pre-0-1.0 Request processed in 112us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843747.834251:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788843747.834939:0:17892:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd007ac9f80 x1875738134514944/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788843763 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843747.834950:0:17892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ac9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17892:1875738134514944:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788843747.834961:0:17892:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788843747.835211:0:17892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f987800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17892:1875738134515072:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788843747.835500:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843747.835533:0:17892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1091443c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843747.835719:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134515072 00000100:00100000:1.0:1788843747.835726:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134515072 00000100:00100000:1.0:1788843747.835877:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788843747.835889:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f987b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17892:x1875738134515072:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788843747.835927:0:18654:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:3.0:1788843747.860568:0:18651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1788843747.860595:0:18651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788843747.860835:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f987b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17892:x1875738134515072:12345-0@lo:5:osp-pre-0-1.0 Request processed in 24939us (25325us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788843747.860850:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788843747.860945:0:17892:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd10f987800 x1875738134515072/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788843763 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843747.860961:0:17892:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788843747.860970:0:17892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f987800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17892:1875738134515072:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788843747.860995:0:17892:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1788843747.861068:0:17892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f987800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17892:1875738134515200:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788843747.861135:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843747.861213:0:17892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1091443c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843747.861224:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134515200 00000100:00100000:2.0:1788843747.861241:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134515200 00000100:00100000:2.0:1788843747.861294:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788843747.861302:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17892:x1875738134515200:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788843747.861370:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17892:x1875738134515200:12345-0@lo:900:osp-pre-0-1.0 Request processed in 68us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843747.861376:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788843747.861420:0:17892:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd10f987800 x1875738134515200/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788843763 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843747.861434:0:17892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f987800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17892:1875738134515200:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788843748.250412:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134515328:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788843748.250485:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843748.251842:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134515328 00000100:00100000:2.0:1788843748.251856:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134515328 00000100:00100000:2.0:1788843748.251924:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788843748.251945:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134515328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788843748.251982:0:17154:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788843748.252055:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134515328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (1569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843748.252062:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788843748.252110:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134515328:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788843748.699075:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843749.723945:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788843750.171029:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788843750.746357:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788843750.964719:0:19468:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788843750.964723:0:19468:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788843750.964724:0:19468:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788843750.964853:0:19468:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bd007392000 00000020:01000004:3.0:1788843750.964869:0:19468:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788843750.964885:0:19468:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788843750.964898:0:19468:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9bd005b60000) 00000020:00000080:3.0:1788843750.964915:0:19468:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788843751.073202:0:19468:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788843751.078339:0:19468:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788843751.078585:0:19468:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788843751.084005:0:19468:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788843751.084853:0:19468:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788843751.086042:0:19468:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788843751.086570:0:19468:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:2.0:1788843751.090517:0:19468:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788843751.090753:0:19468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788843751.090768:0:19468:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788843751.090780:0:19468:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa762dfcbd58d2410 00000020:01000004:2.0:1788843751.090788:0:19468:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788843751.090808:0:19468:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.133@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788843751.090818:0:19468:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.133@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788843751.090834:0:19468:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788843751.090866:0:19468:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1788843751.090870:0:19468:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.133@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788843751.117204:0:19468:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.133@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788843751.117248:0:19468:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.133@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788843751.117253:0:19468:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788843751.117255:0:19468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788843751.117256:0:19468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788843751.117258:0:19468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788843751.117260:0:19468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788843751.117261:0:19468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788843751.117262:0:19468:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788843751.117264:0:19468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788843751.117266:0:19468:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788843751.117270:0:19468:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788843751.117272:0:19468:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788843751.117273:0:19468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788843751.117274:0:19468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788843751.117276:0:19468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788843751.117277:0:19468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788843751.117278:0:19468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788843751.117279:0:19468:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788843751.117280:0:19468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788843751.117282:0:19468:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788843751.117316:0:19468:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788843751.117340:0:19468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f986300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134515456:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788843751.117416:0:19468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843751.117455:0:19468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1052cd480 going to sleep for 11 seconds 00000100:00100000:0.0:1788843751.117934:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134515456 00000100:00100000:0.0:1788843751.117944:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134515456 00000100:00100000:0.0:1788843751.118006:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788843751.118018:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd114f16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+21:19468:x1875738134515456:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788843751.118064:0:17145:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788843751.118069:0:17145:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788843751.118073:0:17145:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788843751.118514:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd114f16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+21:19468:x1875738134515456:12345-0@lo:253:mount.lustre.0 Request processed in 496us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843751.118523:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788843751.121376:0:19468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f986300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134515456:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788843751.121420:0:19468:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788843751.121423:0:19468:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788843751.121425:0:19468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788843751.121426:0:19468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788843751.121427:0:19468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788843751.121428:0:19468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788843751.121430:0:19468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788843751.121431:0:19468:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788843751.121433:0:19468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788843751.121434:0:19468:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788843751.121459:0:19468:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bd007392000 from lustre-OST0001 10000000:01000000:3.0:1788843751.121490:0:19468:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788843751.121493:0:19468:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788843751.121502:0:19468:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bd10fbb0000 local copy 00010000:00010000:3.0:1788843751.121514:0:19468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d212a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2131 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843751.121628:0:19468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f986300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134515584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843751.121694:0:19468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843751.121795:0:19468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1106d0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788843751.122886:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134515584 00000100:00100000:0.0:1788843751.122899:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134515584 00000100:00100000:0.0:1788843751.123003:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788843751.123014:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+21:19468:x1875738134515584:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788843751.123407:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+21:19468:x1875738134515584:12345-0@lo:501:mount.lustre.0 Request processed in 393us (1711us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788843751.123415:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788843751.123518:0:19468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f986300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134515584:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788843751.123539:0:19468:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.133@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788843751.123565:0:19468:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.133@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788843751.123575:0:19468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d212a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2131 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843751.123585:0:19468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007947e00/0xa762dfcbd58d212a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2131 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843751.123613:0:19468:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bd007392000 10000000:01000000:1.0:1788843751.123617:0:19468:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788843751.123622:0:19468:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788843751.123636:0:19468:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788843751.123640:0:19468:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788843751.123643:0:19468:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788843751.123674:0:19468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeae00/0xa762dfcbd58d2417 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843751.123682:0:19468:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeae00/0xa762dfcbd58d2417 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843751.123692:0:19468:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeae00/0xa762dfcbd58d2417 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843751.123711:0:19468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008625180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134515712:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788843751.123746:0:19468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843751.124035:0:19468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12047f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843751.124431:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134515712 00000100:00100000:3.0:1788843751.124440:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134515712 00000100:00100000:3.0:1788843751.124474:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788843751.124481:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+21:19468:x1875738134515712:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788843751.124491:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843751.124505:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007be2a00/0xa762dfcbd58d241e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2417 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843751.124531:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007be2a00/0xa762dfcbd58d241e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2417 expref: 22 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843751.124541:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007be2a00/0xa762dfcbd58d241e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2417 expref: 22 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843751.124558:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be2a00, rc 0) 00000100:00100000:3.0:1788843751.124592:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+22:19468:x1875738134515712:12345-0@lo:101:mount.lustre.0 Request processed in 111us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843751.124598:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788843751.124740:0:19468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008625180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134515712:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788843751.124754:0:19468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeae00/0xa762dfcbd58d2417 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d241e expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843751.124762:0:19468:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeae00/0xa762dfcbd58d2417 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d241e expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788843751.125916:0:19468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788843751.126997:0:19468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788843751.129260:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788843751.129316:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788843751.129333:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788843751.129348:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788843751.129362:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788843751.129377:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788843751.129402:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788843751.129408:0:19468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788843751.129528:0:19468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f986d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134515840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843751.129598:0:19468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843751.129770:0:19468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1106d0780 going to sleep for 11 seconds 00000100:00100000:0.0:1788843751.130354:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134515840 00000100:00100000:0.0:1788843751.130364:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134515840 00000100:00100000:1.0:1788843751.130549:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788843751.130558:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+22:19468:x1875738134515840:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788843751.130762:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+22:19468:x1875738134515840:12345-0@lo:501:mount.lustre.0 Request processed in 204us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843751.130770:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788843751.130904:0:19468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f986d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134515840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843751.130945:0:19468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f986d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134515968:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788843751.130986:0:19468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843751.131047:0:19468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1106d0780 going to sleep for 11 seconds 00000100:00100000:1.0:1788843751.131253:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134515968 00000100:00100000:1.0:1788843751.131258:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134515968 00000100:00100000:1.0:1788843751.131323:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788843751.131331:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+22:19468:x1875738134515968:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788843751.131956:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+22:19468:x1875738134515968:12345-0@lo:503:mount.lustre.0 Request processed in 624us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843751.131964:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788843751.132035:0:19468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f986d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134515968:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788843751.132469:0:19468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788843751.132544:0:19468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f986d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134516096:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788843751.132587:0:19468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843751.137626:0:19468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1106d0780 going to sleep for 11 seconds 00000100:00100000:0.0:1788843751.137737:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134516096 00000100:00100000:0.0:1788843751.137752:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134516096 00000100:00100000:0.0:1788843751.137816:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788843751.137839:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+22:19468:x1875738134516096:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788843751.138589:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+22:19468:x1875738134516096:12345-0@lo:502:mount.lustre.0 Request processed in 751us (5998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843751.138599:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788843751.138714:0:19468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f986d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134516096:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788843751.138937:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788843751.138967:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788843751.138984:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788843751.138997:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788843751.139010:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788843751.139022:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788843751.139033:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788843751.139044:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788843751.139072:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1788843751.139108:0:19468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f986d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134516224:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788843751.139214:0:19468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843751.139239:0:19468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1106d0780 going to sleep for 11 seconds 00000100:00100000:0.0:1788843751.139397:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134516224 00000100:00100000:0.0:1788843751.139404:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134516224 00000100:00100000:0.0:1788843751.139432:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788843751.139439:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+22:19468:x1875738134516224:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788843751.139525:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+22:19468:x1875738134516224:12345-0@lo:502:mount.lustre.0 Request processed in 85us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843751.139532:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788843751.140509:0:19468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f986d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134516224:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788843751.140574:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1788843751.140585:0:19468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1788843751.143069:0:19472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788843751.143079:0:19472:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788843751.143086:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843751.143088:0:19472:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788843751.143095:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788843751.143111:0:19472:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9bd005b63370) 00000020:00000080:3.0:1788843751.143137:0:19472:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788843751.143178:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788843751.143245:0:19472:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd007392000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788843751.143255:0:19472:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788843751.143280:0:19472:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa762dfcbd58d242c 00010000:00010000:3.0:1788843751.150570:0:19472:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1788843751.152012:0:19472:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:3.0:1788843751.155328:0:19472:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1788843751.160697:0:19472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788843751.160710:0:19472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843751.160717:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843751.160719:0:19472:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788843751.160722:0:19472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843751.160726:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843751.160728:0:19472:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788843751.160731:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788843751.160733:0:19472:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788843751.160735:0:19472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843751.160737:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843751.160738:0:19472:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788843751.160740:0:19472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843751.160742:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843751.160744:0:19472:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788843751.160746:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788843751.160777:0:19472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843751.160780:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843751.160782:0:19472:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788843751.160785:0:19472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1788843751.162876:0:19468:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788843751.162921:0:19468:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788843751.162944:0:19468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeae00/0xa762dfcbd58d2417 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d241e expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843751.162957:0:19468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd13fbeae00/0xa762dfcbd58d2417 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d241e expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843751.162966:0:19468:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd007392000 from 1 10000000:01000000:3.0:1788843751.162968:0:19468:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788843751.163012:0:19468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007be2400/0xa762dfcbd58d2433 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843751.163020:0:19468:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd007be2400/0xa762dfcbd58d2433 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843751.163031:0:19468:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd007be2400/0xa762dfcbd58d2433 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843751.163057:0:19468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f986d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134516352:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788843751.163137:0:19468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843751.163214:0:19468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1012ed600 going to sleep for 11 seconds 00000100:00100000:2.0:1788843751.167249:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134516352 00000100:00100000:2.0:1788843751.167267:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134516352 00000100:00100000:2.0:1788843751.167329:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788843751.167340:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+22:19468:x1875738134516352:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843751.167360:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843751.167380:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d243a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2433 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843751.167412:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d243a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2433 expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843751.167425:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d243a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2433 expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843751.167434:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007947400, rc 0) 00000100:00100000:2.0:1788843751.167519:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+23:19468:x1875738134516352:12345-0@lo:101:mount.lustre.0 Request processed in 180us (4381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843751.167525:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788843751.167723:0:19468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f986d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134516352:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788843751.167743:0:19468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd007be2400/0xa762dfcbd58d2433 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d243a expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843751.167753:0:19468:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd007be2400/0xa762dfcbd58d2433 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d243a expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788843751.174184:0:19468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788843751.174481:0:19468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788843751.174656:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788843751.174683:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788843751.174704:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788843751.174710:0:19468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788843751.174790:0:19468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f986d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134516480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843751.174874:0:19468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843751.174924:0:19468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd12047f480 going to sleep for 11 seconds 00000100:00100000:1.0:1788843751.174926:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134516480 00000100:00100000:1.0:1788843751.174936:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134516480 00000100:00100000:1.0:1788843751.174983:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788843751.174992:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+23:19468:x1875738134516480:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788843751.175166:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+23:19468:x1875738134516480:12345-0@lo:501:mount.lustre.0 Request processed in 164us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843751.175175:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788843751.177512:0:19468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f986d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134516480:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843751.177667:0:19468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134516608:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788843751.177733:0:19468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843751.177779:0:19468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd104a350c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843751.178297:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134516608 00000100:00100000:3.0:1788843751.178306:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134516608 00000100:00100000:3.0:1788843751.178372:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788843751.178383:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+23:19468:x1875738134516608:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788843751.178515:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+23:19468:x1875738134516608:12345-0@lo:503:mount.lustre.0 Request processed in 132us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843751.178523:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788843751.180444:0:19468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134516608:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788843751.180991:0:19468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788843751.181436:0:19468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007acbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134516736:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788843751.181538:0:19468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843751.181636:0:19468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd107659780 going to sleep for 11 seconds 00000100:00100000:1.0:1788843751.186446:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134516736 00000100:00100000:1.0:1788843751.186461:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134516736 00000100:00100000:0.0:1788843751.186594:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788843751.186606:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+23:19468:x1875738134516736:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788843751.186783:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+23:19468:x1875738134516736:12345-0@lo:502:mount.lustre.0 Request processed in 179us (5246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843751.186792:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788843751.186967:0:19468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007acbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134516736:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788843751.187265:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788843751.187300:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788843751.187311:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788843751.187322:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788843751.187334:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788843751.187348:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788843751.187361:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788843751.187373:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1788843751.187385:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788843751.187397:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1788843751.187410:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1788843751.187450:0:19468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141aeb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134516864:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843751.187506:0:19468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843751.187545:0:19468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd104a35540 going to sleep for 11 seconds 00000100:00100000:0.0:1788843751.187695:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134516864 00000100:00100000:0.0:1788843751.187701:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134516864 00000100:00100000:0.0:1788843751.187734:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788843751.187742:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+23:19468:x1875738134516864:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788843751.187818:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+23:19468:x1875738134516864:12345-0@lo:502:mount.lustre.0 Request processed in 76us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843751.187838:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788843751.188055:0:19468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141aeb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134516864:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788843751.188097:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1788843751.188104:0:19468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788843751.190235:0:19476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843751.190248:0:19476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843751.190251:0:19476:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788843751.190258:0:19476:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd007392000 00000020:00000080:1.0:1788843751.190261:0:19476:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788843751.190268:0:19476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843751.190271:0:19476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843751.190272:0:19476:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788843751.190275:0:19476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843751.190277:0:19476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843751.190278:0:19476:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788843751.190281:0:19476:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd007392000 00000020:00000080:1.0:1788843751.190283:0:19476:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788843751.190336:0:19476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843751.190350:0:19476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843751.190351:0:19476:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788843751.190354:0:19476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843751.190356:0:19476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843751.190361:0:19476:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788843751.190365:0:19476:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd007392000 00000020:00000080:1.0:1788843751.190367:0:19476:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788843751.190385:0:19476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843751.190387:0:19476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843751.190388:0:19476:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788843751.190390:0:19476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843751.190392:0:19476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843751.190394:0:19476:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788843751.190397:0:19476:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd007392000 00000020:00000080:1.0:1788843751.190399:0:19476:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788843751.190417:0:19476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843751.190419:0:19476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843751.190421:0:19476:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788843751.190423:0:19476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1788843751.190581:0:19468:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788843751.190610:0:19468:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788843751.190630:0:19468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007be2400/0xa762dfcbd58d2433 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d243a expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843751.190643:0:19468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007be2400/0xa762dfcbd58d2433 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d243a expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843751.190692:0:19468:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788843751.190695:0:19468:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bd007392000 10000000:01000000:0.0:1788843751.190698:0:19468:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bd007392000 10000000:01000000:0.0:1788843751.190701:0:19468:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788843751.190706:0:19468:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd007392000 from 1 10000000:01000000:0.0:1788843751.190708:0:19468:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788843751.190744:0:19468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3da00/0xa762dfcbd58d2441 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843751.190757:0:19468:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3da00/0xa762dfcbd58d2441 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843751.190768:0:19468:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3da00/0xa762dfcbd58d2441 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843751.190792:0:19468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ac9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134516992:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788843751.190861:0:19468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843751.190894:0:19468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1076596c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843751.191002:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134516992 00000100:00100000:3.0:1788843751.191017:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134516992 00000100:00100000:3.0:1788843751.191064:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788843751.191072:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+23:19468:x1875738134516992:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788843751.191084:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843751.191096:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007be3600/0xa762dfcbd58d2448 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2441 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843751.191120:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007be3600/0xa762dfcbd58d2448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2441 expref: 24 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843751.191131:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007be3600/0xa762dfcbd58d2448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2441 expref: 24 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843751.191181:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be3600, rc 0) 00000100:00100000:3.0:1788843751.191216:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+24:19468:x1875738134516992:12345-0@lo:101:mount.lustre.0 Request processed in 144us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843751.191222:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788843751.191371:0:19468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ac9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134516992:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788843751.191385:0:19468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3da00/0xa762dfcbd58d2441 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2448 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843751.191395:0:19468:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3da00/0xa762dfcbd58d2441 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2448 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788843751.210979:0:19468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:3.0:1788843751.211313:0:19468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788843751.211515:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788843751.211542:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788843751.211559:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788843751.211571:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788843751.211585:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788843751.211599:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788843751.211613:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788843751.211626:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788843751.211639:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788843751.211651:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788843751.211663:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788843751.211675:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788843751.211687:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788843751.211700:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788843751.211713:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788843751.211726:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788843751.211746:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788843751.211761:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788843751.211774:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788843751.211787:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788843751.211801:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788843751.211815:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788843751.213205:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788843751.213246:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788843751.213267:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1788843751.213280:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1788843751.213291:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1788843751.213302:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1788843751.213314:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1788843751.213327:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1788843751.213342:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1788843751.213355:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1788843751.213367:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1788843751.213379:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1788843751.213393:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1788843751.213407:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1788843751.213420:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1788843751.213435:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1788843751.213449:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:3.0:1788843751.213463:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:3.0:1788843751.213477:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:3.0:1788843751.213490:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:3.0:1788843751.213501:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:3.0:1788843751.213532:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:3.0:1788843751.213547:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:3.0:1788843751.213559:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:3.0:1788843751.213588:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:3.0:1788843751.213593:0:19468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:3.0:1788843751.213711:0:19468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f985880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134517120:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843751.213782:0:19468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843751.216372:0:19468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0086e2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788843751.216408:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134517120 00000100:00100000:3.0:1788843751.216419:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134517120 00000100:00100000:3.0:1788843751.216521:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788843751.216532:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+24:19468:x1875738134517120:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843751.216723:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+24:19468:x1875738134517120:12345-0@lo:501:mount.lustre.0 Request processed in 192us (2939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843751.216732:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788843751.227232:0:19468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f985880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134517120:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843751.227316:0:19468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141aeb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134517248:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788843751.227386:0:19468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843751.227426:0:19468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd102d36d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788843751.227447:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134517248 00000100:00100000:2.0:1788843751.227454:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134517248 00000100:00100000:2.0:1788843751.227500:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788843751.227509:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+24:19468:x1875738134517248:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788843751.227614:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+24:19468:x1875738134517248:12345-0@lo:503:mount.lustre.0 Request processed in 105us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843751.227622:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788843751.227672:0:19468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141aeb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134517248:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788843751.228396:0:19468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788843751.228461:0:19468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141aeb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134517376:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843751.228501:0:19468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843751.228526:0:19468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd102d36d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788843751.228541:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134517376 00000100:00100000:2.0:1788843751.228546:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134517376 00000100:00100000:2.0:1788843751.228567:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788843751.228574:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+24:19468:x1875738134517376:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843751.228651:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+24:19468:x1875738134517376:12345-0@lo:502:mount.lustre.0 Request processed in 76us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843751.228659:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788843751.228697:0:19468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141aeb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134517376:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788843751.230993:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788843751.231110:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788843751.231125:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788843751.231137:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788843751.231184:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788843751.231197:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788843751.231221:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788843751.231234:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788843751.231245:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788843751.231259:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788843751.231273:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788843751.231286:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788843751.231299:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788843751.231311:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788843751.231322:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788843751.231346:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788843751.231359:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788843751.231372:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788843751.231386:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788843751.231399:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788843751.231411:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788843751.231422:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788843751.231449:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788843751.231466:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788843751.231479:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788843751.231491:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788843751.231503:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788843751.231516:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788843751.231528:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788843751.231542:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788843751.231556:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788843751.231571:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788843751.231584:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788843751.231598:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788843751.231611:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788843751.231624:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788843751.231638:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788843751.231652:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788843751.231679:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788843751.231693:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788843751.231705:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788843751.231718:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788843751.231729:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788843751.231741:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788843751.231754:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788843751.231765:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788843751.231779:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788843751.231792:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788843751.233653:0:19468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141aeb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134517504:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843751.233739:0:19468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843751.233782:0:19468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd102d36d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788843751.233808:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134517504 00000100:00100000:2.0:1788843751.233815:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134517504 00000100:00100000:2.0:1788843751.233879:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788843751.233888:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+24:19468:x1875738134517504:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843751.234019:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+24:19468:x1875738134517504:12345-0@lo:502:mount.lustre.0 Request processed in 119us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843751.234027:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788843751.234098:0:19468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141aeb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134517504:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788843751.237125:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1788843751.237188:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1788843751.237236:0:19468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141aeb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134517632:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843751.237304:0:19468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843751.237344:0:19468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd102d36d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788843751.237396:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134517632 00000100:00100000:2.0:1788843751.237402:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134517632 00000100:00100000:2.0:1788843751.237446:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788843751.237454:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+24:19468:x1875738134517632:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843751.237549:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+24:19468:x1875738134517632:12345-0@lo:502:mount.lustre.0 Request processed in 94us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843751.237556:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788843751.237604:0:19468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141aeb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134517632:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788843751.237640:0:19468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1788843751.237646:0:19468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788843751.239116:0:19482:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788843751.239135:0:19482:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9bd13df34d28) 00000020:00000080:1.0:1788843751.239220:0:19482:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1788843751.239306:0:19482:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd007392000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788843751.239311:0:19482:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd007392000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788843751.239313:0:19482:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd007392000 3 00010000:00080000:1.0:1788843751.239345:0:19482:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd006524800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.133@tcp at head 00010000:00010000:1.0:1788843751.242540:0:19482:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1788843751.242748:0:19482:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788843751.242794:0:19482:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788843751.242806:0:19482:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa762dfcbd58d2456 00000100:00080000:1.0:1788843751.242816:0:19482:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788843751.242821:0:19482:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bd006524800 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:1.0:1788843751.242869:0:19482:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd008625180 x1875738134517760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788843751.242919:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008625180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1875738134517760:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788843751.242993:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843751.243997:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134517760 00000100:00100000:1.0:1788843751.244931:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134517760 00000100:00100000:1.0:1788843751.244985:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788843751.244993:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008626680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3629:x1875738134517760:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788843751.245099:0:17151:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:1.0:1788843751.245138:0:17151:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa762dfcbd58d245d 00000004:00100000:1.0:1788843751.245500:0:17151:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788843751.245538:0:17151:0:(import.c:65:import_set_state_nolock()) ffff9bd008464800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843751.246954:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008626680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1875738134517760:12345-0@lo:38:llog_process_th.0 Request processed in 1954us (3954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843751.246967:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788843751.248054:0:19482:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000020:01000004:1.0:1788843751.248460:0:19482:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788843751.248477:0:19482:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9bd13df33370) 00000020:00000080:1.0:1788843751.248502:0:19482:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788843751.248585:0:19482:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd007392000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788843751.248590:0:19482:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd007392000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788843751.248593:0:19482:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd007392000 3 00010000:00080000:1.0:1788843751.248624:0:19482:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd006525000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.133@tcp at head 00000100:00080000:0.0:1788843751.250292:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788843751.250299:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788843751.250302:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788843751.250305:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788843751.250338:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788843751.250341:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788843751.250346:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bd141b67000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788843751.250354:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 525 00000100:00080000:0.0:1788843751.250360:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788843751.250374:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9bd141b67000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:0.0:1788843751.250402:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd007ac8700 x1875738134518400/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788843751.250455:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134518016:0@lo:400:kworker.0 00000100:00100000:0.0:1788843751.250529:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843751.250566:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1875738134518656:0@lo:400:kworker.0 00000100:00100000:0.0:1788843751.250596:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843751.250622:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788843751.250629:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134517888:0@lo:400:kworker.0 00000100:00100000:0.0:1788843751.250655:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843751.250674:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134518528:0@lo:400:kworker.0 00000100:00100000:0.0:1788843751.250696:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843751.250722:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134518144:0@lo:400:kworker.0 00000100:00100000:0.0:1788843751.250747:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843751.250765:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134518784:0@lo:400:kworker.0 00000100:00100000:0.0:1788843751.250788:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843751.250801:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788843751.250806:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134518272:0@lo:400:kworker.0 00010000:00010000:1.0:1788843751.252371:0:19482:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1788843751.252564:0:19482:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788843751.252615:0:19482:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788843751.252637:0:19482:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xa762dfcbd58d246b 00000100:00080000:1.0:1788843751.252652:0:19482:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788843751.252658:0:19482:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9bd006525000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:1.0:1788843751.252695:0:19482:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd008624000 x1875738134518912/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788843751.252710:0:19482:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:1.0:1788843751.253209:0:19482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1788843751.253394:0:19468:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788843751.253424:0:19468:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788843751.253445:0:19468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3da00/0xa762dfcbd58d2441 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2448 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843751.253457:0:19468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3da00/0xa762dfcbd58d2441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2448 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788843751.253504:0:19468:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788843751.253507:0:19468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788843751.253508:0:19468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843751.253509:0:19468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843751.253510:0:19468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843751.253512:0:19468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843751.253513:0:19468:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788843751.253515:0:19468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843751.253516:0:19468:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788843751.253520:0:19468:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788843751.253522:0:19468:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788843751.253524:0:19468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788843751.253524:0:19468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843751.253525:0:19468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843751.253526:0:19468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843751.253527:0:19468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843751.253528:0:19468:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788843751.253530:0:19468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843751.253530:0:19468:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788843751.253549:0:19468:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788843751.253565:0:19468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141aeb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134519040:0@lo:253:mount.lustre.0 00010000:00080000:3.0:1788843751.253659:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd008625180 x1875738134517760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788843761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843751.253671:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788843751.253680:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788843751.253687:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788843751.253692:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788843751.253696:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd006524800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788843751.253704:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008625180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1875738134517760:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788843751.253733:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134518400:0@lo:8:kworker.0 00000100:00100000:3.0:1788843751.253789:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843751.253818:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3629:1875738134518912:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788843751.253854:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843751.254003:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134518400 00000100:00100000:1.0:1788843751.254022:0:18655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134518400 00000100:00100000:1.0:1788843751.254062:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788843751.254069:0:18655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f987480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3629:x1875738134518400:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788843751.254132:0:18655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f987480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3629:x1875738134518400:12345-0@lo:8:kworker.0 Request processed in 61us (341us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788843751.254172:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788843751.254202:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788843751.254207:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd141b67000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788843751.254210:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788843751.254213:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134518400:0@lo:8:kworker.0 00000100:00100000:0.0:1788843751.254384:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843751.254460:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134518016 00000100:00100000:0.0:1788843751.254465:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134518016 00000100:00100000:0.0:1788843751.254493:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134518656 00000100:00100000:0.0:1788843751.254496:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134518656 00000100:00100000:0.0:1788843751.254530:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134518528 00000100:00100000:0.0:1788843751.254533:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134518528 00000100:00100000:0.0:1788843751.254544:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134518784 00000100:00100000:0.0:1788843751.254556:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134518784 00000100:00100000:0.0:1788843751.254574:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134518912 00000100:00100000:0.0:1788843751.254576:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134518912 00000100:00100000:0.0:1788843751.254587:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788843751.254593:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134518016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843751.254638:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134518016:12345-0@lo:400:kworker.0 Request processed in 45us (4109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843751.254644:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788843751.254658:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788843751.254663:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875738134518656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843751.254693:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875738134518656:12345-0@lo:400:kworker.0 Request processed in 30us (4096us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843751.254699:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788843751.254710:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788843751.254716:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134518528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843751.254745:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134518528:12345-0@lo:400:kworker.0 Request processed in 30us (4048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843751.254751:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788843751.254763:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788843751.254768:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134518784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843751.254801:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134518784:12345-0@lo:400:kworker.0 Request processed in 33us (4012us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843751.254806:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788843751.254817:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788843751.254910:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788843751.254915:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843751.254937:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3629:x1875738134518912:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788843751.254959:0:17150:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:0.0:1788843751.255076:0:17150:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xa762dfcbd58d2472 00000004:00100000:0.0:1788843751.255092:0:17150:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788843751.255125:0:17150:0:(import.c:65:import_set_state_nolock()) ffff9bd00706c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788843751.255210:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1875738134518912:12345-0@lo:38:llog_process_th.0 Request processed in 386us (1353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843751.255216:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788843751.255242:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134517888 00000100:00100000:0.0:1788843751.255247:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134517888 00000100:00100000:0.0:1788843751.255275:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134518144 00000100:00100000:0.0:1788843751.255278:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134518144 00000100:00100000:0.0:1788843751.255291:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788843751.255297:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134517888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843751.255331:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134517888:12345-0@lo:400:kworker.0 Request processed in 34us (4676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843751.255337:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788843751.255350:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788843751.255355:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134518144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843751.255383:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134518144:12345-0@lo:400:kworker.0 Request processed in 28us (4636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843751.255389:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1788843751.255416:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788843751.255421:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788843751.255424:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788843751.255427:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788843751.255462:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134517888:0@lo:400:kworker.0 00010000:00080000:0.0:1788843751.255488:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd007acb800 x1875738134518528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843751.255500:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134518528:0@lo:400:kworker.0 00010000:00080000:0.0:1788843751.255512:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd007ac9180 x1875738134518016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843751.255519:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134518016:0@lo:400:kworker.0 00010000:00080000:0.0:1788843751.255530:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd007acb480 x1875738134518656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843751.255539:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1875738134518656:0@lo:400:kworker.0 00000100:00100000:0.0:1788843751.255575:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134518144:0@lo:400:kworker.0 00010000:00080000:0.0:1788843751.255587:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd007ac8e00 x1875738134518784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843751.255595:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134518784:0@lo:400:kworker.0 00010000:00080000:1.0:1788843751.255950:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd008624000 x1875738134518912/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788843761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843751.255958:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788843751.255964:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1788843751.255971:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788843751.255975:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788843751.255978:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd006525000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788843751.255983:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3629:1875738134518912:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788843751.256229:0:19468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843751.256262:0:19468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd102d366c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843751.256294:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134519040 00000100:00100000:2.0:1788843751.256300:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134519040 00000100:00100000:2.0:1788843751.256331:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788843751.256338:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+24:19468:x1875738134519040:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788843751.256370:0:17144:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788843751.256384:0:17144:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788843751.257130:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134518272 00000100:00100000:3.0:1788843751.257170:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134518272 00000100:00100000:3.0:1788843751.257222:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788843751.257232:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007acaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134518272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843751.257301:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007acaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134518272:12345-0@lo:400:kworker.0 Request processed in 71us (2916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843751.257307:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788843751.257520:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788843751.257733:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd007ac8380 x1875738134518272/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843751.257746:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134518272:0@lo:400:kworker.0 20000000:01000000:2.0:1788843751.261462:0:17144:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788843751.261482:0:17144:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788843751.261641:0:17165:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788843751.261647:0:17165:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788843751.261673:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd10fa3c600/0xa762dfcbd58d2479 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843751.261693:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd13fbea800/0xa762dfcbd58d23ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d23e6 expref: 24 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843751.261718:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd10fa3cc00/0xa762dfcbd58d23fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d23f4 expref: 24 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843751.261727:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd10fa3c600/0xa762dfcbd58d2479 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843751.261773:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd10fa3cc00/0xa762dfcbd58d23fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d23f4 expref: 24 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843751.261788:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd10fa3cc00/0xa762dfcbd58d23fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d23f4 expref: 24 pid: 17142 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843751.261803:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ac8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17165:1875738134519168:0@lo:104: 00000100:00100000:1.0:1788843751.262101:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+24:19468:x1875738134519040:12345-0@lo:253:mount.lustre.0 Request processed in 5761us (5871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843751.262112:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788843751.262340:0:19468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141aeb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:20b96c6c-8494-483a-b913-89dfc06b1440:19468:1875738134519040:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788843751.262354:0:19468:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788843751.262357:0:19468:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788843751.262359:0:19468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788843751.262360:0:19468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843751.262361:0:19468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843751.262363:0:19468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843751.262364:0:19468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843751.262366:0:19468:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788843751.262368:0:19468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843751.262369:0:19468:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788843751.262384:0:19468:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788843751.262935:0:17165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788843751.262995:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd13fbea800/0xa762dfcbd58d23ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d23e6 expref: 23 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843751.263072:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd13fbea800/0xa762dfcbd58d23ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d23e6 expref: 23 pid: 17142 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843751.263083:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007acb100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17165:1875738134519296:0@lo:104: 00000100:00100000:0.0:1788843751.263106:0:17165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843751.263125:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd107659900 going to sleep for 11 seconds 00000100:00100000:0.0:1788843751.263172:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134519168 00000100:00100000:0.0:1788843751.263179:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134519168 00000100:00100000:0.0:1788843751.263216:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134519296 00000100:00100000:0.0:1788843751.263218:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134519296 00000100:00100000:0.0:1788843751.263232:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788843751.263240:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20b96c6c-8494-483a-b913-89dfc06b1440+4:17165:x1875738134519168:12345-0@lo:104: 00010000:00010000:0.0:1788843751.263262:0:17133:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd007be3e00/0xa762dfcbd58d23f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d23fb expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843751.263311:0:17133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788843751.263318:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20b96c6c-8494-483a-b913-89dfc06b1440+4:17165:x1875738134519168:12345-0@lo:104: Request processed in 79us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843751.263325:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788843751.263340:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788843751.263347:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007acb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20b96c6c-8494-483a-b913-89dfc06b1440+3:17165:x1875738134519296:12345-0@lo:104: 00010000:00010000:0.0:1788843751.263355:0:17133:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd007be3400/0xa762dfcbd58d23e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d23ed expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843751.263402:0:17133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788843751.263407:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007acb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:20b96c6c-8494-483a-b913-89dfc06b1440+3:17165:x1875738134519296:12345-0@lo:104: Request processed in 62us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843751.263413:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788843751.263430:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788843751.263437:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd007be3e00/0xa762dfcbd58d23f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d23fb expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843751.263445:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be3e00 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:0.0:1788843751.263449:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd007be3e00/0xa762dfcbd58d23f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d23fb expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843751.263458:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd007be3e00/0xa762dfcbd58d23f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d23fb expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843751.263466:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd007be3e00/0xa762dfcbd58d23f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d23fb expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843751.263478:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788843751.263507:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd007be3e00/0xa762dfcbd58d23f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d23fb expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843751.263514:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843751.263532:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd007be3e00/0xa762dfcbd58d23f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d23fb expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843751.263538:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd007be3e00/0xa762dfcbd58d23f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d23fb expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843751.263549:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843751.263552:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd007be3400/0xa762dfcbd58d23e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d23ed expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843751.263558:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be3400 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:0.0:1788843751.263560:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd007be3400/0xa762dfcbd58d23e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d23ed expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843751.263566:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd007be3400/0xa762dfcbd58d23e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d23ed expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843751.263571:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd007be3400/0xa762dfcbd58d23e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d23ed expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843751.263575:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788843751.263586:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd007be3400/0xa762dfcbd58d23e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d23ed expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843751.263592:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843751.263612:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd007be3400/0xa762dfcbd58d23e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d23ed expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843751.263619:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd007be3400/0xa762dfcbd58d23e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d23ed expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843751.263631:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843751.263633:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843751.263634:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843751.263640:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843751.263650:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20b96c6c-8494-483a-b913-89dfc06b1440:3631:1875738134519424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788843751.263678:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843751.263714:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20b96c6c-8494-483a-b913-89dfc06b1440:3632:1875738134519552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788843751.263736:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843751.263769:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134519424 00000100:00100000:0.0:1788843751.263774:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134519424 00010000:00010000:0.0:1788843751.263789:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd10fa3cc00/0xa762dfcbd58d23fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d23f4 expref: 24 pid: 17142 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843751.263805:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134519552 00000100:00100000:0.0:1788843751.263808:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134519552 00010000:00010000:0.0:1788843751.263817:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd13fbea800/0xa762dfcbd58d23ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d23e6 expref: 25 pid: 17142 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843751.263948:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788843751.263957:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20b96c6c-8494-483a-b913-89dfc06b1440+25:3631:x1875738134519424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788843751.263969:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843751.263975:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd10fa3cc00/0xa762dfcbd58d23fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d23f4 expref: 25 pid: 17142 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843751.263987:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd10fa3cc00/0xa762dfcbd58d23fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d23f4 expref: 25 pid: 17142 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843751.264003:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843751.264045:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20b96c6c-8494-483a-b913-89dfc06b1440+25:3631:x1875738134519424:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843751.264051:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788843751.264080:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20b96c6c-8494-483a-b913-89dfc06b1440:3631:1875738134519424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788843751.266110:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788843751.266127:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20b96c6c-8494-483a-b913-89dfc06b1440+24:3632:x1875738134519552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788843751.266180:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843751.266189:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd13fbea800/0xa762dfcbd58d23ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d23e6 expref: 24 pid: 17142 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843751.266216:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd13fbea800/0xa762dfcbd58d23ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d23e6 expref: 24 pid: 17142 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843751.266238:0:17135:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd10fa3c600/0xa762dfcbd58d2479 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843751.266248:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd10fa3c600/0xa762dfcbd58d2479 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788843751.266266:0:17135:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004619339s 00010000:00010000:0.0:1788843751.266271:0:17135:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd10fa3c600/0xa762dfcbd58d2479 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843751.266278:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd10fa3c600/0xa762dfcbd58d2479 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843751.266285:0:17135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd10fa3c600/0xa762dfcbd58d2479 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843751.266292:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd10fa3c600/0xa762dfcbd58d2479 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843751.266298:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3c600 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843751.266303:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd10fa3c600/0xa762dfcbd58d2479 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843751.266312:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd10fa3c600/0xa762dfcbd58d2479 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843751.266321:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd10fa3c600/0xa762dfcbd58d2479 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843751.266339:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843751.266400:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20b96c6c-8494-483a-b913-89dfc06b1440+24:3632:x1875738134519552:12345-0@lo:103:ldlm_bl.0 Request processed in 281us (2662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843751.266408:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788843751.266465:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20b96c6c-8494-483a-b913-89dfc06b1440:3632:1875738134519552:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788843751.266505:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd10fa3cc00/0xa762dfcbd58d23fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d23f4 expref: 23 pid: 17142 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843751.266517:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ac8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17165:1875738134519168:0@lo:104: 00010000:00010000:0.0:1788843751.266528:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd13fbea800/0xa762dfcbd58d23ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d23e6 expref: 22 pid: 17142 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843751.266536:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007acb100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17165:1875738134519296:0@lo:104: 00010000:00010000:0.0:1788843751.266549:0:17165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd10fa3c600/0xa762dfcbd58d2479 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843751.266558:0:17165:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd10fa3c600/0xa762dfcbd58d2479 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843751.266564:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd10fa3c600/0xa762dfcbd58d2479 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843751.266571:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd10fa3c600/0xa762dfcbd58d2479 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1788843751.283380:0:19468:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788843751.286434:0:19468:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788843751.286445:0:19468:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788843751.286482:0:19468:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788843751.286541:0:19468:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.133@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788843751.286559:0:19468:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788843751.286581:0:19468:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788843751.287443:0:19468:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788843751.287669:0:19468:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788843751.771379:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788843752.182327:0:19534:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788843752.182883:0:19534:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1788843752.538865:0:17147:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788843752.538885:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd10f7b9800 from 10 10000000:01000000:0.0:1788843752.538890:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788843752.538938:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d200/0xa762dfcbd58d2480 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843752.538950:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d200/0xa762dfcbd58d2480 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843752.538961:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d200/0xa762dfcbd58d2480 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843752.538989:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007acb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134519680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788843752.539059:0:17147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843752.539110:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd107659240 going to sleep for 11 seconds 00000100:00100000:2.0:1788843752.539243:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134519680 00000100:00100000:2.0:1788843752.539253:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134519680 00000100:00100000:2.0:1788843752.539315:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788843752.539325:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+22:17147:x1875738134519680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843752.539339:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843752.539354:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007946200/0xa762dfcbd58d2487 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d2480 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843752.539380:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007946200/0xa762dfcbd58d2487 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d2480 expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843752.539390:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007946200/0xa762dfcbd58d2487 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2480 expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843752.539400:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007946200, rc 0) 00000100:00100000:2.0:1788843752.539454:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+23:17147:x1875738134519680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843752.539461:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788843752.540751:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007acb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134519680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843752.540776:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d200/0xa762dfcbd58d2480 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2487 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843752.540787:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d200/0xa762dfcbd58d2480 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2487 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843752.540861:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007acb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134519808:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788843752.540909:0:17147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843752.540949:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd107659240 going to sleep for 11 seconds 00000100:00100000:3.0:1788843752.541010:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134519808 00000100:00100000:3.0:1788843752.541017:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134519808 00000100:00100000:3.0:1788843752.541067:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788843752.541076:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+23:17147:x1875738134519808:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788843752.541093:0:17144:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788843752.541108:0:17144:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788843752.541111:0:17144:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1788843752.541227:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+23:17147:x1875738134519808:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 153us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843752.541234:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788843752.541271:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007acb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134519808:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788843752.541326:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788843752.541333:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d200/0xa762dfcbd58d2480 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2487 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843752.541342:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd10fa3d200/0xa762dfcbd58d2480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2487 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843752.541351:0:17147:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788843752.541354:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd137acd000 from 10 10000000:01000000:3.0:1788843752.541357:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788843752.541379:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007be3800/0xa762dfcbd58d248e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843752.541387:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd007be3800/0xa762dfcbd58d248e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843752.541401:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd007be3800/0xa762dfcbd58d248e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843752.541415:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f986680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134519936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788843752.541438:0:17147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843752.541454:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd118d47840 going to sleep for 11 seconds 00000100:00100000:3.0:1788843752.541468:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134519936 00000100:00100000:3.0:1788843752.541471:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134519936 00000100:00100000:3.0:1788843752.541494:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788843752.541500:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+23:17147:x1875738134519936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843752.541508:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843752.541521:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd007be3000/0xa762dfcbd58d2495 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d248e expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843752.541539:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd007be3000/0xa762dfcbd58d2495 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d248e expref: 24 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843752.541550:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd007be3000/0xa762dfcbd58d2495 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d248e expref: 24 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843752.541557:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007be3000, rc 0) 00000100:00100000:3.0:1788843752.541585:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+24:17147:x1875738134519936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843752.541591:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788843752.541632:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f986680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134519936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843752.541643:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd007be3800/0xa762dfcbd58d248e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2495 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843752.541657:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd007be3800/0xa762dfcbd58d248e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2495 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843752.541692:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f986680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134520064:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788843752.541717:0:17147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843752.541729:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd118d47840 going to sleep for 11 seconds 00000100:00100000:3.0:1788843752.541740:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134520064 00000100:00100000:3.0:1788843752.541743:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134520064 00000100:00100000:3.0:1788843752.541759:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788843752.541765:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+24:17147:x1875738134520064:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788843752.541774:0:17142:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788843752.541785:0:17142:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788843752.541787:0:17142:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1788843752.541845:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+24:17147:x1875738134520064:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 79us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843752.541852:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788843752.541881:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f986680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134520064:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788843752.541919:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788843752.541924:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd007be3800/0xa762dfcbd58d248e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2495 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843752.541931:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd007be3800/0xa762dfcbd58d248e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2495 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843752.794287:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843752.858951:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141aeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134520192:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788843752.859033:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843752.859279:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134520192 00000100:00100000:3.0:1788843752.859289:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134520192 00000100:00100000:3.0:1788843752.859371:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788843752.859381:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134520192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788843752.859411:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788843752.859467:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134520192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843752.859474:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788843752.859517:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141aeb100 x1875738134520192/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843768 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843752.859535:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141aeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134520192:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788843752.859682:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134520320:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788843752.859716:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843752.860217:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134520320 00000100:00100000:3.0:1788843752.860224:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134520320 00000100:00100000:3.0:1788843752.860265:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788843752.860273:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134520320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788843752.860297:0:17890:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788843752.860339:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134520320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843752.860345:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788843752.860462:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134520320:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788843753.378747:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134520448:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788843753.378826:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843753.382068:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134520448 00000100:00100000:1.0:1788843753.382084:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134520448 00000100:00100000:1.0:1788843753.382176:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788843753.382188:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134520448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788843753.382224:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788843753.382318:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134520448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (3492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843753.382326:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788843753.382464:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134520448:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788843753.827275:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788843754.078772:0:17908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788843754.332250:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843734/real 1788843734] req@ffff9bd102fb8380 x1875738134506368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843754 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843754.332282:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd102fb8380 x1875738134506368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843754 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843754.332293:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843734/real 1788843734] req@ffff9bd102fbb100 x1875738134506496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843754 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843754.332304:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd102fbb100 x1875738134506496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843754 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788843754.332323:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd118910000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788843754.332344:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788843754.332348:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134506368:0@lo:8:kworker.0 00000100:00080000:1.0:1788843754.332361:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd13e8a4000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788843754.332367:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788843754.332370:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134506496:0@lo:8:kworker.0 00000100:00080000:0.0:1788843754.332600:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788843754.332617:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788843754.332620:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bd118910000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788843754.332625:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 512 00000100:00080000:0.0:1788843754.332630:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788843754.332637:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bd118910000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:0.0:1788843754.332656:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd007ac9180 x1875738134520832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788843754.332668:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788843754.332672:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788843754.332673:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bd13e8a4000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788843754.332676:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 512 00000100:00080000:0.0:1788843754.332678:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788843754.332681:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bd13e8a4000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:0.0:1788843754.332690:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd0084e0000 x1875738134520960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788843754.332732:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788843754.332735:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788843754.332736:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bd141b67000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788843754.332741:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9bd141b67000 using connection 192.168.203.133@tcp/0@lo 00000100:00100000:0.0:1788843754.332749:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd0084e1500 x1875738134521472/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788843754.332796:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134520704:0@lo:400:kworker.0 00000100:00100000:0.0:1788843754.332856:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843754.332885:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134521600:0@lo:400:kworker.0 00000100:00100000:0.0:1788843754.332912:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843754.332927:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134522112:0@lo:400:kworker.0 00000100:00100000:0.0:1788843754.332946:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843754.332961:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788843754.332966:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20b96c6c-8494-483a-b913-89dfc06b1440:3633:1875738134520576:0@lo:400:kworker.0 00000100:00100000:0.0:1788843754.332986:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843754.333011:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134521344:0@lo:400:kworker.0 00000100:00100000:0.0:1788843754.333034:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843754.333051:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1875738134521984:0@lo:400:kworker.0 00000100:00100000:0.0:1788843754.333089:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843754.333115:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134521088:0@lo:400:kworker.0 00000100:00100000:0.0:1788843754.333566:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843754.333582:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134521728:0@lo:400:kworker.0 00000100:00100000:0.0:1788843754.333602:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843754.333612:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788843754.333617:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134521216:0@lo:400:kworker.0 00000100:00100000:0.0:1788843754.333633:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843754.333685:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134521856:0@lo:400:kworker.0 00000100:00100000:0.0:1788843754.333704:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843754.334271:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134521600 00000100:00100000:1.0:1788843754.334282:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134521600 00000100:00100000:1.0:1788843754.334331:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134522112 00000100:00100000:1.0:1788843754.334334:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134522112 00000100:00100000:1.0:1788843754.334363:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134521984 00000100:00100000:1.0:1788843754.334366:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134521984 00000100:00100000:1.0:1788843754.334379:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134521088 00000100:00100000:1.0:1788843754.334391:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134521088 00000100:00100000:1.0:1788843754.334407:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134521728 00000100:00100000:1.0:1788843754.334410:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134521728 00000100:00100000:1.0:1788843754.334420:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134521856 00000100:00100000:1.0:1788843754.334423:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134521856 00000100:00100000:1.0:1788843754.334453:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788843754.334462:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134521600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843754.334527:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134521600:12345-0@lo:400:kworker.0 Request processed in 66us (1613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843754.334534:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788843754.334552:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788843754.334558:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875738134522112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843754.334584:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875738134522112:12345-0@lo:400:kworker.0 Request processed in 27us (1636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843754.334590:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788843754.334602:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788843754.334606:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875738134521984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843754.334630:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1875738134521984:12345-0@lo:400:kworker.0 Request processed in 23us (1541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843754.334635:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788843754.334645:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788843754.334650:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134521088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843754.334682:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134521088:12345-0@lo:400:kworker.0 Request processed in 31us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843754.334687:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788843754.334699:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788843754.334703:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134521728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843754.334740:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134521728:12345-0@lo:400:kworker.0 Request processed in 36us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843754.334746:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788843754.334759:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788843754.334765:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134521856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843754.334793:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134521856:12345-0@lo:400:kworker.0 Request processed in 28us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843754.334798:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788843754.334818:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788843754.334822:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788843754.334834:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134520832:0@lo:8:kworker.0 00000100:00100000:1.0:1788843754.334865:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843754.334897:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134520960:0@lo:8:kworker.0 00000100:00100000:1.0:1788843754.334920:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843754.334937:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0084e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134521472:0@lo:8:kworker.0 00000100:00100000:1.0:1788843754.334957:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843754.334981:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134521344 00000100:00100000:1.0:1788843754.334985:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134521344 00000100:00100000:1.0:1788843754.335012:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134520832 00000100:00100000:1.0:1788843754.335015:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134520832 00000100:00100000:1.0:1788843754.335022:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134520960 00000100:00100000:1.0:1788843754.335024:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134520960 00000100:00100000:1.0:1788843754.335030:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134521472 00000100:00100000:1.0:1788843754.335032:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134521472 00000100:00100000:1.0:1788843754.335040:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788843754.335046:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134521344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843754.335078:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134521344:12345-0@lo:400:kworker.0 Request processed in 33us (2043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843754.335091:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788843754.335104:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788843754.335109:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008625500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3629:x1875738134520832:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788843754.335163:0:18654:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 532 last 0 00000020:00000080:1.0:1788843754.335194:0:18654:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa762dfcbd58d249c 00002000:00100000:1.0:1788843754.335207:0:18654:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9bd006633000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788843754.335211:0:18654:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788843754.335214:0:18654:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788843754.335288:0:18654:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788843754.335314:0:18654:0:(import.c:65:import_set_state_nolock()) ffff9bd006634000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843754.335353:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008625500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3629:x1875738134520832:12345-0@lo:8:kworker.0 Request processed in 242us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843754.335360:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788843754.335372:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788843754.335376:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008625180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3629:x1875738134520960:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788843754.335392:0:18654:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 532 last 0 00000020:00000080:1.0:1788843754.335408:0:18654:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa762dfcbd58d24a3 00002000:00100000:1.0:1788843754.335414:0:18654:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9bd006632800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788843754.335418:0:18654:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788843754.335420:0:18654:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788843754.335582:0:18654:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788843754.335596:0:18654:0:(import.c:65:import_set_state_nolock()) ffff9bd006636800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843754.335626:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008625180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3629:x1875738134520960:12345-0@lo:8:kworker.0 Request processed in 248us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843754.335632:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788843754.335652:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788843754.335656:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008624e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3629:x1875738134521472:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788843754.335681:0:18654:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 532 last 0 00000020:00000080:1.0:1788843754.335708:0:18654:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa762dfcbd58d24aa 00002000:00100000:1.0:1788843754.335716:0:18654:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9bd006631000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396f ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788843754.335719:0:18654:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1788843754.335720:0:18654:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788843754.335742:0:18654:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788843754.335755:0:18654:0:(import.c:65:import_set_state_nolock()) ffff9bd006632000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843754.335782:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008624e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3629:x1875738134521472:12345-0@lo:8:kworker.0 Request processed in 124us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843754.335787:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788843754.335810:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788843754.335848:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0084e0700 x1875738134521856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843754.335862:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134521856:0@lo:400:kworker.0 00010000:00080000:1.0:1788843754.335876:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0084e3480 x1875738134521088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843754.335884:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134521088:0@lo:400:kworker.0 00010000:00080000:1.0:1788843754.335897:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0084e2300 x1875738134521728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843754.335904:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134521728:0@lo:400:kworker.0 00010000:00080000:1.0:1788843754.335937:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd007ac9180 x1875738134520832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788843779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843754.335957:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788843754.335965:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788843754.335974:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788843754.335980:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788843754.335983:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd118910000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788843754.336010:0:3629:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788843754.336015:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134520832:0@lo:8:kworker.0 00010000:00080000:1.0:1788843754.336029:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0084e0000 x1875738134520960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788843779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843754.336036:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788843754.336040:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788843754.336045:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788843754.336048:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788843754.336050:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd13e8a4000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788843754.336063:0:3629:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788843754.336067:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1875738134520960:0@lo:8:kworker.0 00010000:00080000:1.0:1788843754.336078:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0084e1500 x1875738134521472/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788843779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788843754.336086:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788843754.336091:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788843754.336093:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788843754.336095:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9bd141b67000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788843754.336106:0:3629:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788843754.336108:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1875738134521472:0@lo:8:kworker.0 00000004:00080000:1.0:1788843754.336162:0:17175:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788843754.336229:0:17175:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 532389087385ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788843754.336236:0:17175:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1788843754.336258:0:17893:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788843754.336301:0:17893:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 532389159420ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788843754.336306:0:17893:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00080000:1.0:1788843754.336482:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0084e1180 x1875738134521344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843754.336492:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134521344:0@lo:400:kworker.0 00010000:00080000:1.0:1788843754.336505:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141ae0380 x1875738134521984/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843754.336513:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1875738134521984:0@lo:400:kworker.0 00010000:00080000:1.0:1788843754.336526:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd0084e1f80 x1875738134521600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843754.336533:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134521600:0@lo:400:kworker.0 00010000:00080000:1.0:1788843754.336544:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141ae1f80 x1875738134522112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843754.336551:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134522112:0@lo:400:kworker.0 00000004:00080000:3.0:1788843754.338199:0:17173:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788843754.338281:0:17173:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 532391139280ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788843754.338288:0:17173:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788843754.339358:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134520704 00000100:00100000:2.0:1788843754.339373:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134520704 00000004:00080000:2.0:1788843754.340483:0:17174:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:2.0:1788843754.340514:0:17174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17174:1875738134522368:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788843754.340586:0:17174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843754.340620:0:17174:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13308b540 going to sleep for 11 seconds 00000004:00080000:2.0:1788843754.340649:0:17894:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788843754.340664:0:17894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17894:1875738134522624:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1788843754.340689:0:17894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843754.340705:0:17894:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13308b840 going to sleep for 11 seconds 00000100:00100000:2.0:1788843754.340722:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134522368 00000100:00100000:2.0:1788843754.340729:0:18655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134522368 00000100:00100000:2.0:1788843754.340778:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134522624 00000100:00100000:2.0:1788843754.340782:0:18655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134522624 00000100:00100000:2.0:1788843754.340800:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788843754.340808:0:18655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17174:x1875738134522368:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:2.0:1788843754.341023:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788843754.341027:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788843754.341040:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134522240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788843754.341071:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843754.341105:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788843754.341111:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141aebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134522496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788843754.341163:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843754.341197:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134522240 00000100:00100000:2.0:1788843754.341201:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134522240 00000100:00100000:2.0:1788843754.341219:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134522496 00000100:00100000:2.0:1788843754.341221:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134522496 00000100:00100000:2.0:1788843754.341231:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788843754.341238:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3630:x1875738134522240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788843754.341258:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788843754.341305:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3630:x1875738134522240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843754.341311:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788843754.341328:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788843754.341334:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3630:x1875738134522496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788843754.341348:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788843754.341408:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3630:x1875738134522496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843754.341415:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788843754.341721:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141aebb80 x1875738134522496/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843770 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843754.341740:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141aebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134522496:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1788843754.341752:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141ae9880 x1875738134522240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843770 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843754.341762:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134522240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788843754.341819:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134521216 00000100:00100000:2.0:1788843754.341829:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134521216 00000100:00100000:2.0:1788843754.341847:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788843754.341853:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134520704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843754.341895:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134520704:12345-0@lo:400:kworker.0 Request processed in 41us (9038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843754.341902:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788843754.341915:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788843754.341921:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134521216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843754.341953:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134521216:12345-0@lo:400:kworker.0 Request processed in 33us (8319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843754.341959:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788843754.341986:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0084e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134521216:0@lo:400:kworker.0 00000100:00100000:2.0:1788843754.342015:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134520704:0@lo:400:kworker.0 00000100:00100000:0.0:1788843754.350011:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134520576 00000100:00100000:0.0:1788843754.350029:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134520576 00000100:00100000:0.0:1788843754.350094:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788843754.350106:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+24:3633:x1875738134520576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843754.350237:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+24:3633:x1875738134520576:12345-0@lo:400:kworker.0 Request processed in 133us (17249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843754.350256:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000004:00080000:0.0:1788843754.350343:0:17176:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1788843754.352765:0:17176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17176:1875738134522880:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788843754.352843:0:17176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843754.352888:0:17176:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd104a35540 going to sleep for 11 seconds 00000100:00100000:0.0:1788843754.353082:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134522752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788843754.353112:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843754.353179:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134522752 00000100:00100000:0.0:1788843754.353189:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134522752 00000100:00100000:0.0:1788843754.353252:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788843754.353261:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3632:x1875738134522752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788843754.353285:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788843754.353330:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3632:x1875738134522752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843754.353337:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00002000:00080000:3.0:1788843754.361250:0:18655:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788843754.361264:0:18655:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1788843754.361271:0:18655:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00000100:00100000:1.0:1788843754.365255:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20b96c6c-8494-483a-b913-89dfc06b1440:3633:1875738134520576:0@lo:400:kworker.0 00000100:00100000:1.0:1788843754.365299:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788843754.365307:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:0.0:1788843754.372555:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141ae3800 x1875738134522752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843770 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843754.372585:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134522752:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788843754.372647:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788843754.376045:0:17882:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:1.0:1788843754.376087:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134522880 00000100:00100000:1.0:1788843754.376098:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134522880 00000100:00100000:0.0:1788843754.376300:0:19631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788843754.376313:0:19631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17894:x1875738134522624:12345-0@lo:7:osp-pre-1-1.0 00002000:00010000:3.0:1788843754.377751:0:18655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788843754.377764:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d24b1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.377797:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=532s v=(0 0) 00010000:00010000:3.0:1788843754.377848:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843754.377857:0:18655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d24b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.377951:0:18655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d24b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.377964:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d24b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.377974:0:18655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d24b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.377999:0:18655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1788843754.380002:0:17130:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788843754.380030:0:17130:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:3.0:1788843754.380275:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843754.380287:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d24b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.380299:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be3400 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:3.0:1788843754.380305:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d24b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.380317:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d24b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.380354:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d24b1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.380362:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d24b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.380383:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843754.380385:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843754.380387:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788843754.380744:0:18655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788843754.380752:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023631dd0/0xa762dfcbd58d24b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.380766:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=532s v=(0 0) 00010000:00010000:3.0:1788843754.380771:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843754.380778:0:18655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023631dd0/0xa762dfcbd58d24b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.380792:0:18655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023631dd0/0xa762dfcbd58d24b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.380979:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023631dd0/0xa762dfcbd58d24b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.380991:0:18655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023631dd0/0xa762dfcbd58d24b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.381074:0:18655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788843754.385598:0:18655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843754.385611:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4e08135/0xa762dfcbd58d24bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.385641:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788843754.385646:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843754.385654:0:18655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4e08135/0xa762dfcbd58d24bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.385669:0:18655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4e08135/0xa762dfcbd58d24bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.385680:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4e08135/0xa762dfcbd58d24bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.385689:0:18655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4e08135/0xa762dfcbd58d24bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.390661:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788843754.390682:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023631dd0/0xa762dfcbd58d24b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.390698:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be3e00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843754.390703:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023631dd0/0xa762dfcbd58d24b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.390715:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023631dd0/0xa762dfcbd58d24b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.390745:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023631dd0/0xa762dfcbd58d24b8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.390753:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023631dd0/0xa762dfcbd58d24b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.390783:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843754.390788:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4e08135/0xa762dfcbd58d24bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.390795:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d000 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843754.390814:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4e08135/0xa762dfcbd58d24bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.390824:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4e08135/0xa762dfcbd58d24bf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.390855:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4e08135/0xa762dfcbd58d24bf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.390866:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.390868:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.393012:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843754.394962:0:18655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788843754.394978:0:18655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4e08135/0xa762dfcbd58d24bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.395398:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788843754.396650:0:19631:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1788843754.396659:0:19631:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1788843754.396763:0:19631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17894:x1875738134522624:12345-0@lo:7:osp-pre-1-1.0 Request processed in 20449us (56068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843754.396775:0:19631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788843754.396825:0:19631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788843754.396840:0:19631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17176:x1875738134522880:12345-0@lo:5:osp-pre-1-0.0 00010000:00080000:1.0:1788843754.397468:0:17894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141ae9180 x1875738134522624/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788843770 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843754.397484:0:17894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17894:1875738134522624:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1788843754.397498:0:17894:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788843754.397540:0:17894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008627b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17894:1875738134523008:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788843754.397580:0:17894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843754.397605:0:17894:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd107659300 going to sleep for 11 seconds 00000100:00100000:1.0:1788843754.397620:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788843754.397627:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00002000:00010000:3.0:1788843754.399104:0:18655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788843754.399119:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d24c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.399184:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=532s v=(0 0) 00010000:00010000:3.0:1788843754.399191:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843754.399199:0:18655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d24c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.399217:0:18655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d24c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.399229:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d24c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.399238:0:18655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d24c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.399258:0:18655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788843754.399271:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843754.399278:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d24c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.399286:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be3400 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:3.0:1788843754.399300:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d24c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.399311:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d24c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.399331:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d24c6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.399338:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d24c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.399356:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843754.399358:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843754.399360:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843754.399664:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134523008 00000100:00100000:1.0:1788843754.399675:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134523008 00002000:00010000:3.0:1788843754.402407:0:18655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788843754.402423:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aff05051/0xa762dfcbd58d24cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.402445:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=532s v=(0 0) 00010000:00010000:3.0:1788843754.402449:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843754.402457:0:18655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aff05051/0xa762dfcbd58d24cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.402471:0:18655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aff05051/0xa762dfcbd58d24cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.402481:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aff05051/0xa762dfcbd58d24cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.402499:0:18655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aff05051/0xa762dfcbd58d24cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.402520:0:18655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788843754.402533:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843754.402539:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aff05051/0xa762dfcbd58d24cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.402548:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be2600 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:3.0:1788843754.402553:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aff05051/0xa762dfcbd58d24cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.402563:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aff05051/0xa762dfcbd58d24cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.402583:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aff05051/0xa762dfcbd58d24cd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.402592:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aff05051/0xa762dfcbd58d24cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.402611:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843754.402612:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843754.402614:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788843754.403391:0:19631:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788843754.403402:0:19631:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1788843754.403415:0:19631:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00000100:00100000:0.0:1788843754.411802:0:19632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788843754.411823:0:19632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008624700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17894:x1875738134523008:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788843754.411862:0:19632:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1788843754.412542:0:19632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008624700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17894:x1875738134523008:12345-0@lo:5:osp-pre-1-1.0 Request processed in 722us (14957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843754.412554:0:19632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788843754.415662:0:17894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd008627b80 x1875738134523008/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788843770 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843754.415684:0:17894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008627b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17894:1875738134523008:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788843754.415701:0:17894:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788843754.415761:0:17894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008627b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17894:1875738134523136:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788843754.415825:0:17894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843754.415930:0:17894:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd107659300 going to sleep for 11 seconds 00000100:00100000:0.0:1788843754.422214:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134523136 00000100:00100000:0.0:1788843754.422238:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134523136 00000100:00100000:0.0:1788843754.422308:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788843754.422320:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008626d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17894:x1875738134523136:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788843754.422717:0:18654:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:3.0:1788843754.423526:0:19631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788843754.423538:0:19631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d24d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.423558:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=532s v=(0 0) 00010000:00010000:3.0:1788843754.423564:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843754.423573:0:19631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d24d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.423592:0:19631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d24d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.423603:0:19631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d24d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.423610:0:19631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d24d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.423637:0:19631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843754.423811:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843754.423824:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d24d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.423832:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be3400 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843754.423838:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d24d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.423847:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d24d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.423880:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d24d4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.423888:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a5cf3b6/0xa762dfcbd58d24d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.423908:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.423910:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.423912:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788843754.424235:0:19631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788843754.424241:0:19631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d51e477a/0xa762dfcbd58d24db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.424251:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=532s v=(0 0) 00010000:00010000:3.0:1788843754.424255:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843754.424260:0:19631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d51e477a/0xa762dfcbd58d24db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.424277:0:19631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d51e477a/0xa762dfcbd58d24db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.424287:0:19631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d51e477a/0xa762dfcbd58d24db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.424295:0:19631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d51e477a/0xa762dfcbd58d24db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.424308:0:19631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843754.424618:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843754.424624:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d51e477a/0xa762dfcbd58d24db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.424637:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be3c00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843754.424641:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d51e477a/0xa762dfcbd58d24db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.424661:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d51e477a/0xa762dfcbd58d24db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.424673:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d51e477a/0xa762dfcbd58d24db lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.424681:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d51e477a/0xa762dfcbd58d24db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.424696:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.424697:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.424699:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788843754.424776:0:19631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788843754.424782:0:19631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000812e927a/0xa762dfcbd58d24e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.424792:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=532s v=(0 0) 00010000:00010000:3.0:1788843754.424795:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843754.424811:0:19631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000812e927a/0xa762dfcbd58d24e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.424822:0:19631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000812e927a/0xa762dfcbd58d24e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.424829:0:19631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000812e927a/0xa762dfcbd58d24e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.424847:0:19631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000812e927a/0xa762dfcbd58d24e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.424867:0:19631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843754.424982:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843754.424987:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000812e927a/0xa762dfcbd58d24e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.424995:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be2c00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843754.424999:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000812e927a/0xa762dfcbd58d24e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.425009:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000812e927a/0xa762dfcbd58d24e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.425020:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000812e927a/0xa762dfcbd58d24e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.425040:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000812e927a/0xa762dfcbd58d24e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.425054:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.425056:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.425057:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788843754.425537:0:19631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788843754.425545:0:19631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023631dd0/0xa762dfcbd58d24e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.425555:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=532s v=(0 0) 00010000:00010000:3.0:1788843754.425559:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843754.425563:0:19631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023631dd0/0xa762dfcbd58d24e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.425574:0:19631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023631dd0/0xa762dfcbd58d24e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.425582:0:19631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023631dd0/0xa762dfcbd58d24e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.425591:0:19631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023631dd0/0xa762dfcbd58d24e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.425610:0:19631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788843754.426022:0:19631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788843754.426028:0:19631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feec72f3/0xa762dfcbd58d24f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.426043:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=532s v=(0 0) 00010000:00010000:3.0:1788843754.426047:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843754.426052:0:19631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000feec72f3/0xa762dfcbd58d24f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788843754.426261:0:18655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788843754.426268:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054e59659/0xa762dfcbd58d24f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.426277:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=532s v=(0 0) 00010000:00010000:2.0:1788843754.426280:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843754.426292:0:18655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054e59659/0xa762dfcbd58d24f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.426304:0:18655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054e59659/0xa762dfcbd58d24f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.426313:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054e59659/0xa762dfcbd58d24f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.426321:0:18655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054e59659/0xa762dfcbd58d24f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.426344:0:18655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788843754.426516:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788843754.426525:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023631dd0/0xa762dfcbd58d24e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.426535:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be3e00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843754.426540:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023631dd0/0xa762dfcbd58d24e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.426549:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023631dd0/0xa762dfcbd58d24e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.426566:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023631dd0/0xa762dfcbd58d24e9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.426575:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023631dd0/0xa762dfcbd58d24e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.426594:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843754.426598:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054e59659/0xa762dfcbd58d24f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.426606:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946a00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843754.426609:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054e59659/0xa762dfcbd58d24f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.426625:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054e59659/0xa762dfcbd58d24f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.426637:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054e59659/0xa762dfcbd58d24f7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.426643:0:19631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000feec72f3/0xa762dfcbd58d24f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.426646:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054e59659/0xa762dfcbd58d24f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.426665:0:19631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feec72f3/0xa762dfcbd58d24f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.426673:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843754.426676:0:19631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000feec72f3/0xa762dfcbd58d24f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.426678:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843754.426682:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843754.426699:0:19631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788843754.426709:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843754.426714:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000feec72f3/0xa762dfcbd58d24f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.426722:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd118f70400 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:3.0:1788843754.426726:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000feec72f3/0xa762dfcbd58d24f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.426735:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000feec72f3/0xa762dfcbd58d24f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.426759:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000feec72f3/0xa762dfcbd58d24f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.426766:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000feec72f3/0xa762dfcbd58d24f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.426782:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843754.426784:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843754.426785:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.427070:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788843754.427344:0:18655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788843754.427351:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084109c26/0xa762dfcbd58d24fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.427363:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=532s v=(0 0) 00010000:00010000:2.0:1788843754.427367:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843754.427372:0:18655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084109c26/0xa762dfcbd58d24fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.427383:0:18655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084109c26/0xa762dfcbd58d24fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.427391:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084109c26/0xa762dfcbd58d24fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.427410:0:18655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084109c26/0xa762dfcbd58d24fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.429163:0:18655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788843754.431384:0:19631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788843754.431399:0:19631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9986a52/0xa762dfcbd58d2505 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.431420:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=532s v=(0 0) 00010000:00010000:3.0:1788843754.431425:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843754.431433:0:19631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9986a52/0xa762dfcbd58d2505 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.431449:0:19631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9986a52/0xa762dfcbd58d2505 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.431459:0:19631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9986a52/0xa762dfcbd58d2505 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.431468:0:19631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9986a52/0xa762dfcbd58d2505 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.431550:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788843754.431562:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084109c26/0xa762dfcbd58d24fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.431573:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947c00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843754.431579:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084109c26/0xa762dfcbd58d24fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.431590:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084109c26/0xa762dfcbd58d24fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.431609:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084109c26/0xa762dfcbd58d24fe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.431629:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084109c26/0xa762dfcbd58d24fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.431652:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843754.431657:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9986a52/0xa762dfcbd58d2505 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.431663:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd118f71600 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843754.431666:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9986a52/0xa762dfcbd58d2505 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.431673:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9986a52/0xa762dfcbd58d2505 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.431684:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9986a52/0xa762dfcbd58d2505 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.431693:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843754.431694:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843754.431696:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843754.433625:0:19631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788843754.433639:0:19631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9986a52/0xa762dfcbd58d2505 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.435018:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843754.435668:0:19631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843754.435679:0:19631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d668754/0xa762dfcbd58d250c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.435697:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1788843754.435702:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843754.435710:0:19631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d668754/0xa762dfcbd58d250c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.435728:0:19631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d668754/0xa762dfcbd58d250c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.435740:0:19631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d668754/0xa762dfcbd58d250c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.435750:0:19631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d668754/0xa762dfcbd58d250c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.435783:0:19631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788843754.436399:0:19631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843754.436406:0:19631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fd1136a/0xa762dfcbd58d2513 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.436417:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1788843754.436421:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843754.436426:0:19631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fd1136a/0xa762dfcbd58d2513 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.436437:0:19631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fd1136a/0xa762dfcbd58d2513 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.436446:0:19631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fd1136a/0xa762dfcbd58d2513 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.436454:0:19631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fd1136a/0xa762dfcbd58d2513 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.436470:0:19631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788843754.436479:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788843754.436485:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d668754/0xa762dfcbd58d250c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.436494:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbeb000 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843754.436506:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d668754/0xa762dfcbd58d250c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.436518:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d668754/0xa762dfcbd58d250c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.436537:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d668754/0xa762dfcbd58d250c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.436545:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d668754/0xa762dfcbd58d250c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.436565:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843754.436568:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fd1136a/0xa762dfcbd58d2513 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.436575:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbea400 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843754.436579:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fd1136a/0xa762dfcbd58d2513 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.436586:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fd1136a/0xa762dfcbd58d2513 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.436595:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fd1136a/0xa762dfcbd58d2513 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.436602:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fd1136a/0xa762dfcbd58d2513 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.436620:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.436621:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.436623:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843754.438353:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788843754.439423:0:18655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788843754.439436:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000644a35b3/0xa762dfcbd58d251a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.439455:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=532s v=(0 0) 00010000:00010000:2.0:1788843754.439459:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843754.439467:0:18655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000644a35b3/0xa762dfcbd58d251a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.439482:0:18655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000644a35b3/0xa762dfcbd58d251a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.439495:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000644a35b3/0xa762dfcbd58d251a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.439503:0:18655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000644a35b3/0xa762dfcbd58d251a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.439524:0:18655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843754.439752:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843754.439761:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000644a35b3/0xa762dfcbd58d251a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.439770:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd100031800 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843754.439775:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000644a35b3/0xa762dfcbd58d251a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.439785:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000644a35b3/0xa762dfcbd58d251a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.439804:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000644a35b3/0xa762dfcbd58d251a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.439813:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000644a35b3/0xa762dfcbd58d251a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.439832:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.439834:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.439835:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843754.448221:0:18655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843754.448236:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4e08135/0xa762dfcbd58d2521 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.448257:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788843754.448271:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843754.448281:0:18655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4e08135/0xa762dfcbd58d2521 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.448298:0:18655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4e08135/0xa762dfcbd58d2521 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.448309:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4e08135/0xa762dfcbd58d2521 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.448319:0:18655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4e08135/0xa762dfcbd58d2521 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.448342:0:18655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788843754.449694:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843754.449706:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4e08135/0xa762dfcbd58d2521 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.449720:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d000 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:3.0:1788843754.449726:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4e08135/0xa762dfcbd58d2521 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.449740:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4e08135/0xa762dfcbd58d2521 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.449763:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4e08135/0xa762dfcbd58d2521 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.449771:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4e08135/0xa762dfcbd58d2521 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843754.449790:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843754.449793:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843754.449794:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843754.455188:0:19631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843754.455204:0:19631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baddd7b2/0xa762dfcbd58d2528 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.455236:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1788843754.455241:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843754.455248:0:19631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baddd7b2/0xa762dfcbd58d2528 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.455264:0:19631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000baddd7b2/0xa762dfcbd58d2528 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.455275:0:19631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baddd7b2/0xa762dfcbd58d2528 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.455284:0:19631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000baddd7b2/0xa762dfcbd58d2528 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.455317:0:19631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843754.455625:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843754.455634:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000baddd7b2/0xa762dfcbd58d2528 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.455643:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbebe00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843754.455648:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000baddd7b2/0xa762dfcbd58d2528 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.455658:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000baddd7b2/0xa762dfcbd58d2528 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.455676:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000baddd7b2/0xa762dfcbd58d2528 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.455697:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000baddd7b2/0xa762dfcbd58d2528 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.455731:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843754.455734:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843754.455736:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843754.456218:0:18655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843754.456226:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a3ac7e1/0xa762dfcbd58d252f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.456236:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788843754.456240:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843754.456245:0:18655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a3ac7e1/0xa762dfcbd58d252f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.456257:0:18655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a3ac7e1/0xa762dfcbd58d252f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.456266:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a3ac7e1/0xa762dfcbd58d252f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.456273:0:18655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a3ac7e1/0xa762dfcbd58d252f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.456296:0:18655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788843754.457708:0:18655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843754.457728:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047bf716a/0xa762dfcbd58d2536 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.457744:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788843754.457749:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843754.457756:0:18655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047bf716a/0xa762dfcbd58d2536 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.457769:0:18655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047bf716a/0xa762dfcbd58d2536 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.457779:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047bf716a/0xa762dfcbd58d2536 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.457786:0:18655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047bf716a/0xa762dfcbd58d2536 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.458952:0:18655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788843754.460341:0:18655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843754.461525:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e06d8f1d/0xa762dfcbd58d253d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.461553:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788843754.461559:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843754.461567:0:18655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e06d8f1d/0xa762dfcbd58d253d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.461582:0:18655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e06d8f1d/0xa762dfcbd58d253d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.461602:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e06d8f1d/0xa762dfcbd58d253d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.461610:0:18655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e06d8f1d/0xa762dfcbd58d253d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.464908:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788843754.464925:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a3ac7e1/0xa762dfcbd58d252f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.464940:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3ce00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843754.464945:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a3ac7e1/0xa762dfcbd58d252f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.464957:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a3ac7e1/0xa762dfcbd58d252f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.465000:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a3ac7e1/0xa762dfcbd58d252f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.465008:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a3ac7e1/0xa762dfcbd58d252f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.468095:0:18655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788843754.468725:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788843754.470342:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843754.470356:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e06d8f1d/0xa762dfcbd58d253d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.470373:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3c800 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843754.470378:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e06d8f1d/0xa762dfcbd58d253d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.470390:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e06d8f1d/0xa762dfcbd58d253d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.470415:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e06d8f1d/0xa762dfcbd58d253d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.470423:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e06d8f1d/0xa762dfcbd58d253d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.470444:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.470447:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.470463:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843754.470563:0:19631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843754.470570:0:19631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c434ee5b/0xa762dfcbd58d2544 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.470583:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1788843754.470588:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843754.470596:0:19631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c434ee5b/0xa762dfcbd58d2544 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.470611:0:19631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c434ee5b/0xa762dfcbd58d2544 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.470621:0:19631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c434ee5b/0xa762dfcbd58d2544 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.470629:0:19631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c434ee5b/0xa762dfcbd58d2544 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.470652:0:19631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843754.470662:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843754.470665:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c434ee5b/0xa762dfcbd58d2544 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.470672:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbeb400 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843754.470676:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c434ee5b/0xa762dfcbd58d2544 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.470693:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c434ee5b/0xa762dfcbd58d2544 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.470704:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c434ee5b/0xa762dfcbd58d2544 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.470711:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c434ee5b/0xa762dfcbd58d2544 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.470724:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.470726:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.470727:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843754.471351:0:19631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843754.471359:0:19631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074045274/0xa762dfcbd58d254b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.471370:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1788843754.471373:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843754.471378:0:19631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074045274/0xa762dfcbd58d254b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.471387:0:19631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074045274/0xa762dfcbd58d254b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.471395:0:19631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074045274/0xa762dfcbd58d254b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.471411:0:19631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074045274/0xa762dfcbd58d254b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.471425:0:19631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843754.471434:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843754.471438:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074045274/0xa762dfcbd58d254b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.471445:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbea800 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843754.471449:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074045274/0xa762dfcbd58d254b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.471458:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074045274/0xa762dfcbd58d254b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.471469:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074045274/0xa762dfcbd58d254b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.471476:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074045274/0xa762dfcbd58d254b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.471490:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.471492:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.471493:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843754.472431:0:19631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843754.472451:0:19631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ef5429d/0xa762dfcbd58d2552 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.472464:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1788843754.472468:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843754.472474:0:19631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ef5429d/0xa762dfcbd58d2552 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.472487:0:19631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ef5429d/0xa762dfcbd58d2552 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.472496:0:19631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ef5429d/0xa762dfcbd58d2552 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.472505:0:19631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ef5429d/0xa762dfcbd58d2552 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.472522:0:19631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843754.472532:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843754.472537:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ef5429d/0xa762dfcbd58d2552 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.472545:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbea000 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843754.472549:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ef5429d/0xa762dfcbd58d2552 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.472558:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ef5429d/0xa762dfcbd58d2552 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.472578:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ef5429d/0xa762dfcbd58d2552 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.472585:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ef5429d/0xa762dfcbd58d2552 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.472602:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.472604:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.472605:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843754.477074:0:19631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843754.477089:0:19631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085cefefa/0xa762dfcbd58d2559 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.477108:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1788843754.477113:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843754.477120:0:19631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085cefefa/0xa762dfcbd58d2559 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.477160:0:19631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085cefefa/0xa762dfcbd58d2559 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.477172:0:19631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085cefefa/0xa762dfcbd58d2559 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.477248:0:19631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085cefefa/0xa762dfcbd58d2559 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.477287:0:19631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843754.477304:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843754.477310:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085cefefa/0xa762dfcbd58d2559 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.477318:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbeba00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843754.477323:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085cefefa/0xa762dfcbd58d2559 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.477333:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085cefefa/0xa762dfcbd58d2559 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.477352:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085cefefa/0xa762dfcbd58d2559 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.477359:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085cefefa/0xa762dfcbd58d2559 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.477389:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.477391:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.477392:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843754.481376:0:18655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843754.481391:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fd1136a/0xa762dfcbd58d2560 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.481411:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1788843754.481428:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843754.481437:0:18655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fd1136a/0xa762dfcbd58d2560 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.481454:0:18655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fd1136a/0xa762dfcbd58d2560 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.481466:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fd1136a/0xa762dfcbd58d2560 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.481475:0:18655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fd1136a/0xa762dfcbd58d2560 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.481500:0:18655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843754.481577:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843754.481587:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fd1136a/0xa762dfcbd58d2560 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.481598:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbea400 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843754.481604:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fd1136a/0xa762dfcbd58d2560 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.481614:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fd1136a/0xa762dfcbd58d2560 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.481634:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fd1136a/0xa762dfcbd58d2560 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.481641:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fd1136a/0xa762dfcbd58d2560 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.481661:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843754.481670:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843754.481672:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843754.485314:0:18655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843754.485327:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d668754/0xa762dfcbd58d2567 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.485347:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1788843754.485351:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843754.485358:0:18655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d668754/0xa762dfcbd58d2567 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.485374:0:18655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d668754/0xa762dfcbd58d2567 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.485386:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d668754/0xa762dfcbd58d2567 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.485404:0:18655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d668754/0xa762dfcbd58d2567 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.485424:0:18655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843754.485577:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843754.485585:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d668754/0xa762dfcbd58d2567 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.485593:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbeb000 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843754.485598:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d668754/0xa762dfcbd58d2567 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.485608:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d668754/0xa762dfcbd58d2567 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.485626:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d668754/0xa762dfcbd58d2567 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.485634:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d668754/0xa762dfcbd58d2567 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.485652:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.485653:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.485655:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843754.487671:0:19631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843754.487686:0:19631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078838d6f/0xa762dfcbd58d256e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.487704:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788843754.487710:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843754.487718:0:19631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078838d6f/0xa762dfcbd58d256e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.487733:0:19631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078838d6f/0xa762dfcbd58d256e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.487744:0:19631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078838d6f/0xa762dfcbd58d256e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.487752:0:19631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078838d6f/0xa762dfcbd58d256e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.487772:0:19631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788843754.490497:0:18655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843754.490518:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007830bb91/0xa762dfcbd58d2575 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.490537:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1788843754.490542:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843754.490550:0:18655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007830bb91/0xa762dfcbd58d2575 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.490565:0:18655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007830bb91/0xa762dfcbd58d2575 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.490576:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007830bb91/0xa762dfcbd58d2575 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.490585:0:18655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007830bb91/0xa762dfcbd58d2575 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.490597:0:18655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788843754.490752:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788843754.490760:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078838d6f/0xa762dfcbd58d256e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.490771:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3dc00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843754.490776:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078838d6f/0xa762dfcbd58d256e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.490787:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078838d6f/0xa762dfcbd58d256e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.490813:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078838d6f/0xa762dfcbd58d256e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.490822:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078838d6f/0xa762dfcbd58d256e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.490843:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843754.490846:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007830bb91/0xa762dfcbd58d2575 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.490852:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbebc00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843754.490855:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007830bb91/0xa762dfcbd58d2575 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.490863:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007830bb91/0xa762dfcbd58d2575 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.490879:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843754.490890:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843754.490891:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843754.491079:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047bf716a/0xa762dfcbd58d2536 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.491090:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d800 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843754.491094:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047bf716a/0xa762dfcbd58d2536 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.491124:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047bf716a/0xa762dfcbd58d2536 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.491162:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047bf716a/0xa762dfcbd58d2536 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.491170:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047bf716a/0xa762dfcbd58d2536 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.491187:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843754.491189:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843754.491191:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.491643:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007830bb91/0xa762dfcbd58d2575 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.491653:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007830bb91/0xa762dfcbd58d2575 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.491669:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.491671:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.491680:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843754.492309:0:18655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843754.492318:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f3509ee/0xa762dfcbd58d257c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.492332:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788843754.492336:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843754.492342:0:18655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f3509ee/0xa762dfcbd58d257c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.492366:0:18655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f3509ee/0xa762dfcbd58d257c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.492378:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f3509ee/0xa762dfcbd58d257c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.492393:0:18655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f3509ee/0xa762dfcbd58d257c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.492408:0:18655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788843754.492954:0:19636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843754.492964:0:19636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f3509ee/0xa762dfcbd58d257c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.492975:0:19636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3cc00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843754.492980:0:19636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f3509ee/0xa762dfcbd58d257c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.492991:0:19636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f3509ee/0xa762dfcbd58d257c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.493006:0:19636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f3509ee/0xa762dfcbd58d257c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.493013:0:19636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f3509ee/0xa762dfcbd58d257c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.493031:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843754.493032:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843754.493034:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843754.493925:0:19631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1788843754.493933:0:18655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843754.493935:0:19631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085cefefa/0xa762dfcbd58d2583 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.493943:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9976e01/0xa762dfcbd58d258a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.493952:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788843754.493956:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1788843754.493959:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843754.493961:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843754.493967:0:19631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085cefefa/0xa762dfcbd58d2583 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.493968:0:18655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9976e01/0xa762dfcbd58d258a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.493996:0:19631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085cefefa/0xa762dfcbd58d2583 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.493996:0:18655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9976e01/0xa762dfcbd58d258a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.494014:0:19631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085cefefa/0xa762dfcbd58d2583 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.494027:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9976e01/0xa762dfcbd58d258a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.494029:0:19631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085cefefa/0xa762dfcbd58d2583 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.494049:0:18655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9976e01/0xa762dfcbd58d258a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.494072:0:19631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788843754.494523:0:18655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788843754.494537:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788843754.494542:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085cefefa/0xa762dfcbd58d2583 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.494558:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbeba00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843754.494562:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085cefefa/0xa762dfcbd58d2583 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.494569:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085cefefa/0xa762dfcbd58d2583 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.494585:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085cefefa/0xa762dfcbd58d2583 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.494592:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085cefefa/0xa762dfcbd58d2583 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.494608:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843754.494611:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9976e01/0xa762dfcbd58d258a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.494618:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3c600 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843754.494621:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9976e01/0xa762dfcbd58d258a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.494628:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9976e01/0xa762dfcbd58d258a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.494637:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9976e01/0xa762dfcbd58d258a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.494652:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9976e01/0xa762dfcbd58d258a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.494666:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843754.494668:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843754.494669:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.494936:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843754.495305:0:18655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843754.495312:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ef5429d/0xa762dfcbd58d2591 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.495323:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1788843754.495326:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843754.495331:0:18655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ef5429d/0xa762dfcbd58d2591 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.495348:0:18655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ef5429d/0xa762dfcbd58d2591 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.495357:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ef5429d/0xa762dfcbd58d2591 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.495364:0:18655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ef5429d/0xa762dfcbd58d2591 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.495386:0:18655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843754.495440:0:19636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843754.495447:0:19636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ef5429d/0xa762dfcbd58d2591 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.495457:0:19636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbea000 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843754.495461:0:19636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ef5429d/0xa762dfcbd58d2591 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.495470:0:19636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ef5429d/0xa762dfcbd58d2591 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.495483:0:19636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ef5429d/0xa762dfcbd58d2591 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.495490:0:19636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ef5429d/0xa762dfcbd58d2591 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.495506:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843754.495508:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843754.495509:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843754.495627:0:19631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843754.495633:0:19631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074045274/0xa762dfcbd58d2598 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.495641:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1788843754.495644:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843754.495648:0:19631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074045274/0xa762dfcbd58d2598 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.495657:0:19631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074045274/0xa762dfcbd58d2598 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.495665:0:19631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074045274/0xa762dfcbd58d2598 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.495683:0:19631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074045274/0xa762dfcbd58d2598 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.495702:0:19631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843754.495743:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843754.495750:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074045274/0xa762dfcbd58d2598 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.495759:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbea800 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843754.495763:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074045274/0xa762dfcbd58d2598 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.495772:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074045274/0xa762dfcbd58d2598 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.495784:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074045274/0xa762dfcbd58d2598 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.495792:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074045274/0xa762dfcbd58d2598 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.495807:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843754.495814:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843754.495815:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843754.496026:0:18655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843754.496032:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c434ee5b/0xa762dfcbd58d259f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.496041:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1788843754.496044:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843754.496049:0:18655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c434ee5b/0xa762dfcbd58d259f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788843754.496230:0:19631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843754.496236:0:19631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e06d8f1d/0xa762dfcbd58d25a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.496245:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788843754.496248:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843754.496252:0:19631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e06d8f1d/0xa762dfcbd58d25a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.496273:0:19631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e06d8f1d/0xa762dfcbd58d25a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.496281:0:19631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e06d8f1d/0xa762dfcbd58d25a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.496289:0:19631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e06d8f1d/0xa762dfcbd58d25a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.496309:0:19631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843754.496433:0:18655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c434ee5b/0xa762dfcbd58d259f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.496446:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c434ee5b/0xa762dfcbd58d259f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.496453:0:18655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c434ee5b/0xa762dfcbd58d259f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.496467:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843754.496473:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e06d8f1d/0xa762dfcbd58d25a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.496493:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3c800 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843754.496497:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e06d8f1d/0xa762dfcbd58d25a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.496505:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e06d8f1d/0xa762dfcbd58d25a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.496517:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e06d8f1d/0xa762dfcbd58d25a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.496524:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e06d8f1d/0xa762dfcbd58d25a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.496540:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.496542:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.496544:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.496604:0:18655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843754.496677:0:19636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843754.496684:0:19636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c434ee5b/0xa762dfcbd58d259f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.496692:0:19636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbeb400 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843754.496695:0:19636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c434ee5b/0xa762dfcbd58d259f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.496702:0:19636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c434ee5b/0xa762dfcbd58d259f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.496714:0:19636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c434ee5b/0xa762dfcbd58d259f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.496721:0:19636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c434ee5b/0xa762dfcbd58d259f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.496742:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843754.496744:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843754.496745:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843754.496783:0:19631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843754.496788:0:19631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a3ac7e1/0xa762dfcbd58d25ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.496798:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788843754.496806:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843754.496810:0:19631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a3ac7e1/0xa762dfcbd58d25ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.496820:0:19631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a3ac7e1/0xa762dfcbd58d25ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.496827:0:19631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a3ac7e1/0xa762dfcbd58d25ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.496834:0:19631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a3ac7e1/0xa762dfcbd58d25ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.496848:0:19631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843754.496854:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843754.496858:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a3ac7e1/0xa762dfcbd58d25ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.496877:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3ce00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843754.496880:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a3ac7e1/0xa762dfcbd58d25ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.496887:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a3ac7e1/0xa762dfcbd58d25ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.496897:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a3ac7e1/0xa762dfcbd58d25ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.496903:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a3ac7e1/0xa762dfcbd58d25ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.496916:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843754.496918:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843754.496919:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843754.497382:0:18655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843754.497389:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000baddd7b2/0xa762dfcbd58d25b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.497398:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1788843754.497401:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843754.497405:0:18655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000baddd7b2/0xa762dfcbd58d25b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.497427:0:18655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000baddd7b2/0xa762dfcbd58d25b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.497435:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000baddd7b2/0xa762dfcbd58d25b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.497442:0:18655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000baddd7b2/0xa762dfcbd58d25b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.497575:0:18655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843754.497602:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843754.497610:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000baddd7b2/0xa762dfcbd58d25b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.497618:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd13fbebe00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843754.497622:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000baddd7b2/0xa762dfcbd58d25b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.497631:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000baddd7b2/0xa762dfcbd58d25b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.497651:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000baddd7b2/0xa762dfcbd58d25b4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.497659:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000baddd7b2/0xa762dfcbd58d25b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.497674:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843754.497676:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843754.497677:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843754.497715:0:19631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843754.497721:0:19631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4e08135/0xa762dfcbd58d25bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.497728:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788843754.497731:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843754.497735:0:19631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4e08135/0xa762dfcbd58d25bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.497744:0:19631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4e08135/0xa762dfcbd58d25bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.497751:0:19631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4e08135/0xa762dfcbd58d25bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.497759:0:19631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4e08135/0xa762dfcbd58d25bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.497784:0:19631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788843754.498345:0:18655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843754.498353:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ea6c0d6/0xa762dfcbd58d25c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.498363:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1788843754.498366:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843754.498371:0:18655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ea6c0d6/0xa762dfcbd58d25c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.498382:0:18655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ea6c0d6/0xa762dfcbd58d25c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.498390:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ea6c0d6/0xa762dfcbd58d25c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.498410:0:18655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ea6c0d6/0xa762dfcbd58d25c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.498431:0:18655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788843754.498674:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788843754.498681:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4e08135/0xa762dfcbd58d25bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.498689:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d000 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843754.498693:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4e08135/0xa762dfcbd58d25bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.498702:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4e08135/0xa762dfcbd58d25bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.498718:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4e08135/0xa762dfcbd58d25bb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.498725:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4e08135/0xa762dfcbd58d25bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.498745:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843754.498749:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ea6c0d6/0xa762dfcbd58d25c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.498756:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1420e4400 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843754.498759:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ea6c0d6/0xa762dfcbd58d25c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.498779:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ea6c0d6/0xa762dfcbd58d25c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.498789:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ea6c0d6/0xa762dfcbd58d25c2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.498796:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ea6c0d6/0xa762dfcbd58d25c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.498811:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843754.498813:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843754.498815:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843754.498822:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843754.498864:0:19631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843754.498870:0:19631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084109c26/0xa762dfcbd58d25c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.498877:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788843754.498880:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843754.498884:0:19631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084109c26/0xa762dfcbd58d25c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.498893:0:19631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084109c26/0xa762dfcbd58d25c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.498900:0:19631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084109c26/0xa762dfcbd58d25c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.498930:0:19631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084109c26/0xa762dfcbd58d25c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.498950:0:19631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843754.500001:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1788843754.500006:0:19631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843754.500012:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084109c26/0xa762dfcbd58d25c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.500024:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947c00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843754.500030:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084109c26/0xa762dfcbd58d25c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.500034:0:19631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054e59659/0xa762dfcbd58d25d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.500044:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084109c26/0xa762dfcbd58d25c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.500048:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788843754.500058:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843754.500064:0:19631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054e59659/0xa762dfcbd58d25d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.500074:0:19631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054e59659/0xa762dfcbd58d25d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.500083:0:19631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054e59659/0xa762dfcbd58d25d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.500089:0:19631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054e59659/0xa762dfcbd58d25d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.500166:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084109c26/0xa762dfcbd58d25c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.500213:0:19631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843754.500222:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843754.500226:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054e59659/0xa762dfcbd58d25d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.500239:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946a00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843754.500242:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054e59659/0xa762dfcbd58d25d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.500251:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054e59659/0xa762dfcbd58d25d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.500263:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054e59659/0xa762dfcbd58d25d0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.500270:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054e59659/0xa762dfcbd58d25d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.500286:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843754.500288:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843754.500289:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.500951:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084109c26/0xa762dfcbd58d25c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.500974:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.500976:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.500978:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843754.501034:0:18655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843754.501048:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000264e066/0xa762dfcbd58d25d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.501692:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1788843754.501699:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843754.501707:0:18655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000264e066/0xa762dfcbd58d25d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.501722:0:18655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000264e066/0xa762dfcbd58d25d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.501733:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000264e066/0xa762dfcbd58d25d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.501742:0:18655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000264e066/0xa762dfcbd58d25d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.501766:0:18655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843754.501942:0:19636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843754.501949:0:19636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000264e066/0xa762dfcbd58d25d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.501958:0:19636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1420e5200 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:0.0:1788843754.501962:0:19636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000264e066/0xa762dfcbd58d25d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.501971:0:19636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000264e066/0xa762dfcbd58d25d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.501995:0:19636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000264e066/0xa762dfcbd58d25d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.502004:0:19636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000264e066/0xa762dfcbd58d25d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.502021:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843754.502023:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843754.502025:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843754.502400:0:19631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843754.502407:0:19631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c326052e/0xa762dfcbd58d25de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.502416:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788843754.502420:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843754.502431:0:19631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c326052e/0xa762dfcbd58d25de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.502442:0:19631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c326052e/0xa762dfcbd58d25de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.502451:0:19631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c326052e/0xa762dfcbd58d25de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.502458:0:19631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c326052e/0xa762dfcbd58d25de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.502489:0:19631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788843754.503569:0:19631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843754.503578:0:19631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9414993/0xa762dfcbd58d25e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.503590:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788843754.503594:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843754.503598:0:19631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9414993/0xa762dfcbd58d25e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.503608:0:19631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9414993/0xa762dfcbd58d25e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.503616:0:19631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9414993/0xa762dfcbd58d25e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.503623:0:19631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9414993/0xa762dfcbd58d25e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.503640:0:19631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788843754.503900:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788843754.503909:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c326052e/0xa762dfcbd58d25de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.503918:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7aee00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843754.503923:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c326052e/0xa762dfcbd58d25de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.503939:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c326052e/0xa762dfcbd58d25de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.503958:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c326052e/0xa762dfcbd58d25de lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.503967:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c326052e/0xa762dfcbd58d25de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.503994:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843754.504003:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9414993/0xa762dfcbd58d25e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.504012:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7af000 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843754.504016:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9414993/0xa762dfcbd58d25e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.504025:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.504026:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9414993/0xa762dfcbd58d25e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.504038:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843754.504043:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.504048:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9414993/0xa762dfcbd58d25e5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.504057:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9414993/0xa762dfcbd58d25e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.504081:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.504083:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.504085:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843754.504129:0:18655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843754.504162:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050a2c32f/0xa762dfcbd58d25ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.504171:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1788843754.504286:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843754.504292:0:18655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050a2c32f/0xa762dfcbd58d25ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.504304:0:18655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050a2c32f/0xa762dfcbd58d25ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.504314:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050a2c32f/0xa762dfcbd58d25ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.504323:0:18655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050a2c32f/0xa762dfcbd58d25ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.504356:0:18655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788843754.504435:0:19636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843754.504442:0:19636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050a2c32f/0xa762dfcbd58d25ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.504451:0:19636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1420e4600 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843754.504455:0:19636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050a2c32f/0xa762dfcbd58d25ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.504465:0:19636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050a2c32f/0xa762dfcbd58d25ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.504478:0:19636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050a2c32f/0xa762dfcbd58d25ec lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.504497:0:19636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050a2c32f/0xa762dfcbd58d25ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.504514:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843754.504515:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843754.504516:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843754.505239:0:19631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843754.505247:0:19631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001794e17a/0xa762dfcbd58d25f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.505256:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788843754.505265:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843754.505270:0:19631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001794e17a/0xa762dfcbd58d25f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.505281:0:19631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001794e17a/0xa762dfcbd58d25f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.505290:0:19631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001794e17a/0xa762dfcbd58d25f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.505297:0:19631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001794e17a/0xa762dfcbd58d25f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.505315:0:19631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788843754.505353:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843754.505361:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001794e17a/0xa762dfcbd58d25f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.505369:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7afe00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843754.505372:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001794e17a/0xa762dfcbd58d25f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.505381:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001794e17a/0xa762dfcbd58d25f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.505393:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001794e17a/0xa762dfcbd58d25f3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.505402:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001794e17a/0xa762dfcbd58d25f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.505419:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843754.505421:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843754.505422:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843754.505950:0:19631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788843754.505956:0:19631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a092430/0xa762dfcbd58d25fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.505965:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788843754.505968:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843754.505972:0:19631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a092430/0xa762dfcbd58d25fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.505980:0:19631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a092430/0xa762dfcbd58d25fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.505987:0:19631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a092430/0xa762dfcbd58d25fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.506003:0:19631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a092430/0xa762dfcbd58d25fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843754.506020:0:19631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843754.506554:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843754.506562:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a092430/0xa762dfcbd58d25fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.506571:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7aec00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843754.506576:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a092430/0xa762dfcbd58d25fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.506585:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a092430/0xa762dfcbd58d25fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.506600:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a092430/0xa762dfcbd58d25fa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.506608:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a092430/0xa762dfcbd58d25fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788843754.506615:0:18655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788843754.506623:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082ca18a7/0xa762dfcbd58d2601 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.506626:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.506629:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.506632:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843754.506637:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=532s v=(0 0) 00010000:00010000:2.0:1788843754.506642:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843754.506647:0:18655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082ca18a7/0xa762dfcbd58d2601 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.506659:0:18655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082ca18a7/0xa762dfcbd58d2601 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.506667:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082ca18a7/0xa762dfcbd58d2601 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.506674:0:18655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082ca18a7/0xa762dfcbd58d2601 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.506689:0:18655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788843754.506818:0:19636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843754.506824:0:19636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082ca18a7/0xa762dfcbd58d2601 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.506832:0:19636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd100030c00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843754.506835:0:19636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082ca18a7/0xa762dfcbd58d2601 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.506854:0:19636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082ca18a7/0xa762dfcbd58d2601 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.506866:0:19636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082ca18a7/0xa762dfcbd58d2601 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.506873:0:19636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082ca18a7/0xa762dfcbd58d2601 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.506887:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843754.506889:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843754.506891:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788843754.507306:0:19631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843754.507313:0:19631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d711861d/0xa762dfcbd58d2608 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.507322:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1788843754.507332:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843754.507337:0:19631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d711861d/0xa762dfcbd58d2608 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.507346:0:19631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d711861d/0xa762dfcbd58d2608 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.507355:0:19631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d711861d/0xa762dfcbd58d2608 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.507361:0:19631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d711861d/0xa762dfcbd58d2608 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.507375:0:19631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788843754.508873:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843754.508885:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d711861d/0xa762dfcbd58d2608 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.508897:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1420e5a00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843754.508902:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d711861d/0xa762dfcbd58d2608 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.508913:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d711861d/0xa762dfcbd58d2608 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.508933:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d711861d/0xa762dfcbd58d2608 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.508958:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d711861d/0xa762dfcbd58d2608 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.508983:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843754.508985:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843754.508986:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788843754.509072:0:18655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788843754.509079:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000507c68/0xa762dfcbd58d260f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.509091:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=532s v=(0 0) 00010000:00010000:2.0:1788843754.509095:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843754.509101:0:18655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000507c68/0xa762dfcbd58d260f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.509112:0:18655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000507c68/0xa762dfcbd58d260f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.509157:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000507c68/0xa762dfcbd58d260f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.509166:0:18655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000507c68/0xa762dfcbd58d260f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.509184:0:18655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843754.509668:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843754.509676:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000507c68/0xa762dfcbd58d260f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.509686:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd100030a00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843754.509690:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000507c68/0xa762dfcbd58d260f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.509700:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000507c68/0xa762dfcbd58d260f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.509714:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000507c68/0xa762dfcbd58d260f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.509736:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000507c68/0xa762dfcbd58d260f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.509754:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.509756:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843754.509757:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788843754.510974:0:18655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788843754.510993:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000300a913f/0xa762dfcbd58d2616 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.511008:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=532s v=(0 0) 00010000:00010000:2.0:1788843754.511012:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843754.511019:0:18655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000300a913f/0xa762dfcbd58d2616 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.511033:0:18655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000300a913f/0xa762dfcbd58d2616 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.511043:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000300a913f/0xa762dfcbd58d2616 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.511051:0:18655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000300a913f/0xa762dfcbd58d2616 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.511068:0:18655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788843754.511081:0:19631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788843754.511088:0:19631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feef1e72/0xa762dfcbd58d261d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.511098:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1788843754.511102:0:19631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843754.511107:0:19631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000feef1e72/0xa762dfcbd58d261d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.511118:0:19631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000feef1e72/0xa762dfcbd58d261d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.511127:0:19631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feef1e72/0xa762dfcbd58d261d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.511158:0:19631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000feef1e72/0xa762dfcbd58d261d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843754.511184:0:19631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:1.0:1788843754.511232:0:19631:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00010000:00010000:2.0:1788843754.511317:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788843754.511325:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000300a913f/0xa762dfcbd58d2616 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.511334:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd100030e00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843754.511338:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000300a913f/0xa762dfcbd58d2616 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843754.511346:0:19631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17176:x1875738134522880:12345-0@lo:5:osp-pre-1-0.0 Request processed in 114506us (158498us total) trans 0 rc 0/0 00010000:00010000:2.0:1788843754.511352:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000300a913f/0xa762dfcbd58d2616 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843754.511358:0:19631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788843754.511378:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000300a913f/0xa762dfcbd58d2616 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.511385:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000300a913f/0xa762dfcbd58d2616 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.511402:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843754.511406:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000feef1e72/0xa762dfcbd58d261d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.511413:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1420e4200 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843754.511416:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000feef1e72/0xa762dfcbd58d261d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.511423:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000feef1e72/0xa762dfcbd58d261d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.511432:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000feef1e72/0xa762dfcbd58d261d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.511439:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000feef1e72/0xa762dfcbd58d261d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.511452:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843754.511453:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843754.511460:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843754.511579:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788843754.511933:0:18655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788843754.511943:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d2f7a5a/0xa762dfcbd58d2624 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.511952:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=532s v=(0 0) 00010000:00010000:2.0:1788843754.511955:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843754.511960:0:18655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d2f7a5a/0xa762dfcbd58d2624 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.511969:0:18655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d2f7a5a/0xa762dfcbd58d2624 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.511977:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d2f7a5a/0xa762dfcbd58d2624 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.511983:0:18655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d2f7a5a/0xa762dfcbd58d2624 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.512005:0:18655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788843754.512368:0:18655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788843754.512375:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000227f9ebb/0xa762dfcbd58d262b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.512384:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=532s v=(0 0) 00010000:00010000:2.0:1788843754.512387:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843754.512392:0:18655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000227f9ebb/0xa762dfcbd58d262b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.512408:0:18655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000227f9ebb/0xa762dfcbd58d262b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.512416:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000227f9ebb/0xa762dfcbd58d262b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.512423:0:18655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000227f9ebb/0xa762dfcbd58d262b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.512438:0:18655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788843754.512446:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788843754.512450:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d2f7a5a/0xa762dfcbd58d2624 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.512457:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd100031600 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843754.512461:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d2f7a5a/0xa762dfcbd58d2624 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.512469:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d2f7a5a/0xa762dfcbd58d2624 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.512483:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d2f7a5a/0xa762dfcbd58d2624 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.512490:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d2f7a5a/0xa762dfcbd58d2624 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.512514:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843754.512517:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000227f9ebb/0xa762dfcbd58d262b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.512524:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd100031400 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843754.512527:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000227f9ebb/0xa762dfcbd58d262b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.512535:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000227f9ebb/0xa762dfcbd58d262b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.512545:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000227f9ebb/0xa762dfcbd58d262b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.512551:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000227f9ebb/0xa762dfcbd58d262b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843754.512565:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843754.512567:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843754.512569:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788843754.512612:0:18655:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:2.0:1788843754.512682:0:18655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17174:x1875738134522368:12345-0@lo:5:osp-pre-0-0.0 Request processed in 171872us (172094us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843754.512690:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788843754.512745:0:17174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17174:1875738134522368:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788843754.513229:0:17174:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:2.0:1788843754.513283:0:17174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17174:1875738134523264:0@lo:5:osp-pre-0-0.0 00010000:00010000:1.0:1788843754.513311:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843754.513328:0:17174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843754.513368:0:17174:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13dffc000 going to sleep for 11 seconds 00000100:00100000:2.0:1788843754.513385:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134523264 00000100:00100000:2.0:1788843754.513393:0:18655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134523264 00000100:00100000:2.0:1788843754.513439:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788843754.513448:0:18655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17174:x1875738134523264:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788843754.513484:0:18655:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000100:00100000:1.0:1788843754.514250:0:17176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17176:1875738134522880:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788843754.514263:0:17176:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:1.0:1788843754.514294:0:17176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd008627100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17176:1875738134523392:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788843754.514330:0:17176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843754.514352:0:17176:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0086e2240 going to sleep for 11 seconds 00000100:00100000:1.0:1788843754.514367:0:19631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134523392 00000100:00100000:1.0:1788843754.514372:0:19631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134523392 00000100:00100000:1.0:1788843754.514403:0:19631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788843754.514411:0:19631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008627480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17176:x1875738134523392:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788843754.514438:0:19631:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000001:00080000:2.0:1788843754.528849:0:19469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1788843754.528913:0:19469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788843754.528920:0:19469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788843754.529706:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008626d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17894:x1875738134523136:12345-0@lo:5:osp-pre-1-1.0 Request processed in 107383us (113875us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788843754.529719:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788843754.530104:0:17894:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788843754.530114:0:17894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008627b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17894:1875738134523136:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1788843754.530182:0:17894:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1788843754.530240:0:17894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141aebb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17894:1875738134523520:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788843754.530292:0:17894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843754.530320:0:17894:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd107659300 going to sleep for 11 seconds 00000100:00100000:0.0:1788843754.531288:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134523520 00000100:00100000:0.0:1788843754.531299:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134523520 00000100:00100000:0.0:1788843754.531355:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788843754.531365:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17894:x1875738134523520:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788843754.531436:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17894:x1875738134523520:12345-0@lo:900:osp-pre-1-1.0 Request processed in 72us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843754.531443:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788843754.531480:0:17894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141aebb80 x1875738134523520/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788843770 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843754.531493:0:17894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141aebb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17894:1875738134523520:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788843754.541823:0:19631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008627480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17176:x1875738134523392:12345-0@lo:5:osp-pre-1-0.0 Request processed in 27404us (27485us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788843754.541837:0:19631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788843754.542468:0:17176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd008627100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17176:1875738134523392:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788843754.542487:0:17176:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000001:00080000:0.0:1788843754.542828:0:18651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:0.0:1788843754.542873:0:18651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788843754.543121:0:18655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17174:x1875738134523264:12345-0@lo:5:osp-pre-0-0.0 Request processed in 29672us (29792us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788843754.543370:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788843754.543711:0:17174:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1788843754.543720:0:17174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17174:1875738134523264:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788843754.543740:0:17174:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:2.0:1788843754.842904:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843755.875476:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843756.890311:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843757.915480:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843757.978388:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134523648:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788843757.978466:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843757.978846:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134523648 00000100:00100000:3.0:1788843757.978856:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134523648 00000100:00100000:3.0:1788843757.978922:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788843757.978932:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008627b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134523648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788843757.978961:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788843757.979013:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008627b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134523648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843757.979021:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788843757.979068:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134523648:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788843757.982511:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788843757.982649:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788843757.982674:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134523776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788843757.982753:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843757.983037:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134523776 00000100:00100000:2.0:1788843757.983048:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134523776 00000100:00100000:2.0:1788843757.983105:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788843757.983124:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134523776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788843757.983294:0:17890:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788843757.983392:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134523776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 268us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843757.983399:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788843757.989396:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134523776:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788843758.492434:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134523904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788843758.492513:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843758.492663:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134523904 00000100:00100000:3.0:1788843758.492673:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134523904 00000100:00100000:3.0:1788843758.492729:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788843758.492741:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134523904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788843758.492779:0:17154:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788843758.492835:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134523904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843758.492843:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788843758.492890:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134523904:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1788843758.848708:0:19827:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg333-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788843758.938837:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843759.514649:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134524032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788843759.514743:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843759.514932:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134524160:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788843759.514968:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843759.515005:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134524032 00000100:00100000:3.0:1788843759.515015:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134524032 00000100:00100000:3.0:1788843759.515074:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134524160 00000100:00100000:3.0:1788843759.515078:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134524160 00000100:00100000:1.0:1788843759.515086:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788843759.515112:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134524032:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788843759.515115:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788843759.515120:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788843759.515135:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788843759.515241:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134524032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843759.515251:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788843759.515270:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788843759.515276:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134524160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788843759.515293:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788843759.515327:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134524160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843759.515334:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788843759.515381:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134524160:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788843759.515684:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134524032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843759.515880:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134524800:0@lo:400:kworker.0 00000100:00100000:1.0:1788843759.515913:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843759.515972:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134524416:0@lo:400:kworker.0 00000100:00100000:1.0:1788843759.515984:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1875738134525312:0@lo:400:kworker.0 00000100:00100000:3.0:1788843759.516025:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843759.516026:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843759.516051:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134524672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843759.516073:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134525056:0@lo:400:kworker.0 00000100:00100000:1.0:1788843759.516081:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843759.516118:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788843759.516121:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843759.516126:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134524544:0@lo:400:kworker.0 00000100:00100000:1.0:1788843759.516173:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843759.516191:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134525184:0@lo:400:kworker.0 00000100:00100000:1.0:1788843759.516222:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843759.516239:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134525696:0@lo:400:kworker.0 00000100:00100000:1.0:1788843759.516261:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843759.516281:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1875738134525568:0@lo:400:kworker.0 00000100:00100000:1.0:1788843759.516285:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134524800 00000100:00100000:1.0:1788843759.516291:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134524800 00000100:00100000:3.0:1788843759.516314:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843759.516323:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134525312 00000100:00100000:1.0:1788843759.516328:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134525312 00000100:00100000:3.0:1788843759.516334:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788843759.516343:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20b96c6c-8494-483a-b913-89dfc06b1440:3631:1875738134524288:0@lo:400:kworker.0 00000100:00100000:1.0:1788843759.516353:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134525184 00000100:00100000:1.0:1788843759.516357:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134525184 00000100:00100000:1.0:1788843759.516372:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134525696 00000100:00100000:1.0:1788843759.516375:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134525696 00000100:00100000:3.0:1788843759.516379:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843759.516409:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134524928:0@lo:400:kworker.0 00000100:00100000:3.0:1788843759.516431:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843759.516447:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1875738134525440:0@lo:400:kworker.0 00000100:00100000:3.0:1788843759.516466:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843759.516487:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134524288 00000100:00100000:3.0:1788843759.516491:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134524288 00000100:00100000:3.0:1788843759.516520:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788843759.516527:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+24:3631:x1875738134524288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843759.516564:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+24:3631:x1875738134524288:12345-0@lo:400:kworker.0 Request processed in 38us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843759.516572:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788843759.516606:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134525568 00000100:00100000:3.0:1788843759.516608:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134524416 00000100:00100000:1.0:1788843759.516612:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134525568 00000100:00100000:3.0:1788843759.516614:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134524416 00000100:00100000:1.0:1788843759.516635:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134525440 00000100:00100000:1.0:1788843759.516639:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134525440 00000100:00100000:3.0:1788843759.516649:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134524928 00000100:00100000:3.0:1788843759.516654:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134524928 00000100:00100000:2.0:1788843759.516659:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788843759.516660:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788843759.516670:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134524416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843759.516670:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134524800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843759.516678:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788843759.516687:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134524928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843759.516711:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134524416:12345-0@lo:400:kworker.0 Request processed in 43us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843759.516720:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788843759.516732:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134524928:12345-0@lo:400:kworker.0 Request processed in 46us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843759.516746:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788843759.516785:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1875738134524800:12345-0@lo:400:kworker.0 Request processed in 117us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843759.516792:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788843759.516979:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788843759.516987:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875738134525312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843759.517018:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1875738134525312:12345-0@lo:400:kworker.0 Request processed in 32us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843759.517023:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788843759.517035:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788843759.517040:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134525184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843759.517065:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1875738134525184:12345-0@lo:400:kworker.0 Request processed in 25us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843759.517078:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788843759.517091:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788843759.517096:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875738134525696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843759.517135:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1875738134525696:12345-0@lo:400:kworker.0 Request processed in 39us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843759.517159:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788843759.517172:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788843759.517178:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1875738134525568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843759.517204:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1875738134525568:12345-0@lo:400:kworker.0 Request processed in 27us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843759.517209:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788843759.517223:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788843759.517229:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1875738134525440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843759.517257:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1875738134525440:12345-0@lo:400:kworker.0 Request processed in 29us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843759.517258:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134525056 00000100:00100000:0.0:1788843759.517264:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134525056 00000100:00100000:1.0:1788843759.517268:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1788843759.517294:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788843759.517299:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788843759.517300:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843759.517309:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134524544 00000100:00100000:0.0:1788843759.517314:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134524544 00000100:00100000:0.0:1788843759.517340:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788843759.517347:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134525056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843759.517385:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134525056:12345-0@lo:400:kworker.0 Request processed in 38us (1266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843759.517392:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788843759.517405:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788843759.517411:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3633:x1875738134524544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843759.517438:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3633:x1875738134524544:12345-0@lo:400:kworker.0 Request processed in 27us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843759.517443:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788843759.517464:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134524672 00000100:00100000:0.0:1788843759.517467:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134524672 00000100:00100000:0.0:1788843759.517490:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788843759.517505:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1875738134524672:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788843759.517507:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1788843759.517523:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788843759.517542:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134524544:0@lo:400:kworker.0 00010000:00080000:1.0:1788843759.517562:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141b69f80 x1875738134525184/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843759.517564:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1875738134524672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843759.517581:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788843759.517585:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1875738134525184:0@lo:400:kworker.0 00010000:00080000:1.0:1788843759.517597:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141b6aa00 x1875738134525696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843759.517612:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1875738134525696:0@lo:400:kworker.0 00010000:00080000:1.0:1788843759.517623:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f987800 x1875738134524800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843759.517631:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1875738134524800:0@lo:400:kworker.0 00010000:00080000:1.0:1788843759.517641:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141b6a300 x1875738134525312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843759.517648:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1875738134525312:0@lo:400:kworker.0 00000100:00100000:1.0:1788843759.517660:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134524672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843759.518038:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20b96c6c-8494-483a-b913-89dfc06b1440:3631:1875738134524288:0@lo:400:kworker.0 00000100:00100000:3.0:1788843759.518049:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134524928:0@lo:400:kworker.0 00010000:00080000:3.0:1788843759.518060:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141b6bb80 x1875738134525440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843759.518070:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1875738134525440:0@lo:400:kworker.0 00000100:00100000:3.0:1788843759.518081:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134524416:0@lo:400:kworker.0 00000100:00100000:3.0:1788843759.518091:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134525056:0@lo:400:kworker.0 00010000:00080000:3.0:1788843759.518112:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd141b6b800 x1875738134525568/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843759.518121:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1875738134525568:0@lo:400:kworker.0 00000020:00000004:3.0:1788843759.895719:0:19879:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788843759.895951:0:19879:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788843759.964914:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788843760.039215:0:19469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000040:00080000:3.0:1788843760.411467:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788843760.988870:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788843761.201746:0:19929:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788843761.202114:0:19929:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788843761.413284:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843761.414082:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116607232 00000100:00100000:1.0:1788843761.414107:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116607232 00000100:00100000:1.0:1788843761.414205:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 117 00000100:00100000:1.0:1788843761.414276:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2386:x1875738116607232:12345-192.168.203.33@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788843761.414309:0:17144:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 6f839db8-0699-423e-a998-0395c59fee9e@192.168.203.33@tcp t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:1.0:1788843761.414412:0:17144:0:(genops.c:1385:class_connect()) connect: client 6f839db8-0699-423e-a998-0395c59fee9e, cookie 0xa762dfcbd58d2632 00000100:00080000:1.0:1788843761.414843:0:17144:0:(import.c:65:import_set_state_nolock()) ffff9bd006630800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843761.414967:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f839db8-0699-423e-a998-0395c59fee9e+5:2386:x1875738116607232:12345-192.168.203.33@tcp:250:mount.lustre.0 Request processed in 691us (1699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843761.427101:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 117 00000100:00100000:3.0:1788843761.446213:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843761.449063:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116607360 00000100:00100000:1.0:1788843761.449083:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116607360 00000100:00100000:1.0:1788843761.449177:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 118 00000100:00100000:1.0:1788843761.449205:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12eb04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f839db8-0699-423e-a998-0395c59fee9e+5:14898:x1875738116607360:12345-192.168.203.33@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788843761.449226:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843761.449247:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1420e4600/0xa762dfcbd58d2639 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490c92 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843761.449279:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1420e4600/0xa762dfcbd58d2639 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c92 expref: 6 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843761.449291:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1420e4600/0xa762dfcbd58d2639 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c92 expref: 6 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843761.449301:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1420e4600, rc 0) 00000100:00100000:1.0:1788843761.449375:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12eb04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f839db8-0699-423e-a998-0395c59fee9e+6:14898:x1875738116607360:12345-192.168.203.33@tcp:101:mount.lustre.0 Request processed in 173us (3178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843761.449383:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 118 00000100:00100000:3.0:1788843761.452751:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843761.453002:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116607488 00000100:00100000:1.0:1788843761.453013:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116607488 00000100:00100000:1.0:1788843761.453076:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 119 00000100:00100000:1.0:1788843761.453098:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12eb05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f839db8-0699-423e-a998-0395c59fee9e+6:14898:x1875738116607488:12345-192.168.203.33@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788843761.453264:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12eb05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f839db8-0699-423e-a998-0395c59fee9e+6:14898:x1875738116607488:12345-192.168.203.33@tcp:501:mount.lustre.0 Request processed in 178us (522us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788843761.453272:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 119 00000100:00100000:1.0:1788843761.461587:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843761.461700:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116607616 00000100:00100000:2.0:1788843761.461713:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116607616 00000100:00100000:2.0:1788843761.461784:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 120 00000100:00100000:2.0:1788843761.461796:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12eb06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f839db8-0699-423e-a998-0395c59fee9e+6:14898:x1875738116607616:12345-192.168.203.33@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788843761.461820:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843761.461842:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd100030a00/0xa762dfcbd58d2640 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490c99 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843761.461876:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd100030a00/0xa762dfcbd58d2640 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c99 expref: 7 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843761.461888:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd100030a00/0xa762dfcbd58d2640 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490c99 expref: 7 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843761.461899:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd100030a00, rc 0) 00000100:00100000:2.0:1788843761.461971:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12eb06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f839db8-0699-423e-a998-0395c59fee9e+7:14898:x1875738116607616:12345-192.168.203.33@tcp:101:mount.lustre.0 Request processed in 176us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843761.462004:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 120 00000100:00100000:1.0:1788843761.468284:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843761.468390:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116607744 00000100:00100000:3.0:1788843761.468402:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116607744 00000100:00100000:3.0:1788843761.468474:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 121 00000100:00100000:3.0:1788843761.468485:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12eb06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f839db8-0699-423e-a998-0395c59fee9e+7:14898:x1875738116607744:12345-192.168.203.33@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788843761.468716:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12eb06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f839db8-0699-423e-a998-0395c59fee9e+8:14898:x1875738116607744:12345-192.168.203.33@tcp:501:mount.lustre.0 Request processed in 232us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843761.468725:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 121 00000100:00100000:3.0:1788843761.473884:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843761.473990:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116607872 00000100:00100000:1.0:1788843761.474002:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116607872 00000100:00100000:1.0:1788843761.474068:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 122 00000100:00100000:1.0:1788843761.474115:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12eb04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f839db8-0699-423e-a998-0395c59fee9e+8:14898:x1875738116607872:12345-192.168.203.33@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788843761.474327:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12eb04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f839db8-0699-423e-a998-0395c59fee9e+8:14898:x1875738116607872:12345-192.168.203.33@tcp:503:mount.lustre.0 Request processed in 223us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843761.474336:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 122 00000100:00100000:1.0:1788843761.497941:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843761.498127:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116608000 00000100:00100000:3.0:1788843761.498138:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116608000 00000100:00100000:1.0:1788843761.500608:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 123 00000100:00100000:1.0:1788843761.500633:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12eb07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f839db8-0699-423e-a998-0395c59fee9e+8:14917:x1875738116608000:12345-192.168.203.33@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788843761.505335:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12eb07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f839db8-0699-423e-a998-0395c59fee9e+8:14917:x1875738116608000:12345-192.168.203.33@tcp:502:llog_process_th.0 Request processed in 4408us (7104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843761.505355:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 123 00000100:00100000:0.0:1788843761.542838:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843761.543014:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116608128 00000100:00100000:3.0:1788843761.543027:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116608128 00000100:00100000:3.0:1788843761.543100:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 124 00000100:00100000:3.0:1788843761.543112:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12eb04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f839db8-0699-423e-a998-0395c59fee9e+8:14917:x1875738116608128:12345-192.168.203.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788843761.543341:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12eb04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f839db8-0699-423e-a998-0395c59fee9e+8:14917:x1875738116608128:12345-192.168.203.33@tcp:502:llog_process_th.0 Request processed in 230us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843761.543349:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 124 00000100:00100000:2.0:1788843761.548864:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843761.549249:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116608256 00000100:00100000:1.0:1788843761.549261:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116608256 00000100:00100000:1.0:1788843761.549328:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 125 00000100:00100000:1.0:1788843761.549338:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12eb05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f839db8-0699-423e-a998-0395c59fee9e+8:14917:x1875738116608256:12345-192.168.203.33@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788843761.549615:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12eb05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f839db8-0699-423e-a998-0395c59fee9e+8:14917:x1875738116608256:12345-192.168.203.33@tcp:502:llog_process_th.0 Request processed in 276us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843761.549623:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 125 00000100:00100000:1.0:1788843761.563011:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843761.563176:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116608384 00000100:00100000:2.0:1788843761.563187:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116608384 00000100:00100000:2.0:1788843761.563295:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 126 00000100:00100000:2.0:1788843761.563308:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12eb07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f839db8-0699-423e-a998-0395c59fee9e+8:14898:x1875738116608384:12345-192.168.203.33@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788843761.563331:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843761.563355:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd100031600/0xa762dfcbd58d2647 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490cca expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843761.563402:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd100031600/0xa762dfcbd58d2647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490cca expref: 9 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843761.563413:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd100031600/0xa762dfcbd58d2647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490cca expref: 9 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843761.563421:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd100031600, rc 0) 00000100:00100000:2.0:1788843761.563496:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12eb07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f839db8-0699-423e-a998-0395c59fee9e+9:14898:x1875738116608384:12345-192.168.203.33@tcp:101:mount.lustre.0 Request processed in 191us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843761.563502:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 126 00000100:00100000:1.0:1788843761.569994:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843761.570112:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116608512 00000100:00100000:2.0:1788843761.570124:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116608512 00000100:00100000:2.0:1788843761.570213:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 127 00000100:00100000:2.0:1788843761.570225:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12eb05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f839db8-0699-423e-a998-0395c59fee9e+9:14898:x1875738116608512:12345-192.168.203.33@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788843761.570259:0:17142:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788843761.570294:0:17142:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788843761.570299:0:17142:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788843761.570308:0:17142:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788843761.570312:0:17142:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788843761.570315:0:17142:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1788843761.571953:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12eb05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f839db8-0699-423e-a998-0395c59fee9e+9:14898:x1875738116608512:12345-192.168.203.33@tcp:256:mount.lustre.0 Request processed in 1719us (1962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843761.571969:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 127 00000100:00100000:1.0:1788843761.576200:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843761.576296:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116608640 00000100:00100000:3.0:1788843761.576307:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116608640 00000100:00100000:3.0:1788843761.576379:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 128 00000100:00100000:3.0:1788843761.576390:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007745450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f839db8-0699-423e-a998-0395c59fee9e+9:14898:x1875738116608640:12345-192.168.203.33@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788843761.576410:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843761.576431:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd118f70400/0xa762dfcbd58d264e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490cd1 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843761.576464:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd118f70400/0xa762dfcbd58d264e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490cd1 expref: 10 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843761.576476:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd118f70400/0xa762dfcbd58d264e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490cd1 expref: 10 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843761.576508:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd118f70400, rc 0) 00000100:00100000:3.0:1788843761.576575:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007745450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f839db8-0699-423e-a998-0395c59fee9e+10:14898:x1875738116608640:12345-192.168.203.33@tcp:101:mount.lustre.0 Request processed in 176us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843761.576582:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 128 00000100:00100000:1.0:1788843761.582217:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843761.582769:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116608768 00000100:00100000:2.0:1788843761.582780:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116608768 00000100:00100000:2.0:1788843761.582842:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 129 00000100:00100000:2.0:1788843761.582853:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007746850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f839db8-0699-423e-a998-0395c59fee9e+10:14898:x1875738116608768:12345-192.168.203.33@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788843761.583039:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007746850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f839db8-0699-423e-a998-0395c59fee9e+10:14898:x1875738116608768:12345-192.168.203.33@tcp:501:mount.lustre.0 Request processed in 188us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843761.583047:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 129 00000100:00100000:0.0:1788843761.586687:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843761.586870:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116608896 00000100:00100000:1.0:1788843761.586883:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116608896 00000100:00100000:1.0:1788843761.586999:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 130 00000100:00100000:1.0:1788843761.587012:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007745c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f839db8-0699-423e-a998-0395c59fee9e+10:14898:x1875738116608896:12345-192.168.203.33@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788843761.587244:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007745c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f839db8-0699-423e-a998-0395c59fee9e+10:14898:x1875738116608896:12345-192.168.203.33@tcp:503:mount.lustre.0 Request processed in 234us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843761.587253:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 130 00000100:00100000:1.0:1788843761.590374:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843761.590908:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116609024 00000100:00100000:3.0:1788843761.590921:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116609024 00000100:00100000:2.0:1788843761.591111:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 131 00000100:00100000:2.0:1788843761.591123:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007745850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f839db8-0699-423e-a998-0395c59fee9e+10:14923:x1875738116609024:12345-192.168.203.33@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788843761.591353:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007745850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f839db8-0699-423e-a998-0395c59fee9e+10:14923:x1875738116609024:12345-192.168.203.33@tcp:502:llog_process_th.0 Request processed in 231us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843761.591362:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 131 00000100:00100000:3.0:1788843761.595650:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843761.595859:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116609152 00000100:00100000:1.0:1788843761.595869:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116609152 00000100:00100000:1.0:1788843761.595937:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 132 00000100:00100000:1.0:1788843761.595948:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007747c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f839db8-0699-423e-a998-0395c59fee9e+10:14923:x1875738116609152:12345-192.168.203.33@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788843761.596188:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007747c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f839db8-0699-423e-a998-0395c59fee9e+10:14923:x1875738116609152:12345-192.168.203.33@tcp:502:llog_process_th.0 Request processed in 240us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843761.596197:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 132 00000100:00100000:0.0:1788843761.612095:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843761.612249:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843761.612341:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116609280 00000100:00100000:2.0:1788843761.612353:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116609280 00000100:00100000:2.0:1788843761.612399:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116609536 00000100:00100000:2.0:1788843761.612401:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116609536 00000100:00100000:2.0:1788843761.612414:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7 00000100:00100000:2.0:1788843761.612422:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2386:x1875738116609280:12345-192.168.203.33@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788843761.612455:0:17151:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0@192.168.203.33@tcp t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:2.0:1788843761.612519:0:17151:0:(genops.c:1385:class_connect()) connect: client 6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0, cookie 0xa762dfcbd58d2655 00000004:00100000:2.0:1788843761.612578:0:17151:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788843761.612821:0:17151:0:(import.c:65:import_set_state_nolock()) ffff9bd1074c8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788843761.612896:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+6:2386:x1875738116609280:12345-192.168.203.33@tcp:38:mount.lustre.0 Request processed in 474us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843761.612904:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7 00000100:00100000:2.0:1788843761.612925:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 8 00000100:00100000:2.0:1788843761.612929:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2386:x1875738116609536:12345-192.168.203.33@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788843761.612946:0:17151:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0@192.168.203.33@tcp t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:2.0:1788843761.612978:0:17151:0:(genops.c:1385:class_connect()) connect: client 6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0, cookie 0xa762dfcbd58d265c 00000004:00100000:2.0:1788843761.612990:0:17151:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788843761.613176:0:17151:0:(import.c:65:import_set_state_nolock()) ffff9bd1074cc000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788843761.613201:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+6:2386:x1875738116609536:12345-192.168.203.33@tcp:38:mount.lustre.0 Request processed in 270us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843761.613208:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 8 00000100:00100000:3.0:1788843761.629960:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843761.630010:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843761.630044:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843761.630182:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116609664 00000100:00100000:0.0:1788843761.630182:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116609792 00000100:00100000:0.0:1788843761.630193:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116609792 00000100:00100000:1.0:1788843761.630196:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116609664 00000100:00100000:2.0:1788843761.630260:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116609408 00000100:00100000:2.0:1788843761.630266:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116609408 00000100:00100000:2.0:1788843761.630314:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 9 00000100:00100000:2.0:1788843761.630324:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+7:0:x1875738116609408:12345-192.168.203.33@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788843761.630372:0:17151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788843761.630471:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+7:0:x1875738116609408:12345-192.168.203.33@tcp:41:mount.lustre.0 Request processed in 148us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843761.630480:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 9 00000100:00100000:0.0:1788843761.630570:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 10 00000100:00100000:0.0:1788843761.630579:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+6:14898:x1875738116609792:12345-192.168.203.33@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788843761.630594:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788843761.630622:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+6:14898:x1875738116609792:12345-192.168.203.33@tcp:41:mount.lustre.0 Request processed in 46us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843761.630629:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 10 00000100:00100000:2.0:1788843761.637098:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843761.638712:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116609920 00000100:00100000:3.0:1788843761.638731:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116609920 00000100:00100000:3.0:1788843761.638834:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 11 00000100:00100000:3.0:1788843761.638847:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+6:14898:x1875738116609920:12345-192.168.203.33@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788843761.638964:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+6:14898:x1875738116609920:12345-192.168.203.33@tcp:40:mount.lustre.0 Request processed in 120us (1893us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843761.638972:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 11 00000100:00100000:1.0:1788843761.639351:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 12 00000100:00100000:1.0:1788843761.639361:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+6:0:x1875738116609664:12345-192.168.203.33@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788843761.639392:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788843761.639465:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+6:0:x1875738116609664:12345-192.168.203.33@tcp:41:mount.lustre.0 Request processed in 105us (9453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843761.639472:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 12 00000100:00080000:0.0:1788843761.641013:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788843761.641024:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843761.649193:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843761.649246:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843761.649301:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843761.649392:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116610048 00000100:00100000:1.0:1788843761.649404:0:18655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116610048 00000100:00100000:1.0:1788843761.649457:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116610176 00000100:00100000:1.0:1788843761.649461:0:18655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116610176 00000100:00100000:1.0:1788843761.649487:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 16 00000100:00100000:1.0:1788843761.649496:0:18655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2386:x1875738116610048:12345-192.168.203.33@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788843761.649547:0:18655:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0@192.168.203.33@tcp t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:1.0:1788843761.649599:0:18655:0:(genops.c:1385:class_connect()) connect: client 6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0, cookie 0xa762dfcbd58d2663 00002000:00100000:1.0:1788843761.649615:0:18655:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0/ffff9bd006522000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788843761.649639:0:18655:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788843761.649900:0:19632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 17 00000100:00100000:2.0:1788843761.649907:0:19632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2386:x1875738116610176:12345-192.168.203.33@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788843761.649946:0:19632:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0@192.168.203.33@tcp t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:2.0:1788843761.649969:0:19632:0:(genops.c:1385:class_connect()) connect: client 6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0, cookie 0xa762dfcbd58d266a 00002000:00100000:2.0:1788843761.649975:0:19632:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0/ffff9bd1074ca000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788843761.649989:0:19632:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788843761.650192:0:19632:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788843761.650228:0:19632:0:(import.c:65:import_set_state_nolock()) ffff9bd1074cf000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788843761.650307:0:19632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+6:2386:x1875738116610176:12345-192.168.203.33@tcp:8:mount.lustre.0 Request processed in 398us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843761.650316:0:19632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 17 00002000:00080000:1.0:1788843761.650505:0:18655:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788843761.650524:0:18655:0:(import.c:65:import_set_state_nolock()) ffff9bd006521000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843761.650551:0:18655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+6:2386:x1875738116610048:12345-192.168.203.33@tcp:8:mount.lustre.0 Request processed in 1055us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843761.650572:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 16 00000100:00100000:3.0:1788843761.651687:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116610304 00000100:00100000:3.0:1788843761.651701:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116610304 00000100:00100000:3.0:1788843761.651774:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 3 00000100:00100000:3.0:1788843761.651784:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141aebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+6:14898:x1875738116610304:12345-192.168.203.33@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788843761.651849:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141aebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+6:14898:x1875738116610304:12345-192.168.203.33@tcp:900:mount.lustre.0 Request processed in 67us (2709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843761.651856:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 3 00000100:00100000:1.0:1788843761.660507:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843761.660719:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116610432 00000100:00100000:3.0:1788843761.660746:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116610432 00000100:00100000:3.0:1788843761.660877:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 0 00000100:00100000:3.0:1788843761.660889:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+6:14898:x1875738116610432:12345-192.168.203.33@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788843761.663675:0:17152:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2667us 00000004:00200000:0.0:1788843761.680949:0:17152:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788843761.681132:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+6:14898:x1875738116610432:12345-192.168.203.33@tcp:33:mount.lustre.0 Request processed in 20237us (20633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843761.681171:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 0 00000100:00100000:3.0:1788843761.834863:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843761.834999:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116610560 00000100:00100000:2.0:1788843761.835011:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116610560 00000100:00100000:2.0:1788843761.835095:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 13 00000100:00100000:2.0:1788843761.835107:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+6:14946:x1875738116610560:12345-192.168.203.33@tcp:101:mkdir.0 00010000:00010000:2.0:1788843761.835134:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843761.835220:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030c00/0xa762dfcbd58d2671 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490d02 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843761.835305:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030200/0xa762dfcbd58d2678 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843761.835334:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030200/0xa762dfcbd58d2678 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843761.835352:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030200/0xa762dfcbd58d2678 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843761.835454:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788843761.835459:0:17151:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788843761.835510:0:17151:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030200/0xa762dfcbd58d2678 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843761.835543:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030c00/0xa762dfcbd58d2671 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d02 expref: 8 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843761.835565:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030200/0xa762dfcbd58d2678 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d02 expref: 7 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843761.835575:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd133390a00) 00010000:00010000:2.0:1788843761.835578:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788843761.835582:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd100030200, rc 0) 00000100:00100000:2.0:1788843761.835656:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+7:14946:x1875738116610560:12345-192.168.203.33@tcp:101:mkdir.0 Request processed in 552us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843761.835664:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 13 00010000:00010000:2.0:1788843762.013802:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843763.034355:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843763.098727:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134525824:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788843763.098824:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843763.100019:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843763.100038:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd102fb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134525952:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788843763.100171:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843763.100724:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134525952 00000100:00100000:2.0:1788843763.100738:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134525952 00000100:00100000:2.0:1788843763.100829:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788843763.100841:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134525952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788843763.100886:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788843763.100963:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134525952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843763.100982:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788843763.101046:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd102fb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134525952:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788843763.101299:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843763.101550:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134525824 00000100:00100000:0.0:1788843763.101557:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134525824 00000100:00100000:0.0:1788843763.101599:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788843763.101606:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134525824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788843763.101660:0:17890:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788843763.101724:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134525824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (2901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843763.101732:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788843763.101870:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134525824:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788843763.611537:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134526080:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788843763.611632:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843763.614260:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134526080 00000100:00100000:3.0:1788843763.614280:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134526080 00000100:00100000:3.0:1788843763.614484:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788843763.614496:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134526080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788843763.614540:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788843763.615085:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134526080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 578us (3439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843763.615188:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788843763.615287:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134526080:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788843763.876132:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843763.882636:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116610688 00000100:00100000:2.0:1788843763.882660:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116610688 00000100:00100000:2.0:1788843763.882799:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 14 00000100:00100000:2.0:1788843763.882812:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+7:14998:x1875738116610688:12345-192.168.203.33@tcp:41:lfs.0 00000004:00000024:2.0:1788843763.882855:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788843763.882981:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+7:14998:x1875738116610688:12345-192.168.203.33@tcp:41:lfs.0 Request processed in 171us (6866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843763.882989:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 14 00000100:00080000:1.0:1788843763.884353:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843763.891108:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843763.891516:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116610816 00000100:00100000:1.0:1788843763.891526:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116610816 00000100:00100000:1.0:1788843763.891620:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 15 00000100:00100000:1.0:1788843763.891632:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+6:14998:x1875738116610816:12345-192.168.203.33@tcp:41:lfs.0 00000004:00000024:1.0:1788843763.891673:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788843763.891797:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+6:14998:x1875738116610816:12345-192.168.203.33@tcp:41:lfs.0 Request processed in 167us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843763.891826:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 15 00000100:00080000:0.0:1788843763.894410:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788843763.909370:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843763.909480:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116610944 00000100:00100000:1.0:1788843763.909491:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116610944 00000100:00100000:1.0:1788843763.909636:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 10 00000100:00100000:1.0:1788843763.909649:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+6:14998:x1875738116610944:12345-192.168.203.33@tcp:13:lfs.0 00002000:00000024:1.0:1788843763.909679:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788843763.909794:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+6:14998:x1875738116610944:12345-192.168.203.33@tcp:13:lfs.0 Request processed in 148us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843763.909803:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 10 00000100:00080000:0.0:1788843763.910682:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788843763.912327:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843763.914012:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116611072 00000100:00100000:1.0:1788843763.914029:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116611072 00000100:00100000:1.0:1788843763.914176:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 11 00000100:00100000:1.0:1788843763.914188:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+6:14998:x1875738116611072:12345-192.168.203.33@tcp:13:lfs.0 00002000:00000024:1.0:1788843763.914228:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788843763.914351:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+6:14998:x1875738116611072:12345-192.168.203.33@tcp:13:lfs.0 Request processed in 165us (2036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843763.914360:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 11 00000100:00080000:0.0:1788843763.914991:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788843764.059358:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843764.113941:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843764.114194:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116611200 00000100:00100000:1.0:1788843764.114205:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116611200 00000100:00100000:1.0:1788843764.114275:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 133 00000100:00100000:1.0:1788843764.114288:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007747450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f839db8-0699-423e-a998-0395c59fee9e+10:15029:x1875738116611200:12345-192.168.203.33@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788843764.114310:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843764.114332:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1420e5a00/0xa762dfcbd58d267f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490d09 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843764.114390:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1420e5a00/0xa762dfcbd58d267f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d09 expref: 11 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843764.114402:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1420e5a00/0xa762dfcbd58d267f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d09 expref: 11 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843764.114411:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1420e5a00, rc 0) 00000100:00100000:1.0:1788843764.114485:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007747450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f839db8-0699-423e-a998-0395c59fee9e+11:15029:x1875738116611200:12345-192.168.203.33@tcp:101:mount.lustre.0 Request processed in 199us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843764.114493:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 133 00000100:00100000:2.0:1788843764.131955:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843764.132449:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116611328 00000100:00100000:1.0:1788843764.132462:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116611328 00000100:00100000:1.0:1788843764.132545:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 134 00000100:00100000:1.0:1788843764.132558:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007744c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f839db8-0699-423e-a998-0395c59fee9e+11:15029:x1875738116611328:12345-192.168.203.33@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788843764.132772:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007744c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f839db8-0699-423e-a998-0395c59fee9e+11:15029:x1875738116611328:12345-192.168.203.33@tcp:501:mount.lustre.0 Request processed in 217us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843764.132781:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 134 00000100:00100000:2.0:1788843764.137205:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843764.138701:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116611456 00000100:00100000:3.0:1788843764.138729:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116611456 00000100:00100000:3.0:1788843764.138821:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 135 00000100:00100000:3.0:1788843764.139019:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007745050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f839db8-0699-423e-a998-0395c59fee9e+11:15029:x1875738116611456:12345-192.168.203.33@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788843764.139257:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007745050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f839db8-0699-423e-a998-0395c59fee9e+11:15029:x1875738116611456:12345-192.168.203.33@tcp:503:mount.lustre.0 Request processed in 244us (2066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843764.139265:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 135 00000100:00100000:2.0:1788843764.157438:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843764.157722:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116611584 00000100:00100000:1.0:1788843764.157741:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116611584 00000100:00100000:1.0:1788843764.157817:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 136 00000100:00100000:1.0:1788843764.158088:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007747850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f839db8-0699-423e-a998-0395c59fee9e+11:15037:x1875738116611584:12345-192.168.203.33@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788843764.158328:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007747850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f839db8-0699-423e-a998-0395c59fee9e+11:15037:x1875738116611584:12345-192.168.203.33@tcp:502:llog_process_th.0 Request processed in 501us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843764.158337:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 136 00000100:00100000:2.0:1788843764.196347:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843764.196433:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116611712 00000100:00100000:3.0:1788843764.196444:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116611712 00000100:00100000:3.0:1788843764.196508:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 137 00000100:00100000:3.0:1788843764.196520:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007746050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f839db8-0699-423e-a998-0395c59fee9e+11:15037:x1875738116611712:12345-192.168.203.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788843764.196719:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007746050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f839db8-0699-423e-a998-0395c59fee9e+11:15037:x1875738116611712:12345-192.168.203.33@tcp:502:llog_process_th.0 Request processed in 200us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843764.196946:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 137 00000100:00100000:2.0:1788843764.207976:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843764.208209:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116611840 00000100:00100000:1.0:1788843764.208239:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116611840 00000100:00100000:1.0:1788843764.208304:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 138 00000100:00100000:1.0:1788843764.208316:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f839db8-0699-423e-a998-0395c59fee9e+11:15037:x1875738116611840:12345-192.168.203.33@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788843764.208496:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f839db8-0699-423e-a998-0395c59fee9e+11:15037:x1875738116611840:12345-192.168.203.33@tcp:502:llog_process_th.0 Request processed in 182us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843764.208506:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 138 00000100:00100000:0.0:1788843764.222345:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843764.223215:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116611968 00000100:00100000:2.0:1788843764.223229:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116611968 00000100:00100000:2.0:1788843764.223367:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 139 00000100:00100000:2.0:1788843764.223381:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f839db8-0699-423e-a998-0395c59fee9e+11:15029:x1875738116611968:12345-192.168.203.33@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788843764.223423:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843764.223445:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd100031400/0xa762dfcbd58d2686 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490d3a expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843764.223481:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd100031400/0xa762dfcbd58d2686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d3a expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843764.223510:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd100031400/0xa762dfcbd58d2686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d3a expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843764.223520:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd100031400, rc 0) 00000100:00100000:2.0:1788843764.223612:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f839db8-0699-423e-a998-0395c59fee9e+12:15029:x1875738116611968:12345-192.168.203.33@tcp:101:mount.lustre.0 Request processed in 235us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843764.223627:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 139 00000100:00100000:3.0:1788843764.229288:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843764.231284:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116612096 00000100:00100000:1.0:1788843764.231306:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116612096 00000100:00100000:1.0:1788843764.231382:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 140 00000100:00100000:1.0:1788843764.231393:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f839db8-0699-423e-a998-0395c59fee9e+12:15029:x1875738116612096:12345-192.168.203.33@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788843764.231429:0:17142:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788843764.231463:0:17142:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788843764.231468:0:17142:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788843764.231471:0:17142:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788843764.231475:0:17142:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788843764.231477:0:17142:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1788843764.237704:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f839db8-0699-423e-a998-0395c59fee9e+12:15029:x1875738116612096:12345-192.168.203.33@tcp:256:mount.lustre.0 Request processed in 6007us (8124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843764.237732:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 140 00000100:00100000:3.0:1788843764.243974:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843764.244337:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116612224 00000100:00100000:2.0:1788843764.244348:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116612224 00000100:00100000:2.0:1788843764.244466:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 141 00000100:00100000:2.0:1788843764.244478:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f839db8-0699-423e-a998-0395c59fee9e+12:15029:x1875738116612224:12345-192.168.203.33@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788843764.244497:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843764.244517:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd100030c00/0xa762dfcbd58d268d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490d41 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843764.244562:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd100030c00/0xa762dfcbd58d268d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d41 expref: 13 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843764.244575:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd100030c00/0xa762dfcbd58d268d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d41 expref: 13 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843764.244612:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd100030c00, rc 0) 00000100:00100000:2.0:1788843764.244690:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f839db8-0699-423e-a998-0395c59fee9e+13:15029:x1875738116612224:12345-192.168.203.33@tcp:101:mount.lustre.0 Request processed in 214us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843764.244698:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 141 00000100:00100000:2.0:1788843764.248280:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843764.248602:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116612352 00000100:00100000:1.0:1788843764.248678:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116612352 00000100:00100000:1.0:1788843764.248870:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 142 00000100:00100000:1.0:1788843764.248892:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f839db8-0699-423e-a998-0395c59fee9e+13:15029:x1875738116612352:12345-192.168.203.33@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788843764.249112:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f839db8-0699-423e-a998-0395c59fee9e+13:15029:x1875738116612352:12345-192.168.203.33@tcp:501:mount.lustre.0 Request processed in 232us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843764.249121:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 142 00000100:00100000:3.0:1788843764.252295:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843764.253575:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116612480 00000100:00100000:0.0:1788843764.253592:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116612480 00000100:00100000:0.0:1788843764.255854:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 143 00000100:00100000:0.0:1788843764.255939:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f839db8-0699-423e-a998-0395c59fee9e+13:15029:x1875738116612480:12345-192.168.203.33@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788843764.256347:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f839db8-0699-423e-a998-0395c59fee9e+13:15029:x1875738116612480:12345-192.168.203.33@tcp:503:mount.lustre.0 Request processed in 477us (4068us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843764.256356:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 143 00000100:00100000:3.0:1788843764.278444:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843764.279252:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116612608 00000100:00100000:0.0:1788843764.279268:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116612608 00000100:00100000:0.0:1788843764.279697:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 144 00000100:00100000:0.0:1788843764.279852:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f839db8-0699-423e-a998-0395c59fee9e+13:15041:x1875738116612608:12345-192.168.203.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788843764.280324:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f839db8-0699-423e-a998-0395c59fee9e+13:15041:x1875738116612608:12345-192.168.203.33@tcp:502:llog_process_th.0 Request processed in 613us (1893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843764.280335:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 144 00000100:00100000:3.0:1788843764.284444:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843764.284897:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116612736 00000100:00100000:2.0:1788843764.284918:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116612736 00000100:00100000:2.0:1788843764.285093:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 145 00000100:00100000:2.0:1788843764.285327:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f839db8-0699-423e-a998-0395c59fee9e+13:15041:x1875738116612736:12345-192.168.203.33@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788843764.286253:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f839db8-0699-423e-a998-0395c59fee9e+13:15041:x1875738116612736:12345-192.168.203.33@tcp:502:llog_process_th.0 Request processed in 1141us (1827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843764.286267:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 145 00000100:00100000:2.0:1788843764.300255:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843764.300290:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843764.300320:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843764.300347:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843764.300379:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116613760 00000100:00100000:2.0:1788843764.300390:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116613760 00000100:00100000:2.0:1788843764.300451:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 4 00000100:00100000:2.0:1788843764.300463:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+6:2390:x1875738116613760:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843764.300563:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+6:2390:x1875738116613760:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 102us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843764.300572:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 4 00000100:00100000:2.0:1788843764.300616:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843764.300731:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843764.301112:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116613888 00000100:00100000:1.0:1788843764.301119:0:18655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116613888 00000100:00100000:1.0:1788843764.301188:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 5 00000100:00100000:1.0:1788843764.301196:0:18655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+6:2390:x1875738116613888:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843764.301244:0:18655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+6:2390:x1875738116613888:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 49us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843764.301251:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 5 00000100:00100000:1.0:1788843764.301270:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116612864 00000100:00100000:1.0:1788843764.301274:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116612864 00000100:00100000:1.0:1788843764.301286:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116613120 00000100:00100000:1.0:1788843764.301289:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116613120 00000100:00100000:1.0:1788843764.301297:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116613504 00000100:00100000:1.0:1788843764.301299:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116613504 00000100:00100000:1.0:1788843764.301314:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116613632 00000100:00100000:1.0:1788843764.301316:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116613632 00000100:00100000:1.0:1788843764.301328:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 39 00000100:00100000:1.0:1788843764.301333:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+7:2390:x1875738116613504:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843764.301360:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+7:2390:x1875738116613504:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 27us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843764.301367:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 39 00000100:00100000:1.0:1788843764.301377:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 40 00000100:00100000:1.0:1788843764.301383:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+6:2390:x1875738116613632:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843764.301402:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+6:2390:x1875738116613632:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 19us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843764.301407:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 40 00000100:00100000:1.0:1788843764.301418:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 16 00000100:00100000:1.0:1788843764.301422:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2386:x1875738116612864:12345-192.168.203.33@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788843764.301459:0:17149:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from cd5af0cf-62ad-40c0-947c-f942bbf55123@192.168.203.33@tcp t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:1.0:1788843764.301534:0:17149:0:(genops.c:1385:class_connect()) connect: client cd5af0cf-62ad-40c0-947c-f942bbf55123, cookie 0xa762dfcbd58d2694 00000004:00100000:1.0:1788843764.301566:0:17149:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788843764.301681:0:17149:0:(import.c:65:import_set_state_nolock()) ffff9bd006526000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843764.301722:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd5af0cf-62ad-40c0-947c-f942bbf55123+6:2386:x1875738116612864:12345-192.168.203.33@tcp:38:mount.lustre.0 Request processed in 298us (1484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843764.301730:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 16 00000100:00100000:1.0:1788843764.301749:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 17 00000100:00100000:1.0:1788843764.301754:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2386:x1875738116613120:12345-192.168.203.33@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788843764.301769:0:17149:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from cd5af0cf-62ad-40c0-947c-f942bbf55123@192.168.203.33@tcp t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:1.0:1788843764.301791:0:17149:0:(genops.c:1385:class_connect()) connect: client cd5af0cf-62ad-40c0-947c-f942bbf55123, cookie 0xa762dfcbd58d269b 00000004:00100000:1.0:1788843764.301804:0:17149:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788843764.301852:0:17149:0:(import.c:65:import_set_state_nolock()) ffff9bd006526800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843764.302037:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd5af0cf-62ad-40c0-947c-f942bbf55123+6:2386:x1875738116613120:12345-192.168.203.33@tcp:38:mount.lustre.0 Request processed in 120us (1585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843764.302047:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 17 00000040:00080000:1.0:1788843764.317018:0:17908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788843764.323267:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843764.323302:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843764.323332:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843764.323409:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116613376 00000100:00100000:0.0:1788843764.323420:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116613376 00000100:00100000:0.0:1788843764.323509:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116613248 00000100:00100000:0.0:1788843764.323529:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116613248 00000100:00100000:0.0:1788843764.323547:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116612992 00000100:00100000:0.0:1788843764.323549:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116612992 00000100:00100000:0.0:1788843764.323566:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 18 00000100:00100000:0.0:1788843764.323576:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd5af0cf-62ad-40c0-947c-f942bbf55123+7:15029:x1875738116613376:12345-192.168.203.33@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788843764.323622:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788843764.323695:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd5af0cf-62ad-40c0-947c-f942bbf55123+7:15029:x1875738116613376:12345-192.168.203.33@tcp:41:mount.lustre.0 Request processed in 121us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843764.323703:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 18 00000100:00100000:0.0:1788843764.323732:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 19 00000100:00100000:0.0:1788843764.323738:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd5af0cf-62ad-40c0-947c-f942bbf55123+6:0:x1875738116613248:12345-192.168.203.33@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788843764.323756:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788843764.323787:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd5af0cf-62ad-40c0-947c-f942bbf55123+6:0:x1875738116613248:12345-192.168.203.33@tcp:41:mount.lustre.0 Request processed in 50us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843764.323793:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 19 00000100:00100000:0.0:1788843764.323816:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 20 00000100:00100000:0.0:1788843764.323823:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd5af0cf-62ad-40c0-947c-f942bbf55123+6:0:x1875738116612992:12345-192.168.203.33@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788843764.323842:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788843764.323873:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd5af0cf-62ad-40c0-947c-f942bbf55123+6:0:x1875738116612992:12345-192.168.203.33@tcp:41:mount.lustre.0 Request processed in 51us (541us total) trans 0 rc 0/0 00000100:00080000:2.0:1788843764.324183:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788843764.324188:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843764.324243:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 20 00000100:00100000:3.0:1788843764.325980:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843764.326076:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116614016 00000100:00100000:0.0:1788843764.326087:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116614016 00000100:00100000:1.0:1788843764.326265:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 21 00000100:00100000:1.0:1788843764.326280:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd5af0cf-62ad-40c0-947c-f942bbf55123+6:15029:x1875738116614016:12345-192.168.203.33@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788843764.326381:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd5af0cf-62ad-40c0-947c-f942bbf55123+6:15029:x1875738116614016:12345-192.168.203.33@tcp:40:mount.lustre.0 Request processed in 105us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843764.326389:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 21 00000100:00100000:1.0:1788843764.330685:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843764.330803:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843764.330937:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843764.332491:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116614144 00000100:00100000:2.0:1788843764.332509:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116614144 00000100:00100000:2.0:1788843764.332570:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116614272 00000100:00100000:2.0:1788843764.332575:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116614272 00000100:00100000:2.0:1788843764.332609:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 18 00000100:00100000:2.0:1788843764.332618:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2386:x1875738116614144:12345-192.168.203.33@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788843764.332660:0:18654:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from cd5af0cf-62ad-40c0-947c-f942bbf55123@192.168.203.33@tcp t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:2.0:1788843764.332699:0:18654:0:(genops.c:1385:class_connect()) connect: client cd5af0cf-62ad-40c0-947c-f942bbf55123, cookie 0xa762dfcbd58d26a2 00002000:00100000:2.0:1788843764.332851:0:18654:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cd5af0cf-62ad-40c0-947c-f942bbf55123/ffff9bd12e2b2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788843764.332865:0:18654:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788843764.332983:0:18654:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788843764.333020:0:18654:0:(import.c:65:import_set_state_nolock()) ffff9bd12e2b3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788843764.333109:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd5af0cf-62ad-40c0-947c-f942bbf55123+6:2386:x1875738116614144:12345-192.168.203.33@tcp:8:mount.lustre.0 Request processed in 491us (2315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843764.333118:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 18 00000100:00100000:2.0:1788843764.333137:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 19 00000100:00100000:2.0:1788843764.333181:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2386:x1875738116614272:12345-192.168.203.33@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788843764.333201:0:18654:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from cd5af0cf-62ad-40c0-947c-f942bbf55123@192.168.203.33@tcp t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:2.0:1788843764.333248:0:18654:0:(genops.c:1385:class_connect()) connect: client cd5af0cf-62ad-40c0-947c-f942bbf55123, cookie 0xa762dfcbd58d26a9 00002000:00100000:2.0:1788843764.333254:0:18654:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cd5af0cf-62ad-40c0-947c-f942bbf55123/ffff9bd127b88000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788843764.333267:0:18654:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788843764.333312:0:18654:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788843764.333328:0:18654:0:(import.c:65:import_set_state_nolock()) ffff9bd127b8e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788843764.333352:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd5af0cf-62ad-40c0-947c-f942bbf55123+6:2386:x1875738116614272:12345-192.168.203.33@tcp:8:mount.lustre.0 Request processed in 171us (2415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843764.333359:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 19 00000100:00100000:3.0:1788843764.337025:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116614400 00000100:00100000:3.0:1788843764.337046:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116614400 00000100:00100000:0.0:1788843764.338710:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 4 00000100:00100000:0.0:1788843764.338732:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:cd5af0cf-62ad-40c0-947c-f942bbf55123+6:15029:x1875738116614400:12345-192.168.203.33@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788843764.338888:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:cd5af0cf-62ad-40c0-947c-f942bbf55123+6:15029:x1875738116614400:12345-192.168.203.33@tcp:900:mount.lustre.0 Request processed in 163us (8218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843764.338897:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 4 00000100:00100000:3.0:1788843764.341063:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843764.341227:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116614528 00000100:00100000:2.0:1788843764.341237:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116614528 00000100:00100000:2.0:1788843764.341297:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1 00000100:00100000:2.0:1788843764.341309:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd5af0cf-62ad-40c0-947c-f942bbf55123+6:15029:x1875738116614528:12345-192.168.203.33@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788843764.341419:0:17153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788843764.341527:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd5af0cf-62ad-40c0-947c-f942bbf55123+6:15029:x1875738116614528:12345-192.168.203.33@tcp:33:mount.lustre.0 Request processed in 219us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843764.341535:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1 00000100:00100000:2.0:1788843764.512577:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843764.512676:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116614656 00000100:00100000:3.0:1788843764.512688:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116614656 00000100:00100000:3.0:1788843764.512765:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 22 00000100:00100000:3.0:1788843764.512777:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5af0cf-62ad-40c0-947c-f942bbf55123+6:15064:x1875738116614656:12345-192.168.203.33@tcp:101:mkdir.0 00010000:00010000:3.0:1788843764.512812:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843764.512845:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71600/0xa762dfcbd58d26b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490d72 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843764.512927:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71000/0xa762dfcbd58d26b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843764.512943:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71000/0xa762dfcbd58d26b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843764.512956:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71000/0xa762dfcbd58d26b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843764.513011:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788843764.513032:0:17151:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788843764.513060:0:17151:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71000/0xa762dfcbd58d26b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843764.513104:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71600/0xa762dfcbd58d26b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d72 expref: 8 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843764.513127:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71000/0xa762dfcbd58d26b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d72 expref: 7 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843764.513138:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd133390a00) 00010000:00010000:3.0:1788843764.513215:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788843764.513219:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd118f71000, rc 0) 00000100:00100000:3.0:1788843764.513288:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5af0cf-62ad-40c0-947c-f942bbf55123+7:15064:x1875738116614656:12345-192.168.203.33@tcp:101:mkdir.0 Request processed in 513us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843764.513296:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 22 00000100:00100000:1.0:1788843764.634539:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788843764.634568:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134526208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788843764.634653:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843764.634735:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134526208 00000100:00100000:1.0:1788843764.634743:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134526208 00000100:00100000:1.0:1788843764.634811:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788843764.634944:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788843764.634965:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134526336:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788843764.634999:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843764.635040:0:18657:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1788843764.635050:0:18657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1788843764.635180:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134526208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788843764.635209:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788843764.635267:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134526208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 443us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843764.635274:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788843764.635291:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134526336 00000100:00100000:1.0:1788843764.635295:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134526336 00000100:00100000:1.0:1788843764.635312:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788843764.635317:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134526336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788843764.635325:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788843764.635351:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134526336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843764.635356:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788843764.635400:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134526336:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788843764.635478:0:3632:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1788843764.635496:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134526208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843764.636168:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134526464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843764.636209:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843764.636297:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134526464 00000100:00100000:1.0:1788843764.636303:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134526464 00000100:00100000:1.0:1788843764.636346:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788843764.636354:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134526464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788843764.636367:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788843764.636412:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134526464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843764.636435:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788843764.636516:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134526464:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788843764.636673:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788843764.636678:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788843764.637210:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134526976:0@lo:400:kworker.0 00000100:00100000:3.0:1788843764.637265:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843764.637298:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd12036b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1875738134527488:0@lo:400:kworker.0 00000100:00100000:3.0:1788843764.637324:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843764.637344:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788843764.637350:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1875738134526848:0@lo:400:kworker.0 00000100:00100000:3.0:1788843764.637373:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843764.637391:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd12036a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1875738134527360:0@lo:400:kworker.0 00000100:00100000:3.0:1788843764.637412:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843764.637439:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20b96c6c-8494-483a-b913-89dfc06b1440:3632:1875738134526592:0@lo:400:kworker.0 00000100:00100000:3.0:1788843764.637485:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843764.637510:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd12036aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134527104:0@lo:400:kworker.0 00000100:00100000:3.0:1788843764.637536:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843764.637553:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd12036bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1875738134527616:0@lo:400:kworker.0 00000100:00100000:3.0:1788843764.637573:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843764.637585:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788843764.637590:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134526720:0@lo:400:kworker.0 00000100:00100000:3.0:1788843764.637612:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843764.637629:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134527232:0@lo:400:kworker.0 00000100:00100000:3.0:1788843764.637654:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843764.637665:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd12036b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1875738134527744:0@lo:400:kworker.0 00000100:00100000:3.0:1788843764.637693:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843764.637727:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134526976 00000100:00100000:3.0:1788843764.637734:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134526976 00000100:00100000:3.0:1788843764.637768:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134526720 00000100:00100000:3.0:1788843764.637771:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134526720 00000100:00100000:3.0:1788843764.637813:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788843764.638053:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134526976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843764.638126:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134526976:12345-0@lo:400:kworker.0 Request processed in 305us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843764.638134:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788843764.638178:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788843764.638186:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd008627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134526720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843764.638221:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd008627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134526720:12345-0@lo:400:kworker.0 Request processed in 37us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843764.638227:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788843764.638262:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134526976:0@lo:400:kworker.0 00000100:00100000:3.0:1788843764.638286:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134527488 00000100:00100000:3.0:1788843764.638290:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134527488 00000100:00100000:3.0:1788843764.638321:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134526848 00000100:00100000:3.0:1788843764.638324:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134526848 00000100:00100000:3.0:1788843764.638333:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134527360 00000100:00100000:3.0:1788843764.638336:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134527360 00000100:00100000:3.0:1788843764.638347:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134527616 00000100:00100000:3.0:1788843764.638350:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134527616 00000100:00100000:3.0:1788843764.638363:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134527232 00000100:00100000:3.0:1788843764.638366:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134527232 00000100:00100000:3.0:1788843764.638376:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134527744 00000100:00100000:3.0:1788843764.638380:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134527744 00000100:00100000:3.0:1788843764.638393:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788843764.638400:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1875738134527488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843764.638437:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1875738134527488:12345-0@lo:400:kworker.0 Request processed in 37us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843764.638444:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788843764.638529:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788843764.638534:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1875738134526848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843764.638564:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1875738134526848:12345-0@lo:400:kworker.0 Request processed in 30us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843764.638569:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788843764.638581:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788843764.638587:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1875738134527360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843764.638612:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1875738134527360:12345-0@lo:400:kworker.0 Request processed in 27us (1200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843764.638618:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788843764.638628:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788843764.638634:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1875738134527616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843764.638662:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1875738134527616:12345-0@lo:400:kworker.0 Request processed in 29us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843764.638668:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788843764.638677:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788843764.638682:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134527232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843764.638859:0:17150:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788843764.638869:0:17150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788843764.638885:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134526592 00000100:00100000:0.0:1788843764.638889:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134526592 00000100:00100000:0.0:1788843764.638915:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788843764.638922:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+24:3632:x1875738134526592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843764.638957:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+24:3632:x1875738134526592:12345-0@lo:400:kworker.0 Request processed in 36us (1471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843764.638962:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788843764.639128:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1875738134526848:0@lo:400:kworker.0 00000100:00100000:0.0:1788843764.639156:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd12036a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1875738134527360:0@lo:400:kworker.0 00010000:00080000:0.0:1788843764.639172:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd12036b800 x1875738134527488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843764.639183:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd12036b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1875738134527488:0@lo:400:kworker.0 00000100:00080000:0.0:1788843764.639208:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788843764.639212:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788843764.639230:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134526720:0@lo:400:kworker.0 00000100:00100000:0.0:1788843764.639243:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134527232:0@lo:400:kworker.0 00000100:00100000:0.0:1788843764.639251:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141ae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20b96c6c-8494-483a-b913-89dfc06b1440:3632:1875738134526592:0@lo:400:kworker.0 00000100:00100000:0.0:1788843764.639262:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd12036bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1875738134527616:0@lo:400:kworker.0 00000100:00100000:0.0:1788843764.639298:0:17149:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788843764.639307:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788843764.639314:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1875738134527744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843764.639352:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1875738134527744:12345-0@lo:400:kworker.0 Request processed in 39us (1659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843764.639359:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1788843764.639387:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd12036b480 x1875738134527744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843764.639398:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd12036b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1875738134527744:0@lo:400:kworker.0 00000100:00100000:0.0:1788843764.639431:0:19631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134527104 00000100:00100000:0.0:1788843764.639435:0:19631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134527104 00000100:00100000:0.0:1788843764.639475:0:19631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788843764.639482:0:19631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134527104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843764.639519:0:19631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134527104:12345-0@lo:400:kworker.0 Request processed in 38us (1983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843764.639525:0:19631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788843764.639554:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd12036aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134527104:0@lo:400:kworker.0 00000100:00100000:3.0:1788843764.640559:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134527232:12345-0@lo:400:kworker.0 Request processed in 25us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843764.640573:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00010000:2.0:1788843765.084881:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843766.106335:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788843766.692024:0:17882:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of cd5af0cf-62ad-40c0-947c-f942bbf55123 00000001:00100000:1.0:1788843766.692044:0:17882:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0 00000001:00100000:2.0:1788843766.694209:0:17130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cd5af0cf-62ad-40c0-947c-f942bbf55123 00000001:00100000:2.0:1788843766.694229:0:17130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0 00010000:00010000:3.0:1788843767.133571:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788843767.524016:0:20029:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1788843767.714991:0:19469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cd5af0cf-62ad-40c0-947c-f942bbf55123 00000001:00100000:1.0:1788843767.715008:0:19469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0 00000001:00100000:1.0:1788843767.716839:0:18651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cd5af0cf-62ad-40c0-947c-f942bbf55123 00000001:00100000:1.0:1788843767.716855:0:18651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0 00010000:00010000:2.0:1788843768.154460:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843768.218456:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788843768.218490:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134527872:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788843768.218595:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843768.218962:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134527872 00000100:00100000:3.0:1788843768.218970:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134527872 00000100:00100000:3.0:1788843768.219033:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788843768.219053:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134527872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788843768.219095:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788843768.219193:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134527872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 150us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843768.219201:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788843768.219375:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843768.219391:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134528000:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788843768.219437:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843768.219631:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134528000 00000100:00100000:3.0:1788843768.219636:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134528000 00000100:00100000:3.0:1788843768.219690:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788843768.219697:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134528000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788843768.219720:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788843768.219757:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134528000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843768.219763:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788843768.219829:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788843768.219870:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134528000:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788843768.220028:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134527872:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788843768.733172:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134528128:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788843768.733276:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843768.733436:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134528128 00000100:00100000:2.0:1788843768.733446:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134528128 00000100:00100000:2.0:1788843768.733511:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788843768.733522:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134528128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788843768.733564:0:17890:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788843768.733631:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134528128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843768.733638:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788843768.733729:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134528128:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788843769.182017:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843769.754317:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788843769.754347:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134528256:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788843769.754433:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843769.754971:0:19943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134528256 00000100:00100000:0.0:1788843769.754981:0:19943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134528256 00000100:00100000:0.0:1788843769.755057:0:19943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788843769.755069:0:19943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f986300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134528256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788843769.755105:0:19943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788843769.755219:0:19943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f986300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134528256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 152us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843769.755227:0:19943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788843769.755269:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788843769.755314:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134528256:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788843769.756667:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20b96c6c-8494-483a-b913-89dfc06b1440:3630:1875738134528384:0@lo:400:kworker.0 00000100:00100000:1.0:1788843769.756749:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843769.756785:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134528896:0@lo:400:kworker.0 00000100:00100000:0.0:1788843769.756977:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134528640:0@lo:400:kworker.0 00000100:00100000:0.0:1788843769.757013:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843769.757050:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134529152:0@lo:400:kworker.0 00000100:00100000:0.0:1788843769.757073:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843769.757090:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1875738134529664:0@lo:400:kworker.0 00000100:00100000:0.0:1788843769.757120:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843769.757173:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788843769.757179:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134528768:0@lo:400:kworker.0 00000100:00100000:2.0:1788843769.757394:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134528384 00000100:00100000:2.0:1788843769.757403:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134528384 00000100:00100000:2.0:1788843769.757455:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788843769.757465:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+24:3630:x1875738134528384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843769.757715:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843769.757760:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134529408:0@lo:400:kworker.0 00000100:00100000:1.0:1788843769.757785:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843769.757822:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788843769.757828:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134528512:0@lo:400:kworker.0 00000100:00100000:1.0:1788843769.757853:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843769.757873:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134529024:0@lo:400:kworker.0 00000100:00100000:1.0:1788843769.757894:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843769.757913:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134529536:0@lo:400:kworker.0 00000100:00100000:1.0:1788843769.757933:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843769.758013:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134528512 00000100:00100000:1.0:1788843769.758017:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134528512 00000100:00100000:1.0:1788843769.758059:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134529024 00000100:00100000:1.0:1788843769.758062:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134529024 00000100:00100000:1.0:1788843769.758076:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788843769.758082:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00799b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134528512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843769.758120:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00799b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134528512:12345-0@lo:400:kworker.0 Request processed in 38us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843769.758127:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788843769.758171:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788843769.758178:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134529024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843769.758221:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134529024:12345-0@lo:400:kworker.0 Request processed in 43us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843769.758227:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788843769.758249:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134529664 00000100:00100000:1.0:1788843769.758253:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134529664 00000100:00100000:1.0:1788843769.758284:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134528896 00000100:00100000:1.0:1788843769.758287:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134528896 00000100:00100000:1.0:1788843769.758308:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134529408 00000100:00100000:1.0:1788843769.758311:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134529408 00000100:00100000:1.0:1788843769.758322:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134529536 00000100:00100000:1.0:1788843769.758324:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134529536 00000100:00100000:1.0:1788843769.758339:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788843769.758345:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12036bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1875738134529664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843769.758377:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12036bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1875738134529664:12345-0@lo:400:kworker.0 Request processed in 32us (1262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843769.758384:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788843769.758395:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788843769.758400:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00799a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134528896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843769.758425:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00799a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875738134528896:12345-0@lo:400:kworker.0 Request processed in 26us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843769.758432:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788843769.758441:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788843769.758447:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00799aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134529408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843769.758470:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00799aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875738134529408:12345-0@lo:400:kworker.0 Request processed in 24us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843769.758476:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788843769.758486:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788843769.758492:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00799b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134529536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843769.758515:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00799b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134529536:12345-0@lo:400:kworker.0 Request processed in 24us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843769.758522:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788843769.758544:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134530048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788843769.758574:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843769.758605:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788843769.758611:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134529920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843769.758632:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843769.758657:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134530048 00000100:00100000:1.0:1788843769.758660:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134530048 00000100:00100000:1.0:1788843769.758687:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134529920 00000100:00100000:1.0:1788843769.758690:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134529920 00000100:00100000:1.0:1788843769.758703:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788843769.758710:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134530048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788843769.758727:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788843769.758763:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134530048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843769.758769:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788843769.758779:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788843769.758785:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134529920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788843769.758796:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788843769.758821:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134529920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843769.758827:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788843769.758870:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134529920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843769.758884:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134530048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788843769.758919:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134528512:0@lo:400:kworker.0 00000100:00100000:1.0:1788843769.758930:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134529024:0@lo:400:kworker.0 00010000:00080000:1.0:1788843769.758943:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00776ad80 x1875738134529536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843769.758967:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134529536:0@lo:400:kworker.0 00000100:00100000:1.0:1788843769.758981:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875738134528896:0@lo:400:kworker.0 00000100:00100000:1.0:1788843769.758993:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1875738134529408:0@lo:400:kworker.0 00000100:00100000:1.0:1788843769.759785:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134528640 00000100:00100000:1.0:1788843769.759806:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134528640 00000100:00100000:1.0:1788843769.759852:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134529152 00000100:00100000:1.0:1788843769.759856:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134529152 00000100:00100000:1.0:1788843769.759882:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788843769.759891:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12036aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134528640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843769.759958:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12036aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134528640:12345-0@lo:400:kworker.0 Request processed in 68us (2944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843769.759966:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788843769.759978:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788843769.759985:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12036b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134529152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843769.760013:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12036b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134529152:12345-0@lo:400:kworker.0 Request processed in 29us (2939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843769.760018:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788843769.763297:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+24:3630:x1875738134528384:12345-0@lo:400:kworker.0 Request processed in 5819us (6535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843769.763316:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788843769.763388:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20b96c6c-8494-483a-b913-89dfc06b1440:3630:1875738134528384:0@lo:400:kworker.0 00000100:00080000:3.0:1788843769.764324:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788843769.764335:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788843769.764340:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788843769.764343:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843769.766678:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843769.766750:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134529280:0@lo:400:kworker.0 00000100:00100000:0.0:1788843769.766789:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843769.766919:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00776b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1875738134529792:0@lo:400:kworker.0 00000100:00100000:0.0:1788843769.766944:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843769.766985:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134528768 00000100:00100000:1.0:1788843769.766994:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134528768 00000100:00100000:1.0:1788843769.767064:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788843769.767075:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134528768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843769.767133:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134528768:12345-0@lo:400:kworker.0 Request processed in 61us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843769.767162:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788843769.770133:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134528640:0@lo:400:kworker.0 00000100:00100000:0.0:1788843769.770174:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134529152:0@lo:400:kworker.0 00000100:00100000:0.0:1788843769.770205:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3632:1875738134529664:0@lo:400:kworker.0 00000100:00100000:0.0:1788843769.770243:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134528768:0@lo:400:kworker.0 00000100:00100000:3.0:1788843769.774703:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134529280 00000100:00100000:3.0:1788843769.774722:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134529280 00000100:00100000:3.0:1788843769.774796:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134529792 00000100:00100000:3.0:1788843769.774808:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134529792 00000100:00100000:3.0:1788843769.774845:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788843769.774856:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12036b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134529280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843769.774971:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12036b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134529280:12345-0@lo:400:kworker.0 Request processed in 117us (8180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843769.774979:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788843769.774999:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788843769.775006:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12036a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1875738134529792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843769.775047:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12036a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1875738134529792:12345-0@lo:400:kworker.0 Request processed in 43us (8102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843769.775066:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1788843769.775089:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788843769.775485:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134529280:0@lo:400:kworker.0 00010000:00080000:0.0:1788843769.775504:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd00776b100 x1875738134529792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843769.775515:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00776b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1875738134529792:0@lo:400:kworker.0 00000100:00100000:2.0:1788843769.779615:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843769.779693:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116614784 00000100:00100000:1.0:1788843769.779713:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116614784 00000100:00100000:1.0:1788843769.779775:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 148 00000100:00100000:1.0:1788843769.779786:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f839db8-0699-423e-a998-0395c59fee9e+13:2390:x1875738116614784:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843769.779993:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f839db8-0699-423e-a998-0395c59fee9e+13:2390:x1875738116614784:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 207us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843769.780003:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 148 00000100:00100000:3.0:1788843769.781174:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843769.781414:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843769.781445:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843769.782006:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116615168 00000100:00100000:2.0:1788843769.782018:0:18655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116615168 00000100:00100000:2.0:1788843769.782104:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 10 00000100:00100000:2.0:1788843769.782114:0:18655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:2389:x1875738116615168:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843769.782229:0:18655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:2389:x1875738116615168:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 116us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843769.782237:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 10 00000100:00080000:2.0:1788843769.784534:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843769.785481:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843769.785523:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843769.785642:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116615680 00000100:00100000:0.0:1788843769.785651:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116615680 00000100:00100000:0.0:1788843769.785730:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 11 00000100:00100000:0.0:1788843769.785742:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd5af0cf-62ad-40c0-947c-f942bbf55123+5:2389:x1875738116615680:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1788843769.785834:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd5af0cf-62ad-40c0-947c-f942bbf55123+5:2389:x1875738116615680:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 95us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843769.785843:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 11 00000100:00080000:0.0:1788843769.785868:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788843769.787924:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116614912 00000100:00100000:1.0:1788843769.787947:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116614912 00000100:00100000:1.0:1788843769.788121:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116615424 00000100:00100000:1.0:1788843769.788126:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116615424 00000100:00100000:3.0:1788843769.788411:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843769.788436:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843769.788494:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843769.788963:0:19631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116615296 00000100:00100000:3.0:1788843769.788971:0:19631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116615296 00000100:00100000:2.0:1788843769.789051:0:19944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116615040 00000100:00100000:2.0:1788843769.789056:0:19944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116615040 00000100:00080000:0.0:1788843769.789115:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788843769.789121:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788843769.789123:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843769.789369:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116615552 00000100:00100000:1.0:1788843769.789374:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116615552 00000100:00100000:1.0:1788843769.789399:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 53 00000100:00100000:1.0:1788843769.789408:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+6:2390:x1875738116614912:12345-192.168.203.33@tcp:400:kworker.0 00000100:00080000:0.0:1788843769.789610:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788843769.789725:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+6:2390:x1875738116614912:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 316us (8592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843769.789734:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 53 00000100:00100000:1.0:1788843769.789758:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 54 00000100:00100000:1.0:1788843769.789766:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5af0cf-62ad-40c0-947c-f942bbf55123+6:2389:x1875738116615424:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843769.789943:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5af0cf-62ad-40c0-947c-f942bbf55123+6:2389:x1875738116615424:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 177us (8496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843769.789951:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 54 00000100:00100000:1.0:1788843769.789965:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 55 00000100:00100000:1.0:1788843769.789972:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5af0cf-62ad-40c0-947c-f942bbf55123+5:2389:x1875738116615552:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843769.789997:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5af0cf-62ad-40c0-947c-f942bbf55123+5:2389:x1875738116615552:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 26us (1560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843769.790011:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 55 00000100:00100000:3.0:1788843769.790163:0:19631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116615808 00000100:00100000:3.0:1788843769.790169:0:19631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116615808 00000100:00100000:3.0:1788843769.790330:0:19631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 12 00000100:00100000:3.0:1788843769.790339:0:19631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:2389:x1875738116615296:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843769.790370:0:19631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:2389:x1875738116615296:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 33us (1966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843769.790377:0:19631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 12 00000100:00100000:3.0:1788843769.790391:0:19631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 13 00000100:00100000:3.0:1788843769.790399:0:19631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd5af0cf-62ad-40c0-947c-f942bbf55123+5:2389:x1875738116615808:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843769.790423:0:19631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cd5af0cf-62ad-40c0-947c-f942bbf55123+5:2389:x1875738116615808:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 25us (1930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843769.790430:0:19631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 13 00000100:00080000:1.0:1788843769.790606:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788843769.790905:0:19944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 56 00000100:00100000:2.0:1788843769.790915:0:19944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:2389:x1875738116615040:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843769.790949:0:19944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:2389:x1875738116615040:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 37us (5426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843769.790956:0:19944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 56 00010000:00010000:3.0:1788843770.206205:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788843770.652561:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788843771.226445:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788843771.343938:0:20177:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd78997d20 20000000:00000080:2.0:1788843771.343957:0:20177:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bd127b52800 uarg=0000000000000000 20000000:01000000:2.0:1788843771.344000:0:20177:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788843771.344006:0:20177:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788843771.344011:0:20177:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788843771.354119:0:20178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1788843771.354300:0:20177:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788843771.367273:0:20177:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788843771.367534:0:20177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d26be lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843771.367556:0:20177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd10fa3c200/0xa762dfcbd58d2353 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d234c expref: 23 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843771.367565:0:20177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd13fbeac00/0xa762dfcbd58d2361 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d235a expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843771.367571:0:20177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd10fa3ca00/0xa762dfcbd58d23a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2399 expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843771.367579:0:20177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d243a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d2433 expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843771.367588:0:20177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd118f70400/0xa762dfcbd58d264e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490cd1 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843771.367606:0:20177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd100030c00/0xa762dfcbd58d268d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d41 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843771.367614:0:20177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d26be lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843771.367873:0:20177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd100030c00/0xa762dfcbd58d268d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d41 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843771.367909:0:20177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd100030c00/0xa762dfcbd58d268d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d41 expref: 12 pid: 17145 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843771.367925:0:20177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007998380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1875738134530176:192.168.203.33@tcp:104: 00010000:00010000:1.0:1788843771.368040:0:20177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd118f70400/0xa762dfcbd58d264e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490cd1 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843771.368049:0:20177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd118f70400/0xa762dfcbd58d264e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490cd1 expref: 12 pid: 17145 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843771.368057:0:20177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007998700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1875738134530304:192.168.203.33@tcp:104: 00010000:00010000:1.0:1788843771.368087:0:20177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d243a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d2433 expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843771.368095:0:20177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d243a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d2433 expref: 23 pid: 17145 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843771.368104:0:20177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007999500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1875738134530432:0@lo:104: 00000100:00100000:1.0:1788843771.368174:0:20177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788843771.368219:0:20177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd10fa3ca00/0xa762dfcbd58d23a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d2399 expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843771.368228:0:20177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd10fa3ca00/0xa762dfcbd58d23a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d2399 expref: 23 pid: 17144 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843771.368237:0:20177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1875738134530560:0@lo:104: 00000100:00100000:1.0:1788843771.368260:0:20177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788843771.368292:0:20177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd13fbeac00/0xa762dfcbd58d2361 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d235a expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843771.368301:0:20177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd13fbeac00/0xa762dfcbd58d2361 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d235a expref: 23 pid: 17145 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843771.368309:0:20177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007998a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1875738134530688:0@lo:104: 00000100:00100000:1.0:1788843771.368343:0:20177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788843771.368362:0:20177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd10fa3c200/0xa762dfcbd58d2353 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa762dfcbd58d234c expref: 23 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843771.368371:0:20177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd10fa3c200/0xa762dfcbd58d2353 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa762dfcbd58d234c expref: 23 pid: 17142 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843771.368379:0:20177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00799b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1875738134530816:0@lo:104: 00000100:00100000:1.0:1788843771.368399:0:20177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843771.368410:0:20177:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1208319c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843771.368633:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134530432 00000100:00100000:2.0:1788843771.368654:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134530432 00000100:00100000:2.0:1788843771.368725:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134530560 00000100:00100000:2.0:1788843771.368728:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134530560 00000100:00100000:2.0:1788843771.368740:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134530688 00000100:00100000:2.0:1788843771.368742:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134530688 00000100:00100000:2.0:1788843771.368750:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134530816 00000100:00100000:2.0:1788843771.368752:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134530816 00000100:00100000:2.0:1788843771.368765:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788843771.368773:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00799bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20b96c6c-8494-483a-b913-89dfc06b1440+6:20177:x1875738134530432:12345-0@lo:104: 00010000:00010000:2.0:1788843771.368785:0:17134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd007be2400/0xa762dfcbd58d2433 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d243a expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.368842:0:17134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788843771.368848:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00799bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20b96c6c-8494-483a-b913-89dfc06b1440+6:20177:x1875738134530432:12345-0@lo:104: Request processed in 76us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843771.368865:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788843771.368884:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788843771.368889:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00799a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20b96c6c-8494-483a-b913-89dfc06b1440+5:20177:x1875738134530560:12345-0@lo:104: 00010000:00010000:2.0:1788843771.368898:0:17134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd007946800/0xa762dfcbd58d2399 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d23a0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.368934:0:17134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788843771.368939:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00799a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20b96c6c-8494-483a-b913-89dfc06b1440+5:20177:x1875738134530560:12345-0@lo:104: Request processed in 50us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843771.368945:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788843771.368958:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788843771.368964:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007999c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20b96c6c-8494-483a-b913-89dfc06b1440+4:20177:x1875738134530688:12345-0@lo:104: 00010000:00010000:2.0:1788843771.368972:0:17134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd007946000/0xa762dfcbd58d235a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d2361 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.369002:0:17134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788843771.369007:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007999c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20b96c6c-8494-483a-b913-89dfc06b1440+4:20177:x1875738134530688:12345-0@lo:104: Request processed in 44us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843771.369012:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788843771.369034:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788843771.369040:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007999f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20b96c6c-8494-483a-b913-89dfc06b1440+3:20177:x1875738134530816:12345-0@lo:104: 00010000:00010000:2.0:1788843771.369047:0:17134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.133@tcp lock: ffff9bd007be2e00/0xa762dfcbd58d234c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d2353 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.369072:0:17134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788843771.369076:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007999f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:20b96c6c-8494-483a-b913-89dfc06b1440+3:20177:x1875738134530816:12345-0@lo:104: Request processed in 38us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843771.369087:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788843771.369109:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788843771.369115:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd007be2400/0xa762dfcbd58d2433 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d243a expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.369123:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be2400 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:2.0:1788843771.369127:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd007be2400/0xa762dfcbd58d2433 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d243a expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.369136:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd007be2400/0xa762dfcbd58d2433 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d243a expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843771.369164:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd007be2400/0xa762dfcbd58d2433 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d243a expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843771.369171:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788843771.369203:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd007be2400/0xa762dfcbd58d2433 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d243a expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.369210:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788843771.369232:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd007be2400/0xa762dfcbd58d2433 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d243a expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.369240:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd007be2400/0xa762dfcbd58d2433 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d243a expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.369251:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788843771.369254:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd007946800/0xa762dfcbd58d2399 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d23a0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.369270:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946800 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:2.0:1788843771.369273:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd007946800/0xa762dfcbd58d2399 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d23a0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.369279:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd007946800/0xa762dfcbd58d2399 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d23a0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843771.369285:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd007946800/0xa762dfcbd58d2399 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d23a0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843771.369290:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788843771.369304:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd007946800/0xa762dfcbd58d2399 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d23a0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.369310:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788843771.369316:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd007946800/0xa762dfcbd58d2399 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d23a0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.369322:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd007946800/0xa762dfcbd58d2399 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d23a0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.369330:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788843771.369333:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd007946000/0xa762dfcbd58d235a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d2361 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.369339:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946000 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:2.0:1788843771.369342:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd007946000/0xa762dfcbd58d235a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d2361 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.369358:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd007946000/0xa762dfcbd58d235a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d2361 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843771.369365:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd007946000/0xa762dfcbd58d235a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d2361 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843771.369370:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788843771.369383:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd007946000/0xa762dfcbd58d235a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2361 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.369389:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788843771.369404:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd007946000/0xa762dfcbd58d235a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2361 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.369410:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd007946000/0xa762dfcbd58d235a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2361 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.369419:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843771.369422:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.133@tcp lock: ffff9bd007be2e00/0xa762dfcbd58d234c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa762dfcbd58d2353 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.369427:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007be2e00 already unused, calling callback (ffffffffc12a7c20) 10000000:00010000:2.0:1788843771.369429:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.133@tcp lock: ffff9bd007be2e00/0xa762dfcbd58d234c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa762dfcbd58d2353 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.369435:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.133@tcp lock: ffff9bd007be2e00/0xa762dfcbd58d234c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa762dfcbd58d2353 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843771.369442:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.133@tcp lock: ffff9bd007be2e00/0xa762dfcbd58d234c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa762dfcbd58d2353 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843771.369452:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788843771.369466:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.133@tcp lock: ffff9bd007be2e00/0xa762dfcbd58d234c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2353 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.369471:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788843771.369478:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.133@tcp lock: ffff9bd007be2e00/0xa762dfcbd58d234c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2353 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.369484:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.133@tcp lock: ffff9bd007be2e00/0xa762dfcbd58d234c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa762dfcbd58d2353 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.369496:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843771.369497:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843771.369499:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843771.369505:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843771.369517:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20b96c6c-8494-483a-b913-89dfc06b1440:3632:1875738134530944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843771.369551:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843771.369584:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788843771.369590:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20b96c6c-8494-483a-b913-89dfc06b1440:3632:1875738134531072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843771.369612:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843771.369638:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20b96c6c-8494-483a-b913-89dfc06b1440:3630:1875738134531200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843771.369660:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843771.369677:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788843771.369682:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20b96c6c-8494-483a-b913-89dfc06b1440:3630:1875738134531328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843771.369700:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843771.369721:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134530944 00000100:00100000:2.0:1788843771.369725:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134530944 00010000:00010000:2.0:1788843771.369752:0:17136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d243a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2433 expref: 24 pid: 17145 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843771.369768:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134531072 00000100:00100000:2.0:1788843771.369771:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134531072 00010000:00010000:2.0:1788843771.369780:0:17136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd10fa3ca00/0xa762dfcbd58d23a0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2399 expref: 25 pid: 17144 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843771.369790:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134531200 00000100:00100000:2.0:1788843771.369792:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134531200 00010000:00010000:2.0:1788843771.369801:0:17136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd13fbeac00/0xa762dfcbd58d2361 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d235a expref: 26 pid: 17145 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843771.369810:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134531328 00000100:00100000:2.0:1788843771.369812:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134531328 00010000:00010000:2.0:1788843771.369820:0:17136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd10fa3c200/0xa762dfcbd58d2353 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d234c expref: 27 pid: 17142 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843771.369832:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788843771.369838:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20b96c6c-8494-483a-b913-89dfc06b1440+27:3632:x1875738134530944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788843771.369848:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843771.369854:0:17136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d243a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2433 expref: 27 pid: 17145 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.369863:0:17136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d243a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d2433 expref: 27 pid: 17145 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.369880:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843771.369909:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20b96c6c-8494-483a-b913-89dfc06b1440+27:3632:x1875738134530944:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843771.369915:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788843771.369936:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788843771.369942:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20b96c6c-8494-483a-b913-89dfc06b1440+26:3632:x1875738134531072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788843771.371803:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843771.371821:0:17136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd10fa3ca00/0xa762dfcbd58d23a0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d2399 expref: 26 pid: 17144 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.371839:0:17136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd10fa3ca00/0xa762dfcbd58d23a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d2399 expref: 26 pid: 17144 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.371862:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843771.371924:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20b96c6c-8494-483a-b913-89dfc06b1440+26:3632:x1875738134531072:12345-0@lo:103:ldlm_bl.0 Request processed in 1981us (2310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843771.371934:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788843771.371968:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788843771.371980:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20b96c6c-8494-483a-b913-89dfc06b1440+25:3630:x1875738134531200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788843771.371993:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843771.371998:0:17136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd13fbeac00/0xa762dfcbd58d2361 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d235a expref: 25 pid: 17145 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.372006:0:17136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd13fbeac00/0xa762dfcbd58d2361 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d235a expref: 25 pid: 17145 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.372016:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843771.372065:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20b96c6c-8494-483a-b913-89dfc06b1440+25:3630:x1875738134531200:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (2405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843771.372072:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788843771.372084:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788843771.372090:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20b96c6c-8494-483a-b913-89dfc06b1440+24:3630:x1875738134531328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788843771.372111:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843771.372116:0:17136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd10fa3c200/0xa762dfcbd58d2353 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa762dfcbd58d234c expref: 24 pid: 17142 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.372125:0:17136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd10fa3c200/0xa762dfcbd58d2353 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa762dfcbd58d234c expref: 24 pid: 17142 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.372134:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843771.372174:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20b96c6c-8494-483a-b913-89dfc06b1440+24:3630:x1875738134531328:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (2471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843771.372180:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788843771.372239:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20b96c6c-8494-483a-b913-89dfc06b1440:3630:1875738134531328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843771.372249:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20b96c6c-8494-483a-b913-89dfc06b1440:3630:1875738134531200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843771.372282:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20b96c6c-8494-483a-b913-89dfc06b1440:3632:1875738134531072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843771.372290:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20b96c6c-8494-483a-b913-89dfc06b1440:3632:1875738134530944:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788843771.372561:0:20177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd007947400/0xa762dfcbd58d243a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d2433 expref: 23 pid: 17145 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843771.372574:0:20177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007999500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1875738134530432:0@lo:104: 00010000:00010000:1.0:1788843771.372584:0:20177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd10fa3ca00/0xa762dfcbd58d23a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d2399 expref: 22 pid: 17144 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843771.372807:0:20177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1875738134530560:0@lo:104: 00010000:00010000:1.0:1788843771.372822:0:20177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd13fbeac00/0xa762dfcbd58d2361 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d235a expref: 21 pid: 17145 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843771.372831:0:20177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007998a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1875738134530688:0@lo:104: 00010000:00010000:1.0:1788843771.372841:0:20177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd10fa3c200/0xa762dfcbd58d2353 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa762dfcbd58d234c expref: 20 pid: 17142 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843771.372859:0:20177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00799b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1875738134530816:0@lo:104: 00010000:00010000:0.0:1788843771.373986:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843771.376181:0:20177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007998380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1875738134530176:192.168.203.33@tcp:104: 00000100:00100000:1.0:1788843771.376198:0:20177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007998700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20177:1875738134530304:192.168.203.33@tcp:104: 00010000:00010000:1.0:1788843771.376240:0:20177:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d26be lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843771.379981:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843771.380067:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116615936 00000100:00100000:2.0:1788843771.380078:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116615936 00010000:00010000:2.0:1788843771.380119:0:17136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd100030c00/0xa762dfcbd58d268d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d41 expref: 13 pid: 17145 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843771.380190:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 13 00000100:00100000:2.0:1788843771.380201:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0013a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f839db8-0699-423e-a998-0395c59fee9e+13:2390:x1875738116615936:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843771.380239:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843771.380245:0:17136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd100030c00/0xa762dfcbd58d268d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d41 expref: 13 pid: 17145 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.380267:0:17136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd100030c00/0xa762dfcbd58d268d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d41 expref: 13 pid: 17145 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.380288:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd100030c00/0xa762dfcbd58d268d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d41 expref: 13 pid: 17145 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.380305:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843771.380369:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0013a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f839db8-0699-423e-a998-0395c59fee9e+12:2390:x1875738116615936:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 171us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843771.380377:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 13 00000100:00100000:3.0:1788843771.386529:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843771.389397:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116616064 00000100:00100000:2.0:1788843771.389414:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116616064 00010000:00010000:2.0:1788843771.389473:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd118f70400/0xa762dfcbd58d264e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490cd1 expref: 12 pid: 17145 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843771.389517:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 14 00000100:00100000:2.0:1788843771.389528:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f839db8-0699-423e-a998-0395c59fee9e+12:2390:x1875738116616064:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843771.389545:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843771.389550:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd118f70400/0xa762dfcbd58d264e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490cd1 expref: 12 pid: 17145 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.389565:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd118f70400/0xa762dfcbd58d264e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490cd1 expref: 12 pid: 17145 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.389585:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd118f70400/0xa762dfcbd58d264e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490cd1 expref: 12 pid: 17145 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.389604:0:17135:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d26be lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.389628:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d26be lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.389646:0:17135:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d26be lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.389654:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d26be lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.389662:0:17135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d26be lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.389668:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d26be lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.389674:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1420e5200 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843771.389680:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d26be lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.389688:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d26be lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.389709:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d26be lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843771.389721:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843771.389792:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f839db8-0699-423e-a998-0395c59fee9e+11:2390:x1875738116616064:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 264us (3277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843771.389800:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 14 00010000:00010000:1.0:1788843771.389890:0:20177:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d26be lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843771.389900:0:20177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d26be lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843771.389905:0:20177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd1420e5200/0xa762dfcbd58d26be lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843772.254801:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843772.855895:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843772.856053:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116616192 00000100:00100000:1.0:1788843772.856066:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116616192 00000100:00100000:1.0:1788843772.856160:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 149 00000100:00100000:1.0:1788843772.856173:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f839db8-0699-423e-a998-0395c59fee9e+11:14912:x1875738116616192:12345-192.168.203.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843772.856203:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843772.856226:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1420e4200/0xa762dfcbd58d26c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490d79 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843772.856262:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1420e4200/0xa762dfcbd58d26c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d79 expref: 12 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843772.856275:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1420e4200/0xa762dfcbd58d26c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d79 expref: 12 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843772.856295:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1420e4200, rc 0) 00000100:00100000:1.0:1788843772.856363:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f839db8-0699-423e-a998-0395c59fee9e+12:14912:x1875738116616192:12345-192.168.203.33@tcp:101:ll_cfg_requeue.0 Request processed in 191us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843772.856372:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 149 00000100:00100000:0.0:1788843772.874508:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843772.874727:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116616320 00000100:00100000:3.0:1788843772.874750:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116616320 00000100:00100000:3.0:1788843772.874836:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 150 00000100:00100000:3.0:1788843772.874847:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f839db8-0699-423e-a998-0395c59fee9e+12:14912:x1875738116616320:12345-192.168.203.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843772.875030:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f839db8-0699-423e-a998-0395c59fee9e+12:14912:x1875738116616320:12345-192.168.203.33@tcp:501:ll_cfg_requeue.0 Request processed in 185us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843772.875040:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 150 00000100:00100000:1.0:1788843772.878210:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843772.878320:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116616448 00000100:00100000:0.0:1788843772.878332:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116616448 00000100:00100000:0.0:1788843772.878388:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 151 00000100:00100000:0.0:1788843772.878400:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007a0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f839db8-0699-423e-a998-0395c59fee9e+12:14912:x1875738116616448:12345-192.168.203.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843772.878563:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007a0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f839db8-0699-423e-a998-0395c59fee9e+12:14912:x1875738116616448:12345-192.168.203.33@tcp:503:ll_cfg_requeue.0 Request processed in 164us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843772.878571:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 151 00000100:00100000:2.0:1788843772.895447:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843772.898272:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116616576 00000100:00100000:1.0:1788843772.898289:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116616576 00000100:00100000:1.0:1788843772.898353:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 152 00000100:00100000:1.0:1788843772.898365:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd105a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f839db8-0699-423e-a998-0395c59fee9e+12:14912:x1875738116616576:12345-192.168.203.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843772.898384:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843772.898404:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1420e4800/0xa762dfcbd58d26cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490d80 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843772.898437:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1420e4800/0xa762dfcbd58d26cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d80 expref: 13 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843772.898449:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1420e4800/0xa762dfcbd58d26cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d80 expref: 13 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843772.898459:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1420e4800, rc 0) 00000100:00100000:1.0:1788843772.898524:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd105a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f839db8-0699-423e-a998-0395c59fee9e+13:14912:x1875738116616576:12345-192.168.203.33@tcp:101:ll_cfg_requeue.0 Request processed in 161us (3087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843772.898532:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 152 00000100:00100000:2.0:1788843772.909387:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843772.911783:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116616704 00000100:00100000:3.0:1788843772.911799:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116616704 00000100:00100000:3.0:1788843772.911877:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 153 00000100:00100000:3.0:1788843772.911888:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1037cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f839db8-0699-423e-a998-0395c59fee9e+13:14912:x1875738116616704:12345-192.168.203.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843772.912053:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1037cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f839db8-0699-423e-a998-0395c59fee9e+13:14912:x1875738116616704:12345-192.168.203.33@tcp:501:ll_cfg_requeue.0 Request processed in 165us (2679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843772.912062:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 153 00000100:00100000:2.0:1788843772.920919:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843772.921059:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116616832 00000100:00100000:0.0:1788843772.921078:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116616832 00000100:00100000:0.0:1788843772.921161:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 154 00000100:00100000:0.0:1788843772.921173:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd114f16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f839db8-0699-423e-a998-0395c59fee9e+13:14912:x1875738116616832:12345-192.168.203.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843772.921328:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd114f16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f839db8-0699-423e-a998-0395c59fee9e+13:14912:x1875738116616832:12345-192.168.203.33@tcp:503:ll_cfg_requeue.0 Request processed in 156us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843772.921336:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 154 10000000:01000000:3.0:1788843773.210331:0:17147:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788843773.210339:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd007392000 from 13 10000000:01000000:3.0:1788843773.210344:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788843773.210394:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd118f71c00/0xa762dfcbd58d26d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843773.210405:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd118f71c00/0xa762dfcbd58d26d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843773.210418:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd118f71c00/0xa762dfcbd58d26d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843773.210446:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134531456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788843773.210516:0:17147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843773.210566:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007bab300 going to sleep for 11 seconds 00000100:00100000:2.0:1788843773.210723:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134531456 00000100:00100000:2.0:1788843773.210731:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134531456 00000100:00100000:2.0:1788843773.210797:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788843773.210808:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd114f17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+20:17147:x1875738134531456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843773.210823:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843773.210837:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd100030c00/0xa762dfcbd58d26da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d26d3 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843773.210873:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd100030c00/0xa762dfcbd58d26da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d26d3 expref: 21 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843773.210885:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd100030c00/0xa762dfcbd58d26da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d26d3 expref: 21 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843773.210901:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd100030c00, rc 0) 00000100:00100000:2.0:1788843773.210944:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd114f17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+21:17147:x1875738134531456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843773.210950:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788843773.211346:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134531456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843773.211362:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd118f71c00/0xa762dfcbd58d26d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d26da expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843773.211373:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd118f71c00/0xa762dfcbd58d26d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d26da expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843773.211436:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134531584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843773.211467:0:17147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843773.211498:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007bab300 going to sleep for 11 seconds 00000100:00100000:2.0:1788843773.211616:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134531584 00000100:00100000:2.0:1788843773.211621:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134531584 00000100:00100000:2.0:1788843773.211655:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788843773.211663:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd114f16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+21:17147:x1875738134531584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843773.212025:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd114f16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+21:17147:x1875738134531584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 362us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843773.212033:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788843773.214267:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134531584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843773.214342:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120369c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134531712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843773.214427:0:17147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843773.214465:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0017e4240 going to sleep for 11 seconds 00000100:00100000:3.0:1788843773.214567:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134531712 00000100:00100000:3.0:1788843773.214574:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134531712 00000100:00100000:3.0:1788843773.214625:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788843773.214635:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+21:17147:x1875738134531712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788843773.214782:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+21:17147:x1875738134531712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843773.214790:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788843773.216519:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120369c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134531712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788843773.218447:0:20245:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788843773.218754:0:17147:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788843773.218777:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788843773.218790:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd118f71c00/0xa762dfcbd58d26d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d26da expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843773.218803:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd118f71c00/0xa762dfcbd58d26d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d26da expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843773.218815:0:17147:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788843773.218817:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd137ae8800 from 13 10000000:01000000:3.0:1788843773.218830:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788843773.218873:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd118f70600/0xa762dfcbd58d26e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843773.218881:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd118f70600/0xa762dfcbd58d26e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843773.218903:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd118f70600/0xa762dfcbd58d26e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843773.218931:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134531840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788843773.219003:0:17147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843773.219074:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd007bab300 going to sleep for 11 seconds 00000100:00100000:2.0:1788843773.219390:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134531840 00000100:00100000:2.0:1788843773.219408:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134531840 00000100:00100000:2.0:1788843773.219465:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788843773.219475:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+21:17147:x1875738134531840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843773.219488:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843773.219502:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd100031800/0xa762dfcbd58d26e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d26e1 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843773.219529:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd100031800/0xa762dfcbd58d26e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d26e1 expref: 22 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843773.219539:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd100031800/0xa762dfcbd58d26e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d26e1 expref: 22 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843773.219549:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd100031800, rc 0) 00000100:00100000:2.0:1788843773.219600:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+22:17147:x1875738134531840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843773.219606:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788843773.219812:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134531840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843773.219830:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd118f70600/0xa762dfcbd58d26e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d26e8 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843773.219840:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd118f70600/0xa762dfcbd58d26e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d26e8 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843773.220346:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120369c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134531968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843773.220389:0:17147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843773.220463:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0017e4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788843773.229694:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134531968 00000100:00100000:2.0:1788843773.229711:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134531968 00000100:00100000:3.0:1788843773.229853:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788843773.229876:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+22:17147:x1875738134531968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843773.230399:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+22:17147:x1875738134531968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 524us (10006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843773.230408:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788843773.231242:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120369c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134531968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843773.231314:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120369c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134532096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843773.231388:0:17147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843773.231488:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0017e4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788843773.237796:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134532096 00000100:00100000:3.0:1788843773.237813:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134532096 00000100:00100000:3.0:1788843773.238399:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788843773.238413:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+22:17147:x1875738134532096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788843773.238603:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20b96c6c-8494-483a-b913-89dfc06b1440+22:17147:x1875738134532096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 193us (7213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843773.238610:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788843773.238714:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120369c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134532096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788843773.242878:0:20246:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788843773.242952:0:17147:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788843773.242974:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788843773.242987:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd118f70600/0xa762dfcbd58d26e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d26e8 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843773.243000:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd118f70600/0xa762dfcbd58d26e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d26e8 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843773.243020:0:17147:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788843773.243023:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd10f7b9800 from 13 10000000:01000000:0.0:1788843773.243026:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788843773.244310:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d26ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843773.244326:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d26ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843773.244339:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d26ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843773.244370:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120369c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134532224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788843773.244448:0:17147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843773.252803:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0017e4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843773.252888:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134532224 00000100:00100000:2.0:1788843773.253001:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134532224 00000100:00100000:2.0:1788843773.253198:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788843773.253211:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+22:17147:x1875738134532224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843773.253229:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843773.253250:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd100031200/0xa762dfcbd58d26f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d26ef expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843773.253283:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd100031200/0xa762dfcbd58d26f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d26ef expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843773.253313:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd100031200/0xa762dfcbd58d26f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d26ef expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843773.253323:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd100031200, rc 0) 00000100:00100000:2.0:1788843773.253404:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+23:17147:x1875738134532224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (8955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843773.253411:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788843773.253540:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120369c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134532224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843773.253558:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d26ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d26f6 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843773.253576:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d26ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d26f6 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843773.253650:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120369c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134532352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843773.253698:0:17147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843773.253714:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0017e4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843773.253988:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134532352 00000100:00100000:2.0:1788843773.253992:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134532352 00000100:00100000:2.0:1788843773.254023:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788843773.254030:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+23:17147:x1875738134532352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843773.254338:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+23:17147:x1875738134532352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 307us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843773.254345:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788843773.255825:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120369c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134532352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843773.255913:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120369c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134532480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843773.255984:0:17147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843773.256042:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0017e4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843773.256270:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134532480 00000100:00100000:1.0:1788843773.256277:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134532480 00000100:00100000:1.0:1788843773.256331:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788843773.256352:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+23:17147:x1875738134532480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788843773.256465:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+23:17147:x1875738134532480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843773.256474:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788843773.256560:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120369c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134532480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788843773.263458:0:20247:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788843773.267971:0:17147:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788843773.268022:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788843773.268035:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d26ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d26f6 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843773.268047:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd10f7afc00/0xa762dfcbd58d26ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d26f6 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843773.268794:0:17147:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788843773.268797:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd137acd000 from 13 10000000:01000000:0.0:1788843773.268801:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788843773.268841:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af800/0xa762dfcbd58d26fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843773.268851:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af800/0xa762dfcbd58d26fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843773.268973:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af800/0xa762dfcbd58d26fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843773.268999:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120369c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134532608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788843773.269364:0:17147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843773.269437:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0017e4240 going to sleep for 11 seconds 00000100:00100000:1.0:1788843773.269524:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134532608 00000100:00100000:1.0:1788843773.269532:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134532608 00000100:00100000:1.0:1788843773.269607:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788843773.269616:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+23:17147:x1875738134532608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843773.269629:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843773.269644:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd1420e4400/0xa762dfcbd58d2704 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa762dfcbd58d26fd expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843773.269670:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd1420e4400/0xa762dfcbd58d2704 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa762dfcbd58d26fd expref: 24 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843773.269689:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd1420e4400/0xa762dfcbd58d2704 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa762dfcbd58d26fd expref: 24 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843773.269698:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1420e4400, rc 0) 00000100:00100000:1.0:1788843773.269770:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+24:17147:x1875738134532608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843773.269777:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788843773.269885:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120369c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134532608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843773.270022:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af800/0xa762dfcbd58d26fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2704 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843773.270033:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af800/0xa762dfcbd58d26fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa762dfcbd58d2704 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843773.271886:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134532736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843773.272121:0:17147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843773.272226:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd111590480 going to sleep for 11 seconds 00000100:00100000:1.0:1788843773.273548:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134532736 00000100:00100000:1.0:1788843773.273560:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134532736 00000100:00100000:1.0:1788843773.273621:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788843773.273631:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+24:17147:x1875738134532736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788843773.273789:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+24:17147:x1875738134532736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (1669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843773.273804:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788843773.274169:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134532736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843773.274227:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134532864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843773.274268:0:17147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843773.274298:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd111590480 going to sleep for 11 seconds 00000100:00100000:0.0:1788843773.274345:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134532864 00000100:00100000:0.0:1788843773.274350:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134532864 00000100:00100000:0.0:1788843773.274381:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788843773.274387:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+24:17147:x1875738134532864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843773.274464:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+24:17147:x1875738134532864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843773.274470:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788843773.274533:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:20b96c6c-8494-483a-b913-89dfc06b1440:17147:1875738134532864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788843773.275593:0:20249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00010000:00010000:1.0:1788843773.276661:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788843773.277254:0:17147:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788843773.277288:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788843773.277299:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af800/0xa762dfcbd58d26fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2704 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843773.277312:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.133@tcp lock: ffff9bd10f7af800/0xa762dfcbd58d26fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa762dfcbd58d2704 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843773.340576:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134532992:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788843773.340660:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843773.340733:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134532992 00000100:00100000:3.0:1788843773.340742:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134532992 00000100:00100000:3.0:1788843773.340813:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788843773.340823:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134532992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788843773.340853:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788843773.341112:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134532992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 288us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843773.341120:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788843773.341192:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134532992:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788843773.342657:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843773.342705:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788843773.342723:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134533120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788843773.342790:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843773.345082:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134533120 00000100:00100000:1.0:1788843773.345097:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134533120 00000100:00100000:1.0:1788843773.345172:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788843773.345183:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134533120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788843773.345220:0:17154:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788843773.345311:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134533120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (2520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843773.345318:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788843773.346273:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134533120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788843773.851589:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788843773.851616:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134533248:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788843773.851694:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843773.851876:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134533248 00000100:00100000:3.0:1788843773.851887:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134533248 00000100:00100000:3.0:1788843773.851948:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788843773.851959:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134533248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788843773.851992:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788843773.852060:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134533248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843773.852067:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788843773.852176:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134533248:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788843774.298487:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788843774.557882:0:17908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788843774.874747:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843774.874773:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134533376:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788843774.874858:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843774.874927:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134533376 00000100:00100000:1.0:1788843774.874936:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134533376 00000100:00100000:1.0:1788843774.875095:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788843774.875114:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134533376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788843774.875171:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788843774.875233:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134533376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 122us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843774.875241:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1788843774.875268:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788843774.875319:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134533376:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788843774.879292:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd12036a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20b96c6c-8494-483a-b913-89dfc06b1440:3632:1875738134533504:0@lo:400:kworker.0 00000100:00100000:3.0:1788843774.879379:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843774.879434:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788843774.879456:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134533632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843774.879486:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843774.879520:0:19943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134533632 00000100:00100000:3.0:1788843774.879527:0:19943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134533632 00000100:00100000:3.0:1788843774.879598:0:19943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788843774.879607:0:19943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134533632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788843774.879630:0:19943:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788843774.879686:0:19943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134533632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843774.879693:0:19943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788843774.879713:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788843774.879756:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134533632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843774.879799:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134533504 00000100:00100000:3.0:1788843774.879803:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134533504 00000100:00100000:3.0:1788843774.879831:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788843774.879838:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd11504c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+24:3632:x1875738134533504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843774.879875:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd11504c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20b96c6c-8494-483a-b913-89dfc06b1440+24:3632:x1875738134533504:12345-0@lo:400:kworker.0 Request processed in 37us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843774.879882:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788843774.879920:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134533888:0@lo:400:kworker.0 00000100:00100000:3.0:1788843774.879947:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843774.879968:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788843774.879991:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134533760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843774.880023:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843774.880061:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134533888 00000100:00100000:3.0:1788843774.880067:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd12036a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20b96c6c-8494-483a-b913-89dfc06b1440:3632:1875738134533504:0@lo:400:kworker.0 00000100:00100000:1.0:1788843774.880067:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134533888 00000100:00100000:3.0:1788843774.880114:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134533760 00000100:00100000:1.0:1788843774.880116:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788843774.880126:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134533888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843774.880127:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134533760 00000100:00100000:3.0:1788843774.880184:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788843774.880191:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134533760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788843774.880203:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788843774.880238:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134533760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843774.880244:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1788843774.880259:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843774.880279:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134533760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843774.881121:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134533888:12345-0@lo:400:kworker.0 Request processed in 995us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843774.881131:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788843774.881351:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134533888:0@lo:400:kworker.0 00000100:00100000:3.0:1788843774.882071:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134534016:0@lo:400:kworker.0 00000100:00100000:3.0:1788843774.882117:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843774.882213:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134534016 00000100:00100000:1.0:1788843774.882219:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134534016 00000100:00100000:1.0:1788843774.882264:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788843774.882273:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134534016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843774.882318:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134534016:12345-0@lo:400:kworker.0 Request processed in 47us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843774.882325:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788843774.882390:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134534016:0@lo:400:kworker.0 00000100:00100000:0.0:1788843774.889306:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd12036b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1875738134534400:0@lo:400:kworker.0 00000100:00100000:0.0:1788843774.889388:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843774.889424:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1875738134534912:0@lo:400:kworker.0 00000100:00100000:0.0:1788843774.889445:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843774.889466:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788843774.889472:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134534272:0@lo:400:kworker.0 00000100:00100000:0.0:1788843774.889494:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843774.889512:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1875738134534784:0@lo:400:kworker.0 00000100:00100000:0.0:1788843774.889532:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843774.889577:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134534272 00000100:00100000:0.0:1788843774.889585:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134534272 00000100:00100000:0.0:1788843774.889640:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788843774.889651:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134534272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843774.889707:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1875738134534272:12345-0@lo:400:kworker.0 Request processed in 58us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843774.889714:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788843774.889817:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd12036ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134534528:0@lo:400:kworker.0 00000100:00100000:3.0:1788843774.889846:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843774.889873:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788843774.889879:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134534144:0@lo:400:kworker.0 00000100:00100000:3.0:1788843774.889917:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843774.889933:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134534656:0@lo:400:kworker.0 00000100:00100000:3.0:1788843774.889953:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843774.889973:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134534400 00000100:00100000:3.0:1788843774.889977:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134534400 00000100:00100000:3.0:1788843774.890019:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134534912 00000100:00100000:3.0:1788843774.890023:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134534912 00000100:00100000:3.0:1788843774.890044:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134534784 00000100:00100000:3.0:1788843774.890047:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134534784 00000100:00100000:3.0:1788843774.890075:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134534528 00000100:00100000:3.0:1788843774.890078:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134534528 00000100:00100000:3.0:1788843774.890090:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134534656 00000100:00100000:3.0:1788843774.890092:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134534656 00000100:00100000:3.0:1788843774.890105:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788843774.890111:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12036a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1875738134534400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843774.890169:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12036a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1875738134534400:12345-0@lo:400:kworker.0 Request processed in 57us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843774.890175:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788843774.890190:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788843774.890196:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1875738134534912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843774.890225:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1875738134534912:12345-0@lo:400:kworker.0 Request processed in 30us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843774.890231:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788843774.890243:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788843774.890249:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1875738134534784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843774.890275:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1875738134534784:12345-0@lo:400:kworker.0 Request processed in 27us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843774.890281:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788843774.890291:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788843774.890296:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134534528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843774.890323:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134534528:12345-0@lo:400:kworker.0 Request processed in 28us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843774.890329:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788843774.890339:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788843774.890344:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e879500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134534656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843774.890379:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e879500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1875738134534656:12345-0@lo:400:kworker.0 Request processed in 34us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843774.890385:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1788843774.890403:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788843774.890407:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788843774.890433:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd120368700 x1875738134534656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843774.890589:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1875738134534656:0@lo:400:kworker.0 00000100:00100000:3.0:1788843774.890609:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd12036ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134534528:0@lo:400:kworker.0 00000100:00100000:3.0:1788843774.890670:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1875738134534272:0@lo:400:kworker.0 00000100:00100000:3.0:1788843774.890679:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1875738134534784:0@lo:400:kworker.0 00000100:00100000:3.0:1788843774.890687:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd12036b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1875738134534400:0@lo:400:kworker.0 00010000:00080000:3.0:1788843774.890696:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd120368e00 x1875738134534912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843774.890705:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1875738134534912:0@lo:400:kworker.0 00000100:00100000:2.0:1788843774.890920:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134534144 00000100:00100000:2.0:1788843774.890925:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134534144 00000100:00100000:2.0:1788843774.890953:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788843774.890959:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e878380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134534144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843774.891026:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e878380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134534144:12345-0@lo:400:kworker.0 Request processed in 67us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843774.891032:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788843774.891064:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134534144:0@lo:400:kworker.0 00000100:00100000:3.0:1788843774.898297:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843774.898374:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843774.898404:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843774.898537:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116617216 00000100:00100000:1.0:1788843774.898560:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116617216 00000100:00100000:1.0:1788843774.898627:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 63 00000100:00100000:1.0:1788843774.898638:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:2388:x1875738116617216:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843774.898743:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:2388:x1875738116617216:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 106us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843774.898751:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 63 00000100:00080000:1.0:1788843774.898775:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788843774.899271:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843774.899294:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843774.899338:0:19944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116617728 00000100:00100000:1.0:1788843774.899344:0:19944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116617728 00000100:00100000:1.0:1788843774.899381:0:19944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 64 00000100:00100000:1.0:1788843774.899388:0:19944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd5af0cf-62ad-40c0-947c-f942bbf55123+5:2388:x1875738116617728:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843774.899444:0:19944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd5af0cf-62ad-40c0-947c-f942bbf55123+5:2388:x1875738116617728:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 56us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843774.899467:0:19944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 64 00000100:00080000:1.0:1788843774.899486:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788843774.900099:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116616960 00000100:00100000:0.0:1788843774.900106:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116616960 00000100:00100000:1.0:1788843774.900302:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 168 00000100:00100000:1.0:1788843774.900312:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f839db8-0699-423e-a998-0395c59fee9e+13:2388:x1875738116616960:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843774.900356:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f839db8-0699-423e-a998-0395c59fee9e+13:2388:x1875738116616960:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 47us (2069us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843774.900363:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 168 00000100:00100000:3.0:1788843774.900858:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843774.900947:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843774.901370:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116617088 00000100:00100000:0.0:1788843774.901378:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116617088 00000100:00100000:0.0:1788843774.901437:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 65 00000100:00100000:0.0:1788843774.901445:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e879c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+6:2388:x1875738116617088:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1788843774.901493:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e879c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+6:2388:x1875738116617088:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 49us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843774.901500:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 65 00000100:00080000:0.0:1788843774.901568:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843774.902375:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116617472 00000100:00100000:2.0:1788843774.902384:0:18655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116617472 00000100:00100000:2.0:1788843774.902450:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116617984 00000100:00100000:2.0:1788843774.902454:0:18655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116617984 00000100:00100000:2.0:1788843774.902867:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 15 00000100:00100000:2.0:1788843774.902879:0:18655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e87b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:2388:x1875738116617472:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843774.903082:0:18655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e87b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:2388:x1875738116617472:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 205us (4676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843774.903090:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 15 00000100:00100000:2.0:1788843774.903107:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 16 00000100:00100000:2.0:1788843774.903115:0:18655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e87a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd5af0cf-62ad-40c0-947c-f942bbf55123+5:2388:x1875738116617984:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843774.903139:0:18655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e87a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd5af0cf-62ad-40c0-947c-f942bbf55123+5:2388:x1875738116617984:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 25us (3844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843774.903175:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 16 00000100:00080000:0.0:1788843774.906825:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788843774.908718:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843774.908784:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843774.908834:0:19944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116617600 00000100:00100000:1.0:1788843774.908844:0:19944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116617600 00000100:00100000:1.0:1788843774.908933:0:19944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 66 00000100:00100000:1.0:1788843774.908944:0:19944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e87a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd5af0cf-62ad-40c0-947c-f942bbf55123+6:2388:x1875738116617600:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843774.909037:0:19944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e87a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd5af0cf-62ad-40c0-947c-f942bbf55123+6:2388:x1875738116617600:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 95us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843774.909046:0:19944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 66 00000100:00080000:2.0:1788843774.910104:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843774.911390:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116617344 00000100:00100000:0.0:1788843774.911404:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116617344 00000100:00100000:1.0:1788843774.911898:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116617856 00000100:00100000:1.0:1788843774.911913:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116617856 00000100:00100000:1.0:1788843774.911944:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 17 00000100:00100000:1.0:1788843774.911953:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:2388:x1875738116617344:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843774.912046:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:2388:x1875738116617344:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 93us (11098us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843774.912052:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 17 00000100:00100000:1.0:1788843774.912072:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 18 00000100:00100000:1.0:1788843774.912078:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e87aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd5af0cf-62ad-40c0-947c-f942bbf55123+5:2388:x1875738116617856:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:1.0:1788843774.912100:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e87aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cd5af0cf-62ad-40c0-947c-f942bbf55123+5:2388:x1875738116617856:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 23us (3316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843774.912119:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 18 00000100:00080000:3.0:1788843774.912565:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788843775.193704:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843775.193852:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116618112 00000100:00100000:0.0:1788843775.193876:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116618112 00000100:00100000:0.0:1788843775.193952:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 23 00000100:00100000:0.0:1788843775.193965:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+6:15582:x1875738116618112:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788843775.193988:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843775.194026:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aea00/0xa762dfcbd58d270b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490d87 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.194095:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae600/0xa762dfcbd58d2712 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.194113:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae600/0xa762dfcbd58d2712 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.194127:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae600/0xa762dfcbd58d2712 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.194179:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d2719 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.194187:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d2719 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.194194:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d2719 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.194277:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af400/0xa762dfcbd58d2720 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.194296:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af400/0xa762dfcbd58d2720 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.194304:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af400/0xa762dfcbd58d2720 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843775.194340:0:17149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788843775.194343:0:17149:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788843775.194382:0:17149:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af400/0xa762dfcbd58d2720 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.194394:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae600/0xa762dfcbd58d2712 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.194402:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae600/0xa762dfcbd58d2712 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.194409:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae600/0xa762dfcbd58d2712 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.194415:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7ae600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843775.194418:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae600/0xa762dfcbd58d2712 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.194426:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae600/0xa762dfcbd58d2712 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.194439:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd133390a00) 00010000:00010000:0.0:1788843775.194442:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843775.194448:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae600/0xa762dfcbd58d2712 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.194464:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae600/0xa762dfcbd58d2712 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.194477:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d2719 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.194483:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d2719 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.194489:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d2719 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.194494:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7afa00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843775.194497:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d2719 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.194504:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d2719 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.194511:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9bd0071ded00) 00010000:00010000:0.0:1788843775.194513:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843775.194516:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d2719 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.194522:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d2719 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.194552:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aea00/0xa762dfcbd58d270b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d87 expref: 8 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.194576:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af400/0xa762dfcbd58d2720 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d87 expref: 7 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.194584:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bd0071deb00) 00010000:00010000:0.0:1788843775.194586:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788843775.194588:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10f7af400, rc 0) 00000100:00100000:0.0:1788843775.195016:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+7:15582:x1875738116618112:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 1052us (1320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843775.195025:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 23 00000100:00100000:2.0:1788843775.205034:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843775.205197:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116618240 00000100:00100000:0.0:1788843775.205209:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116618240 00000100:00100000:0.0:1788843775.205277:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 5 00000100:00100000:0.0:1788843775.205288:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+7:15582:x1875738116618240:12345-192.168.203.33@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788843775.205388:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+7:15582:x1875738116618240:12345-192.168.203.33@tcp:900:lhsmtool_posix.0 Request processed in 101us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843775.205396:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 5 00000100:00100000:3.0:1788843775.223195:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843775.223359:0:19944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116618496 00000100:00100000:1.0:1788843775.223372:0:19944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116618496 00000100:00100000:1.0:1788843775.223439:0:19944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 24 00000100:00100000:1.0:1788843775.223449:0:19944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e87b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+7:15582:x1875738116618496:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788843775.223470:0:19944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843775.223493:0:19944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d2727 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490d8e expref: -99 pid: 19944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.223569:0:19944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d272e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.223584:0:19944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d272e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.223596:0:19944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d272e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.223611:0:19944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d2735 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.223618:0:19944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d2735 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.223625:0:19944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d2735 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.223762:0:19944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946000/0xa762dfcbd58d273c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.223782:0:19944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946000/0xa762dfcbd58d273c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.223790:0:19944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946000/0xa762dfcbd58d273c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843775.223800:0:19944:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788843775.223953:0:19944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d272e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.223961:0:19944:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d272e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.223968:0:19944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d272e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.223974:0:19944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843775.223978:0:19944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d272e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.223985:0:19944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d272e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.224006:0:19944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bd0071deb00) 00010000:00010000:1.0:1788843775.224009:0:19944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843775.224015:0:19944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d272e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.224020:0:19944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d272e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.224033:0:19944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d2735 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.224045:0:19944:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d2735 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.224050:0:19944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d2735 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.224055:0:19944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843775.224058:0:19944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d2735 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.224063:0:19944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d2735 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.224071:0:19944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9bd1420eed00) 00010000:00010000:1.0:1788843775.224074:0:19944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843775.224076:0:19944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d2735 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.224081:0:19944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d2735 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.225384:0:19944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d2727 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d8e expref: 10 pid: 19944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.225406:0:19944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946000/0xa762dfcbd58d273c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d8e expref: 9 pid: 19944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.225413:0:19944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd1420eee00) 00010000:00010000:1.0:1788843775.225416:0:19944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843775.225428:0:19944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007946000, rc 0) 00000100:00100000:1.0:1788843775.225503:0:19944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e87b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+9:15582:x1875738116618496:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 2054us (2317us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788843775.225513:0:19944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 24 00000100:00100000:2.0:1788843775.241822:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843775.242039:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116618624 00000100:00100000:0.0:1788843775.242051:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116618624 00000100:00100000:0.0:1788843775.242124:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 25 00000100:00100000:0.0:1788843775.242136:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+9:15582:x1875738116618624:12345-192.168.203.33@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788843775.242293:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+9:15582:x1875738116618624:12345-192.168.203.33@tcp:59:lhsmtool_posix.0 Request processed in 159us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843775.242302:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 25 00000100:00100000:2.0:1788843775.245358:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843775.245677:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116618752 00000100:00100000:3.0:1788843775.245689:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116618752 00000100:00100000:3.0:1788843775.245754:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 26 00000100:00100000:3.0:1788843775.245767:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:15582:x1875738116618752:12345-192.168.203.33@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1788843775.246752:0:17151:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 943us 00000100:00100000:1.0:1788843775.257061:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843775.257105:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116618880 00000100:00100000:1.0:1788843775.257122:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116618880 00000100:00100000:1.0:1788843775.257200:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 27 00000100:00100000:1.0:1788843775.257210:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00799b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+9:15588:x1875738116618880:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1788843775.257231:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843775.257256:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d274a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490d95 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.257323:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d2751 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.257339:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d2751 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.257350:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d2751 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.257365:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d2758 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.257371:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d2758 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.257377:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d2758 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.257433:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d2751 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.257440:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d2751 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.257446:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d2751 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.257452:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843775.257456:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d2751 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.257464:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d2751 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.257476:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd133390a00) 00010000:00010000:1.0:1788843775.257479:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843775.257484:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d2751 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.257490:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d2751 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.257501:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d2758 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.257506:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d2758 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.257511:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d2758 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.257522:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843775.257525:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d2758 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.257531:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d2758 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.257540:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bd1420eed00) 00010000:00010000:1.0:1788843775.257542:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843775.257545:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d2758 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.257550:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d2758 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.257584:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d274a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d95 expref: 10 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.257594:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd133390a00) 00010000:00010000:1.0:1788843775.257603:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843775.257607:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d274a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d95 expref: 10 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.257617:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007946800, rc 0) 00000100:00100000:1.0:1788843775.257684:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00799b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+9:15588:x1875738116618880:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 476us (633us total) trans 0 rc 301/301 00000100:00100000:1.0:1788843775.257692:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 27 00000100:00100000:0.0:1788843775.262242:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843775.262386:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116619008 00000100:00100000:3.0:1788843775.262399:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116619008 00000100:00100000:3.0:1788843775.262459:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 0 00000100:00100000:3.0:1788843775.262469:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+9:15588:x1875738116619008:12345-192.168.203.33@tcp:700:lfs.0 00000100:00100000:3.0:1788843775.262551:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+9:15588:x1875738116619008:12345-192.168.203.33@tcp:700:lfs.0 Request processed in 82us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843775.262559:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 0 00000100:00100000:0.0:1788843775.279884:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843775.279925:0:19944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116619264 00000100:00100000:0.0:1788843775.279936:0:19944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116619264 00000100:00100000:0.0:1788843775.280010:0:19944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 28 00000100:00100000:0.0:1788843775.280022:0:19944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12036b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+9:15588:x1875738116619264:12345-192.168.203.33@tcp:36:lfs.0 00010000:00010000:0.0:1788843775.280079:0:19944:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843775.280111:0:19944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030200/0xa762dfcbd58d2678 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d02 expref: 9 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.280131:0:19944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd133390a00) 00010000:00010000:0.0:1788843775.280136:0:19944:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788843775.280216:0:19944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d275f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.280231:0:19944:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71000/0xa762dfcbd58d26b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d72 expref: 5 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.280240:0:19944:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d275f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.280278:0:19944:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71000/0xa762dfcbd58d26b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d72 expref: 5 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.280292:0:19944:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71000/0xa762dfcbd58d26b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d72 expref: 5 pid: 17151 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843775.280307:0:19944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd120369880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19944:1875738134535040:192.168.203.33@tcp:104: 00000100:00100000:0.0:1788843775.280390:0:19944:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd13e9c4240 going to sleep for 11 seconds 00000100:00100000:2.0:1788843775.287211:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:15582:x1875738116618752:12345-192.168.203.33@tcp:59:lhsmtool_posix.0 Request processed in 41436us (41853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843775.287226:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 26 00000100:00100000:1.0:1788843775.288091:0:19944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd120369880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19944:1875738134535040:192.168.203.33@tcp:104: 00010000:00010000:1.0:1788843775.288134:0:19944:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d275f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843775.290871:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843775.290931:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116619392 00000100:00100000:3.0:1788843775.290943:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116619392 00010000:00010000:3.0:1788843775.290989:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71000/0xa762dfcbd58d26b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d72 expref: 6 pid: 17151 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843775.291040:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 15 00000100:00100000:3.0:1788843775.291050:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e87ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd5af0cf-62ad-40c0-947c-f942bbf55123+6:2390:x1875738116619392:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843775.291067:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843775.291074:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71000/0xa762dfcbd58d26b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d72 expref: 6 pid: 17151 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843775.291089:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71000/0xa762dfcbd58d26b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d72 expref: 6 pid: 17151 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843775.291128:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71000/0xa762dfcbd58d26b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d72 expref: 6 pid: 17151 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843775.291168:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd133390a00) 00010000:00010000:3.0:1788843775.291175:0:17137:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d275f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843775.291185:0:17137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d275f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843775.291193:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d275f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843775.291222:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843775.291275:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e87ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd5af0cf-62ad-40c0-947c-f942bbf55123+5:2390:x1875738116619392:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 225us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843775.291283:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 15 00010000:00010000:3.0:1788843775.291311:0:19944:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d275f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843775.291318:0:19944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d275f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843775.291341:0:19944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71600/0xa762dfcbd58d2766 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843775.291351:0:19944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71600/0xa762dfcbd58d2766 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843775.291358:0:19944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71600/0xa762dfcbd58d2766 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.296788:0:19944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d276d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.296818:0:19944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d276d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.296831:0:19944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d276d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788843775.297031:0:19944:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d726f26f reply state 000000005ce8d6d8 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d276d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.297046:0:19944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d276d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.297056:0:19944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bd1420eed00) 00010000:00010000:1.0:1788843775.297059:0:19944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788843775.297063:0:19944:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788843775.297071:0:19944:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788843775.297082:0:19944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d275f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.297088:0:19944:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d275f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.297095:0:19944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d275f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.297101:0:19944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7afa00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843775.297106:0:19944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d275f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.297122:0:19944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d275f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.297135:0:19944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd133390a00) 00010000:00010000:1.0:1788843775.297137:0:19944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843775.297198:0:19944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d275f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.297206:0:19944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afa00/0xa762dfcbd58d275f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788843775.297230:0:19944:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d726f26f reply state 000000005ce8d6d8 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71600/0xa762dfcbd58d2766 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.297239:0:19944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71600/0xa762dfcbd58d2766 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.297246:0:19944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bd00744fa00) 00010000:00010000:1.0:1788843775.297248:0:19944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788843775.297252:0:19944:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788843775.297382:0:19944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12036b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+10:15588:x1875738116619264:12345-192.168.203.33@tcp:36:lfs.0 Request processed in 17356us (17502us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788843775.297391:0:19944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 28 00010000:00010000:0.0:1788843775.322441:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843775.404110:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843775.404255:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116619520 00000100:00100000:2.0:1788843775.404266:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116619520 00000100:00100000:2.0:1788843775.404324:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 29 00000100:00100000:2.0:1788843775.404335:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+10:15596:x1875738116619520:12345-192.168.203.33@tcp:101:lctl.0 00010000:00010000:2.0:1788843775.404363:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843775.404390:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030200/0xa762dfcbd58d2774 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490d9c expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.404460:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030e00/0xa762dfcbd58d277b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.404487:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030e00/0xa762dfcbd58d277b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.404500:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030e00/0xa762dfcbd58d277b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843775.404551:0:17149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788843775.404555:0:17149:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788843775.404611:0:17149:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030e00/0xa762dfcbd58d277b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.404638:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030200/0xa762dfcbd58d2774 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d9c expref: 12 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.404669:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030e00/0xa762dfcbd58d277b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490d9c expref: 11 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.404678:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd105fa2200) 00010000:00010000:2.0:1788843775.404681:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788843775.404684:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd100030e00, rc 0) 00000100:00100000:2.0:1788843775.404744:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+11:15596:x1875738116619520:12345-192.168.203.33@tcp:101:lctl.0 Request processed in 411us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843775.404751:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 29 00000100:00100000:3.0:1788843775.442054:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843775.442205:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116619648 00000100:00100000:2.0:1788843775.442216:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116619648 00000100:00100000:2.0:1788843775.442281:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 30 00000100:00100000:2.0:1788843775.442292:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e87b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5af0cf-62ad-40c0-947c-f942bbf55123+5:15597:x1875738116619648:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1788843775.442312:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843775.442336:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030200/0xa762dfcbd58d2782 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490da3 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.442404:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c200/0xa762dfcbd58d2789 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.442420:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c200/0xa762dfcbd58d2789 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.442431:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c200/0xa762dfcbd58d2789 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843775.442498:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788843775.442502:0:17151:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788843775.442523:0:17151:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c200/0xa762dfcbd58d2789 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.442547:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030200/0xa762dfcbd58d2782 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490da3 expref: 7 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.442568:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c200/0xa762dfcbd58d2789 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490da3 expref: 6 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.442577:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd105fa2200) 00010000:00010000:2.0:1788843775.442581:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788843775.442585:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3c200, rc 0) 00000100:00100000:2.0:1788843775.442651:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e87b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5af0cf-62ad-40c0-947c-f942bbf55123+6:15597:x1875738116619648:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 361us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843775.443586:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 30 00000100:00100000:1.0:1788843775.451839:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843775.452001:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116619776 00000100:00100000:2.0:1788843775.452013:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116619776 00000100:00100000:2.0:1788843775.452084:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 31 00000100:00100000:2.0:1788843775.452095:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00799ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd5af0cf-62ad-40c0-947c-f942bbf55123+6:15597:x1875738116619776:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1788843775.452117:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843775.452166:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d2790 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490daa expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.452243:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d2797 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.452275:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d2797 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.452287:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d2797 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.452301:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d279e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.452309:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d279e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.452316:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d279e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.452393:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d27a5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.452401:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d27a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.452407:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d27a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843775.452445:0:17149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788843775.452448:0:17149:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788843775.452467:0:17149:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d27a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.452480:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d2797 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.452496:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d2797 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.452503:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d2797 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.452510:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843775.452515:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d2797 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.452523:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d2797 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.452538:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd105fa2200) 00010000:00010000:2.0:1788843775.452542:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843775.452548:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d2797 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.452555:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d2797 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.452573:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d279e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.452579:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d279e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.452585:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d279e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.452590:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3ce00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843775.452600:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d279e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.452606:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d279e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.452613:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bd00744fa00) 00010000:00010000:2.0:1788843775.452615:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843775.452618:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d279e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.452623:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d279e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.452647:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d2790 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490daa expref: 8 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.452660:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d27a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490daa expref: 7 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.452667:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bd1420eed00) 00010000:00010000:2.0:1788843775.452669:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788843775.452672:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3c800, rc 0) 00000100:00100000:2.0:1788843775.452780:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00799ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd5af0cf-62ad-40c0-947c-f942bbf55123+7:15597:x1875738116619776:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 687us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843775.452788:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 31 00000100:00100000:0.0:1788843775.462306:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843775.462415:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116619904 00000100:00100000:2.0:1788843775.462428:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116619904 00000100:00100000:2.0:1788843775.462491:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 6 00000100:00100000:2.0:1788843775.462503:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:cd5af0cf-62ad-40c0-947c-f942bbf55123+5:15597:x1875738116619904:12345-192.168.203.33@tcp:900:lfs.0 00000100:00100000:2.0:1788843775.462610:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:cd5af0cf-62ad-40c0-947c-f942bbf55123+5:15597:x1875738116619904:12345-192.168.203.33@tcp:900:lfs.0 Request processed in 108us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843775.462618:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 6 00000100:00100000:0.0:1788843775.468753:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843775.468849:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116620160 00000100:00100000:2.0:1788843775.468873:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116620160 00000100:00100000:2.0:1788843775.468938:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 32 00000100:00100000:2.0:1788843775.468949:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5af0cf-62ad-40c0-947c-f942bbf55123+7:15597:x1875738116620160:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1788843775.468972:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843775.469005:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d27ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490db1 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843775.469113:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788843775.469399:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d27ac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490db1 expref: 9 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.469415:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd105fa2200) 00010000:00010000:2.0:1788843775.469418:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788843775.469424:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d27ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490db1 expref: 9 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.469438:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3ca00, rc 0) 00000100:00100000:2.0:1788843775.469695:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5af0cf-62ad-40c0-947c-f942bbf55123+8:15597:x1875738116620160:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 746us (951us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788843775.469703:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 32 00000100:00100000:3.0:1788843775.478703:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843775.478793:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116620416 00000100:00100000:2.0:1788843775.478804:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116620416 00000100:00100000:2.0:1788843775.478868:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 33 00000100:00100000:2.0:1788843775.478889:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e87bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd5af0cf-62ad-40c0-947c-f942bbf55123+8:15597:x1875738116620416:12345-192.168.203.33@tcp:36:lfs.0 00010000:00010000:2.0:1788843775.478946:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843775.478977:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d27a5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490daa expref: 8 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.479008:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bd1420eed00) 00010000:00010000:2.0:1788843775.479015:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788843775.479038:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d27ba lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.479052:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d27ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.479062:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d27ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788843775.479298:0:17149:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ea9260a9 reply state 000000005c4124a8 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d27ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.479322:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d27ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.479328:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bd1420eed00) 00010000:00010000:2.0:1788843775.479331:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1788843775.479334:0:17149:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788843775.479340:0:17149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788843775.479415:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e87bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd5af0cf-62ad-40c0-947c-f942bbf55123+9:15597:x1875738116620416:12345-192.168.203.33@tcp:36:lfs.0 Request processed in 526us (720us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788843775.479421:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 33 00000100:00100000:0.0:1788843775.489352:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843775.489457:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116620672 00000100:00100000:3.0:1788843775.489469:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116620672 00000100:00100000:3.0:1788843775.489540:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2 00000100:00100000:3.0:1788843775.489553:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12036ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd5af0cf-62ad-40c0-947c-f942bbf55123+9:15597:x1875738116620672:12345-192.168.203.33@tcp:35:lfs.0 00000100:00100000:3.0:1788843775.489793:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12036ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd5af0cf-62ad-40c0-947c-f942bbf55123+10:15597:x1875738116620672:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 242us (454us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788843775.489800:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2 00000100:00100000:0.0:1788843775.492699:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843775.492794:0:19944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116620928 00000100:00100000:1.0:1788843775.492806:0:19944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116620928 00000100:00100000:1.0:1788843775.492878:0:19944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 34 00000100:00100000:1.0:1788843775.492890:0:19944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd5af0cf-62ad-40c0-947c-f942bbf55123+10:15597:x1875738116620928:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:1.0:1788843775.492933:0:19944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843775.492960:0:19944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d27c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490db8 expref: -99 pid: 19944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.493047:0:19944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d27c8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.493065:0:19944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d27c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.493078:0:19944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d27c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.493089:0:19944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d27cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.493097:0:19944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d27cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.493103:0:19944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d27cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843775.493235:0:19944:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788843775.493303:0:19944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d27c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.493500:0:19944:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d27c8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.493508:0:19944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d27c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.493525:0:19944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843775.493529:0:19944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d27c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.493537:0:19944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d27c8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.493551:0:19944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd105fa2200) 00010000:00010000:1.0:1788843775.493555:0:19944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843775.493561:0:19944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d27c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.493566:0:19944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947400/0xa762dfcbd58d27c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.493580:0:19944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d27cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.493586:0:19944:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d27cf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.493591:0:19944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d27cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.493596:0:19944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007946800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843775.493599:0:19944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d27cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.493604:0:19944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d27cf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.493626:0:19944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bd00744fa00) 00010000:00010000:1.0:1788843775.493628:0:19944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843775.493631:0:19944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d27cf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.493636:0:19944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946800/0xa762dfcbd58d27cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.493671:0:19944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d27c1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490db8 expref: 12 pid: 19944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.493682:0:19944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd105fa2200) 00010000:00010000:1.0:1788843775.493684:0:19944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788843775.493688:0:19944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007946a00/0xa762dfcbd58d27c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490db8 expref: 12 pid: 19944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843775.493697:0:19944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd007946a00, rc 0) 00000100:00100000:1.0:1788843775.493806:0:19944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd5af0cf-62ad-40c0-947c-f942bbf55123+11:15597:x1875738116620928:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 917us (1114us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1788843775.493813:0:19944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 34 00000100:00100000:1.0:1788843775.503359:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843775.503555:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116621056 00000100:00100000:0.0:1788843775.503567:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116621056 00000100:00100000:0.0:1788843775.503694:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 35 00000100:00100000:0.0:1788843775.503706:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd5af0cf-62ad-40c0-947c-f942bbf55123+11:15597:x1875738116621056:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1788843775.503733:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843775.503758:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae000/0xa762dfcbd58d27dd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490dbf expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.503868:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af200/0xa762dfcbd58d27e4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.503884:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af200/0xa762dfcbd58d27e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.503895:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af200/0xa762dfcbd58d27e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843775.503919:0:17150:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788843775.503923:0:17150:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788843775.503947:0:17150:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af200/0xa762dfcbd58d27e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.503974:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae000/0xa762dfcbd58d27dd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490dbf expref: 13 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.504004:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af200/0xa762dfcbd58d27e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490dbf expref: 12 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.504029:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bd1420eed00) 00010000:00010000:0.0:1788843775.504032:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788843775.504036:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10f7af200, rc 0) 00000100:00100000:0.0:1788843775.504113:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd5af0cf-62ad-40c0-947c-f942bbf55123+12:15597:x1875738116621056:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 408us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843775.504120:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 35 00000100:00100000:0.0:1788843775.509074:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843775.509206:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116621184 00000100:00100000:2.0:1788843775.509234:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116621184 00000100:00100000:2.0:1788843775.509301:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 3 00000100:00100000:2.0:1788843775.509428:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd5af0cf-62ad-40c0-947c-f942bbf55123+12:15597:x1875738116621184:12345-192.168.203.33@tcp:37:lfs.0 00000100:00100000:2.0:1788843775.517939:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cd5af0cf-62ad-40c0-947c-f942bbf55123+12:15597:x1875738116621184:12345-192.168.203.33@tcp:37:lfs.0 Request processed in 8617us (8866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843775.517954:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 3 00000100:00100000:1.0:1788843775.523696:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843775.523897:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116621440 00000100:00100000:3.0:1788843775.523909:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116621440 00000100:00100000:3.0:1788843775.523972:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 4 00000100:00100000:3.0:1788843775.523983:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd1153f7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd5af0cf-62ad-40c0-947c-f942bbf55123+12:15597:x1875738116621440:12345-192.168.203.33@tcp:35:lfs.0 00000100:00100000:3.0:1788843775.524252:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd1153f7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cd5af0cf-62ad-40c0-947c-f942bbf55123+13:15597:x1875738116621440:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 270us (565us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788843775.524260:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 4 00000040:00080000:0.0:1788843775.578897:0:17908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788843775.593556:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843775.593804:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116621568 00000100:00100000:2.0:1788843775.593816:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116621568 00000100:00100000:2.0:1788843775.593891:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 36 00000100:00100000:2.0:1788843775.593901:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12036ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+11:15603:x1875738116621568:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:2.0:1788843775.593921:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843775.593941:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d27eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490dc6 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.594016:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d27f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.594032:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d27f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.594044:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d27f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.594054:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d27f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.594061:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d27f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.594068:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d27f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.594198:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c600/0xa762dfcbd58d2800 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.594207:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c600/0xa762dfcbd58d2800 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.594216:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c600/0xa762dfcbd58d2800 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843775.594248:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788843775.594251:0:17151:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788843775.594290:0:17151:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c600/0xa762dfcbd58d2800 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.594302:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d27f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.594309:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d27f2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.594684:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d27f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.594690:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3ce00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843775.594694:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d27f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.594703:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d27f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.594716:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd105fa2200) 00010000:00010000:2.0:1788843775.594727:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843775.594733:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d27f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.594740:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d27f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.594754:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d27f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.594760:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d27f9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.594772:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d27f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.594777:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843775.594780:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d27f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.594787:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d27f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.594795:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bd00744fa00) 00010000:00010000:2.0:1788843775.594797:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843775.594800:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d27f9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.594806:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d27f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.594831:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d27eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490dc6 expref: 13 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.595675:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c600/0xa762dfcbd58d2800 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490dc6 expref: 12 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.595690:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bd1420eed00) 00010000:00010000:2.0:1788843775.595693:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788843775.595696:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3c600, rc 0) 00000100:00100000:2.0:1788843775.595782:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12036ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+12:15603:x1875738116621568:12345-192.168.203.33@tcp:101:bash.0 Request processed in 1879us (2234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843775.595791:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 36 00000100:00100000:0.0:1788843775.598590:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843775.598659:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116621696 00000100:00100000:2.0:1788843775.598671:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116621696 00000100:00100000:2.0:1788843775.598737:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7 00000100:00100000:2.0:1788843775.598748:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd120369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:15603:x1875738116621696:12345-192.168.203.33@tcp:900:bash.0 00000100:00100000:2.0:1788843775.598831:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd120369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:15603:x1875738116621696:12345-192.168.203.33@tcp:900:bash.0 Request processed in 85us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843775.598839:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7 00000100:00100000:3.0:1788843775.600972:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843775.602104:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116621952 00000100:00100000:2.0:1788843775.602119:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116621952 00000100:00100000:2.0:1788843775.602205:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 37 00000100:00100000:2.0:1788843775.602216:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+12:15603:x1875738116621952:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:2.0:1788843775.602237:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843775.602261:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d2807 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490dcd expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.602393:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d280e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.602421:0:17149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af200/0xa762dfcbd58d27e4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490dbf expref: 12 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.602431:0:17149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d280e lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.602482:0:17149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af200/0xa762dfcbd58d27e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490dbf expref: 12 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.602497:0:17149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af200/0xa762dfcbd58d27e4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490dbf expref: 12 pid: 17150 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843775.602512:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079baa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17149:1875738134535168:192.168.203.33@tcp:104: 00000100:00100000:2.0:1788843775.602612:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd111590300 going to sleep for 11 seconds 00000100:00100000:1.0:1788843775.605363:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843775.605634:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116622080 00000100:00100000:3.0:1788843775.605644:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116622080 00010000:00010000:3.0:1788843775.605697:0:17136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af200/0xa762dfcbd58d27e4 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490dbf expref: 13 pid: 17150 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843775.605743:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 16 00000100:00100000:3.0:1788843775.605755:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007998e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd5af0cf-62ad-40c0-947c-f942bbf55123+13:2389:x1875738116622080:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843775.605772:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843775.605793:0:17136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af200/0xa762dfcbd58d27e4 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490dbf expref: 13 pid: 17150 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843775.605807:0:17136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af200/0xa762dfcbd58d27e4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490dbf expref: 13 pid: 17150 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843775.605831:0:17136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bd1420eed00) 00010000:00010000:3.0:1788843775.605837:0:17136:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d280e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843775.605848:0:17136:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d280e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843775.605856:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d280e lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843775.605890:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843775.605942:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007998e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd5af0cf-62ad-40c0-947c-f942bbf55123+13:2389:x1875738116622080:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 190us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843775.605950:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 16 00010000:00010000:2.0:1788843775.606692:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af200/0xa762dfcbd58d27e4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490dbf expref: 12 pid: 17150 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843775.606714:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079baa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17149:1875738134535168:192.168.203.33@tcp:104: 00010000:00010000:2.0:1788843775.606738:0:17149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d280e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.606749:0:17149:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d280e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.606754:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d280e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.606778:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d2815 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.606798:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d2815 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.606806:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d2815 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.607965:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d281c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.607985:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d281c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.608007:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d281c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843775.608019:0:17149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788843775.608050:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d280e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.608057:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d280e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.608064:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d280e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.608070:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3d000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843775.608075:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d280e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.608083:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d280e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.608111:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bd1420eed00) 00010000:00010000:2.0:1788843775.608114:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843775.608119:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d280e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.608126:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d280e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788843775.608615:0:17149:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e8201b4 reply state 000000000c211936 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d2815 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.608633:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d2815 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.608640:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bd105fa2600) 00010000:00010000:2.0:1788843775.608643:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788843775.608646:0:17149:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788843775.609066:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d2807 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490dcd expref: 15 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.609086:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d281c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490dcd expref: 14 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.609092:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd105fa2a00) 00010000:00010000:2.0:1788843775.609095:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788843775.609097:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3d800, rc 0) 00000100:00100000:2.0:1788843775.611285:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+15:15603:x1875738116621952:12345-192.168.203.33@tcp:101:bash.0 Request processed in 9058us (10310us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788843775.611298:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 37 00000100:00100000:1.0:1788843775.632887:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843775.632988:0:19944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116622208 00000100:00100000:2.0:1788843775.633011:0:19944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116622208 00000100:00100000:2.0:1788843775.633083:0:19944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 38 00000100:00100000:2.0:1788843775.633096:0:19944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+15:15603:x1875738116622208:12345-192.168.203.33@tcp:101:bash.0 00010000:00010000:2.0:1788843775.633123:0:19944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843775.633189:0:19944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d282a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490dd4 expref: -99 pid: 19944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.633256:0:19944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d2831 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.633272:0:19944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d2831 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.633284:0:19944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d2831 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843775.633332:0:19944:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788843775.633336:0:19944:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788843775.633356:0:19944:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d2831 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.633367:0:19944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d2831 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.633396:0:19944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d282a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490dd4 expref: 17 pid: 19944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.633418:0:19944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d2831 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490dd4 expref: 16 pid: 19944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.633446:0:19944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd105fa2a00) 00010000:00010000:2.0:1788843775.633449:0:19944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843775.633453:0:19944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3d000, rc 0) 00000100:00100000:2.0:1788843775.633514:0:19944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+16:15603:x1875738116622208:12345-192.168.203.33@tcp:101:bash.0 Request processed in 421us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843775.633523:0:19944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 38 00000100:00100000:3.0:1788843775.642927:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843775.643077:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116622464 00000100:00100000:0.0:1788843775.643090:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116622464 00000100:00100000:0.0:1788843775.643182:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 5 00000100:00100000:0.0:1788843775.643194:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+16:15603:x1875738116622464:12345-192.168.203.33@tcp:35:bash.0 00000100:00100000:0.0:1788843775.643517:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+17:15603:x1875738116622464:12345-192.168.203.33@tcp:35:bash.0 Request processed in 324us (599us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788843775.643527:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 5 00000040:00080000:3.0:1788843775.771581:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788843775.790046:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843775.792061:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116622720 00000100:00100000:0.0:1788843775.792083:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116622720 00000100:00100000:0.0:1788843775.792289:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 39 00000100:00100000:0.0:1788843775.792302:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+17:15613:x1875738116622720:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:0.0:1788843775.792329:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843775.792354:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aea00/0xa762dfcbd58d2838 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490ddb expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843775.792498:0:17150:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788843775.792597:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aea00/0xa762dfcbd58d2838 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ddb expref: 19 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.792613:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd105fa2200) 00010000:00010000:0.0:1788843775.792617:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788843775.792623:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aea00/0xa762dfcbd58d2838 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490ddb expref: 19 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.792636:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10f7aea00, rc 0) 00000100:00100000:0.0:1788843775.793362:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+18:15613:x1875738116622720:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 1060us (3323us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1788843775.793372:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 39 00000100:00100000:3.0:1788843775.797823:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843775.799073:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116622976 00000100:00100000:0.0:1788843775.799089:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116622976 00000100:00100000:0.0:1788843775.799166:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 6 00000100:00100000:0.0:1788843775.799177:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd13e878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+18:15613:x1875738116622976:12345-192.168.203.33@tcp:35:lfs.0 00000100:00100000:0.0:1788843775.799413:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd13e878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+19:15613:x1875738116622976:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 237us (1598us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788843775.799421:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 6 00000100:00100000:3.0:1788843775.862383:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843775.862596:0:19944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116623232 00000100:00100000:2.0:1788843775.862608:0:19944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116623232 00000100:00100000:2.0:1788843775.862680:0:19944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 40 00000100:00100000:2.0:1788843775.862692:0:19944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0084e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+19:15616:x1875738116623232:12345-192.168.203.33@tcp:101:lfs.0 00010000:00010000:2.0:1788843775.862720:0:19944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843775.862744:0:19944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d2846 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490de2 expref: -99 pid: 19944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.862857:0:19944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d284d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.862874:0:19944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d284d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.862896:0:19944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d284d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843775.862908:0:19944:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788843775.863016:0:19944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d2846 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490de2 expref: 22 pid: 19944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.863056:0:19944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d284d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490de2 expref: 21 pid: 19944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.863065:0:19944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd105fa2a00) 00010000:00010000:2.0:1788843775.863068:0:19944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843775.863072:0:19944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3dc00, rc 0) 00000100:00100000:2.0:1788843775.863138:0:19944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0084e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+21:15616:x1875738116623232:12345-192.168.203.33@tcp:101:lfs.0 Request processed in 448us (765us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788843775.863191:0:19944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 40 00000100:00100000:3.0:1788843775.873941:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843775.874016:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843775.874112:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116623488 00000100:00100000:0.0:1788843775.874123:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116623488 00000100:00100000:0.0:1788843775.874236:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 0 00000100:00100000:0.0:1788843775.874248:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd127be2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+21:2387:x1875738116623488:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843775.874265:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843775.874296:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d284d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490de2 expref: 21 pid: 19944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843775.874318:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd105fa2a00) 00010000:00010000:0.0:1788843775.874323:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843775.874377:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd127be2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+20:2387:x1875738116623488:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 132us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843775.874384:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 0 00000100:00100000:2.0:1788843775.875008:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116623360 00000100:00100000:2.0:1788843775.875016:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116623360 00000100:00100000:2.0:1788843775.875062:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 41 00000100:00100000:2.0:1788843775.875071:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+20:15616:x1875738116623360:12345-192.168.203.33@tcp:54:lfs.0 00010000:00010000:2.0:1788843775.875133:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d285b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.875174:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d285b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.875186:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d285b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.875220:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d285b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.875239:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d285b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.875258:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d285b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.875263:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3c800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843775.875268:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d285b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.875275:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d285b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.875285:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd105fa2a00) 00010000:00010000:2.0:1788843775.875287:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788843775.875291:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d285b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843775.875296:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d285b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843775.875357:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+20:15616:x1875738116623360:12345-192.168.203.33@tcp:54:lfs.0 Request processed in 287us (1424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843775.875364:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 41 00000100:00100000:3.0:1788843775.885626:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843775.885777:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116623744 00000100:00100000:0.0:1788843775.885788:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116623744 00000100:00100000:0.0:1788843775.885853:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 7 00000100:00100000:0.0:1788843775.885864:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd127be1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+20:15616:x1875738116623744:12345-192.168.203.33@tcp:35:lfs.0 00000100:00100000:0.0:1788843775.886119:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd127be1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+21:15616:x1875738116623744:12345-192.168.203.33@tcp:35:lfs.0 Request processed in 255us (502us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788843775.886126:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 7 00000100:00100000:3.0:1788843776.264070:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843776.264196:0:19944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116624000 00000100:00100000:2.0:1788843776.264209:0:19944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116624000 00000100:00100000:2.0:1788843776.264290:0:19944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 42 00000100:00100000:2.0:1788843776.264303:0:19944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd127be2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+21:15647:x1875738116624000:12345-192.168.203.33@tcp:101:cat.0 00010000:00010000:2.0:1788843776.264338:0:19944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843776.264363:0:19944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d2862 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490de9 expref: -99 pid: 19944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.264517:0:19944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d2869 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.264535:0:19944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d2869 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.264549:0:19944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d2869 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843776.264560:0:19944:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788843776.264668:0:19944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d2862 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490de9 expref: 24 pid: 19944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.264688:0:19944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d2869 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490de9 expref: 23 pid: 19944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.264697:0:19944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd105fa2a00) 00010000:00010000:2.0:1788843776.264700:0:19944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843776.264704:0:19944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3cc00, rc 0) 00000100:00100000:2.0:1788843776.264775:0:19944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd127be2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+23:15647:x1875738116624000:12345-192.168.203.33@tcp:101:cat.0 Request processed in 476us (714us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788843776.264783:0:19944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 42 00000100:00080000:3.0:1788843776.265176:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843776.274067:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843776.274201:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116624128 00000100:00100000:3.0:1788843776.274213:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116624128 00000100:00100000:3.0:1788843776.274287:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1 00000100:00100000:3.0:1788843776.274298:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007769f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+23:2389:x1875738116624128:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843776.274316:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843776.274345:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d2869 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490de9 expref: 23 pid: 19944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843776.274366:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd105fa2a00) 00010000:00010000:3.0:1788843776.274373:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843776.274446:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007769f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+22:2389:x1875738116624128:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 148us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843776.275441:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1 00000100:00100000:0.0:1788843776.284331:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843776.285573:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116624384 00000100:00100000:3.0:1788843776.285586:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116624384 00000100:00100000:3.0:1788843776.285665:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 8 00000100:00100000:3.0:1788843776.285677:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+22:15647:x1875738116624384:12345-192.168.203.33@tcp:35:cat.0 00000100:00100000:3.0:1788843776.285977:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+23:15647:x1875738116624384:12345-192.168.203.33@tcp:35:cat.0 Request processed in 301us (1654us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1788843776.285996:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 8 00010000:00010000:1.0:1788843776.346308:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843776.366165:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843776.366279:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116624640 00000100:00100000:2.0:1788843776.366291:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116624640 00000100:00100000:2.0:1788843776.366361:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 43 00000100:00100000:2.0:1788843776.366373:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+23:15653:x1875738116624640:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1788843776.366397:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843776.366427:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d2877 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490df0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.366552:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d287e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.366568:0:17149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d281c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490dcd expref: 24 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.366576:0:17149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d2831 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490dd4 expref: 24 pid: 19944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.366584:0:17149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d287e lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.366619:0:17149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d2831 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490dd4 expref: 24 pid: 19944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.366633:0:17149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d2831 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490dd4 expref: 24 pid: 19944 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843776.366648:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079baa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17149:1875738134535296:192.168.203.33@tcp:104: 00010000:00010000:2.0:1788843776.366975:0:17149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d281c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490dcd expref: 24 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.366993:0:17149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d281c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490dcd expref: 24 pid: 17149 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843776.367002:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079bb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17149:1875738134535424:192.168.203.33@tcp:104: 00000100:00100000:2.0:1788843776.367034:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd111590e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788843776.369711:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843776.369749:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843776.370052:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116624768 00000100:00100000:0.0:1788843776.370062:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116624768 00010000:00010000:0.0:1788843776.370108:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d2831 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490dd4 expref: 25 pid: 19944 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843776.370171:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116624896 00000100:00100000:0.0:1788843776.370174:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116624896 00010000:00010000:0.0:1788843776.370187:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d281c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490dcd expref: 26 pid: 17149 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843776.370204:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 17 00000100:00100000:0.0:1788843776.370214:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+26:2390:x1875738116624768:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843776.370245:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843776.370251:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d2831 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490dd4 expref: 26 pid: 19944 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.370264:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d2831 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490dd4 expref: 26 pid: 19944 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.370288:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd105fa2a00) 00010000:00010000:0.0:1788843776.370294:0:17135:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d287e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.370303:0:17135:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d287e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.370309:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843776.370360:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+26:2390:x1875738116624768:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 147us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843776.370368:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 17 00000100:00100000:0.0:1788843776.370387:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 18 00000100:00100000:0.0:1788843776.370394:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0013a8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+25:2390:x1875738116624896:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843776.370401:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843776.370406:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d281c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490dcd expref: 25 pid: 17149 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.370416:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d281c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490dcd expref: 25 pid: 17149 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.370981:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd105fa2a00) 00010000:00010000:0.0:1788843776.370997:0:17135:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d287e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.371006:0:17135:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d287e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.371015:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d287e lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.371037:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843776.371074:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0013a8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+25:2390:x1875738116624896:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 678us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843776.371081:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 18 00010000:00010000:2.0:1788843776.371298:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d2831 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490dd4 expref: 24 pid: 19944 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843776.371316:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079baa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17149:1875738134535296:192.168.203.33@tcp:104: 00010000:00010000:2.0:1788843776.371329:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d281c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490dcd expref: 23 pid: 17149 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843776.371338:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079bb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17149:1875738134535424:192.168.203.33@tcp:104: 00010000:00010000:2.0:1788843776.371359:0:17149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d287e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.371368:0:17149:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d287e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.371374:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d287e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843776.371391:0:17149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788843776.371669:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d2877 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490df0 expref: 24 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.371685:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3cc00/0xa762dfcbd58d287e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490df0 expref: 23 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.371692:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd105fa2a00) 00010000:00010000:2.0:1788843776.371695:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788843776.371697:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3cc00, rc 0) 00000100:00100000:2.0:1788843776.371736:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+23:15653:x1875738116624640:12345-192.168.203.33@tcp:101:dd.0 Request processed in 5366us (5608us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788843776.371743:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 43 00000100:00100000:1.0:1788843776.378522:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843776.378837:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116625024 00000100:00100000:0.0:1788843776.378847:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116625024 00000100:00100000:0.0:1788843776.378917:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 44 00000100:00100000:0.0:1788843776.378929:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+23:15653:x1875738116625024:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1788843776.378954:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843776.378979:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae800/0xa762dfcbd58d288c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490df7 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.379025:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae200/0xa762dfcbd58d2893 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.379043:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae200/0xa762dfcbd58d2893 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.379055:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae200/0xa762dfcbd58d2893 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.379225:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae800/0xa762dfcbd58d288c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490df7 expref: 25 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.379242:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae200/0xa762dfcbd58d2893 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490df7 expref: 24 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.379251:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd105fa2a00) 00010000:00010000:0.0:1788843776.379254:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788843776.379257:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10f7ae200, rc 0) 00000100:00100000:0.0:1788843776.379320:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+24:15653:x1875738116625024:12345-192.168.203.33@tcp:101:dd.0 Request processed in 394us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843776.379327:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 44 00000100:00100000:3.0:1788843776.383685:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843776.384264:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116625280 00000100:00100000:0.0:1788843776.384286:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116625280 00000100:00100000:0.0:1788843776.384353:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 45 00000100:00100000:0.0:1788843776.384365:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd127be0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+24:15653:x1875738116625280:12345-192.168.203.33@tcp:36:dd.0 00010000:00010000:0.0:1788843776.384844:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afe00/0xa762dfcbd58d289a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.384866:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afe00/0xa762dfcbd58d289a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.384879:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afe00/0xa762dfcbd58d289a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788843776.384923:0:17150:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1788843776.384949:0:17150:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000074d94571 reply state 000000000cefc830 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afe00/0xa762dfcbd58d289a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.384982:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afe00/0xa762dfcbd58d289a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.385000:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd105fa2a00) 00010000:00010000:0.0:1788843776.385003:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788843776.385007:0:17150:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788843776.385107:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd127be0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+27:15653:x1875738116625280:12345-192.168.203.33@tcp:36:dd.0 Request processed in 743us (1431us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1788843776.385115:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 45 00000020:00080000:0.0:1788843776.385120:0:17150:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788843776.389993:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843776.390094:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116625408 00000100:00100000:0.0:1788843776.390106:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116625408 00000100:00100000:0.0:1788843776.390203:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 46 00000100:00100000:0.0:1788843776.390217:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd127be1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+27:15653:x1875738116625408:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:0.0:1788843776.390244:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843776.390266:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae800/0xa762dfcbd58d28a1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490dfe expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.390333:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae800/0xa762dfcbd58d28a1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490dfe expref: 28 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.390349:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae800/0xa762dfcbd58d28a1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490dfe expref: 28 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.390371:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd105fa2a00) 00010000:00010000:0.0:1788843776.390374:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788843776.390378:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10f7ae800, rc 0) 00000100:00100000:0.0:1788843776.390802:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd127be1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+28:15653:x1875738116625408:12345-192.168.203.33@tcp:101:dd.0 Request processed in 588us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843776.390811:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 46 00000100:00100000:1.0:1788843776.414299:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843776.414402:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116625664 00000100:00100000:3.0:1788843776.414413:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116625664 00000100:00100000:3.0:1788843776.414487:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 2 00000100:00100000:3.0:1788843776.414499:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+28:15653:x1875738116625664:12345-192.168.203.33@tcp:103:dd.0 00010000:00010000:3.0:1788843776.414535:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843776.414562:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae800/0xa762dfcbd58d28a1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490dfe expref: 28 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843776.414584:0:17136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd105fa2a00) 00010000:00010000:3.0:1788843776.414590:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843776.414652:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+27:15653:x1875738116625664:12345-192.168.203.33@tcp:103:dd.0 Request processed in 155us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843776.414660:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 2 00000100:00100000:3.0:1788843776.418511:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843776.422232:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116625792 00000100:00100000:2.0:1788843776.422249:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116625792 00000100:00100000:2.0:1788843776.422322:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 47 00000100:00100000:2.0:1788843776.422334:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd127be1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+27:15653:x1875738116625792:12345-192.168.203.33@tcp:58:dd.0 00010000:00010000:2.0:1788843776.422475:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d28a8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.422498:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d28a8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.422511:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d28a8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788843776.423744:0:17149:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788843776.423965:0:17149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788843776.424113:0:17149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788843776.424250:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd127be1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+27:15653:x1875738116625792:12345-192.168.203.33@tcp:58:dd.0 Request processed in 1912us (5743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843776.424260:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 47 00000100:00100000:1.0:1788843776.427117:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843776.427393:0:19944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116625920 00000100:00100000:2.0:1788843776.427406:0:19944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116625920 00000100:00100000:2.0:1788843776.427519:0:19944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 48 00000100:00100000:2.0:1788843776.427532:0:19944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+27:15653:x1875738116625920:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:2.0:1788843776.427556:0:19944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843776.427581:0:19944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d28af lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490e05 expref: -99 pid: 19944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.427668:0:19944:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d28a8 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.427679:0:19944:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d28af lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e05 expref: 28 pid: 19944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.427700:0:19944:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d28a8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.427714:0:19944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d28af lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e05 expref: 28 pid: 19944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.427729:0:19944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd105fa2a00) 00010000:00010000:2.0:1788843776.427733:0:19944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788843776.427737:0:19944:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d28af lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e05 expref: 28 pid: 19944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.427745:0:19944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3d800, rc 0) 00000100:00100000:2.0:1788843776.427813:0:19944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+28:15653:x1875738116625920:12345-192.168.203.33@tcp:101:dd.0 Request processed in 284us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843776.427821:0:19944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 48 00000040:00080000:3.0:1788843776.795580:0:17185:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788843776.795591:0:17185:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788843776.795620:0:17185:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788843776.795630:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788843776.795777:0:17185:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd127be0a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17185:1875738134535552:192.168.203.33@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788843776.795888:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0017e4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788843776.807559:0:17185:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd127be0a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17185:1875738134535552:192.168.203.33@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788843776.809928:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843776.810176:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116626048 00000100:00100000:0.0:1788843776.810188:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116626048 00000100:00100000:0.0:1788843776.810259:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 49 00000100:00100000:0.0:1788843776.810272:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd127be0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+28:15654:x1875738116626048:12345-192.168.203.33@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788843776.810307:0:17150:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788843776.810440:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd127be0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+28:15654:x1875738116626048:12345-192.168.203.33@tcp:53:lhsmtool_posix.0 Request processed in 170us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843776.810448:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 49 00000100:00100000:1.0:1788843776.819835:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843776.822952:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116626176 00000100:00100000:0.0:1788843776.822970:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116626176 00000100:00100000:0.0:1788843776.823063:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 50 00000100:00100000:0.0:1788843776.823077:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+28:15654:x1875738116626176:12345-192.168.203.33@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788843776.823195:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aee00/0xa762dfcbd58d28b6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.823217:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aee00/0xa762dfcbd58d28b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.823229:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aee00/0xa762dfcbd58d28b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.823244:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aec00/0xa762dfcbd58d28bd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.823252:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aec00/0xa762dfcbd58d28bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.823279:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aec00/0xa762dfcbd58d28bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.823305:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af000/0xa762dfcbd58d28c4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.823315:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af000/0xa762dfcbd58d28c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.823322:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af000/0xa762dfcbd58d28c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843776.823368:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788843776.823372:0:17151:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788843776.823385:0:17151:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af000/0xa762dfcbd58d28c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.823459:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aee00/0xa762dfcbd58d28b6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.823466:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aee00/0xa762dfcbd58d28b6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.823474:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aee00/0xa762dfcbd58d28b6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.823480:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7aee00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843776.823484:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aee00/0xa762dfcbd58d28b6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.823491:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aee00/0xa762dfcbd58d28b6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.823511:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd1420eee00) 00010000:00010000:0.0:1788843776.823514:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843776.823520:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aee00/0xa762dfcbd58d28b6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.823526:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aee00/0xa762dfcbd58d28b6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.823539:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aec00/0xa762dfcbd58d28bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.823627:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aec00/0xa762dfcbd58d28bd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.823634:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aec00/0xa762dfcbd58d28bd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.823640:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7aec00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843776.823643:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aec00/0xa762dfcbd58d28bd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.823650:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aec00/0xa762dfcbd58d28bd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.823659:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9bd0071ded00) 00010000:00010000:0.0:1788843776.823662:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843776.823666:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aec00/0xa762dfcbd58d28bd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.823672:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aec00/0xa762dfcbd58d28bd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.823697:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af000/0xa762dfcbd58d28c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.823704:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af000/0xa762dfcbd58d28c4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.823710:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af000/0xa762dfcbd58d28c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.823715:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7af000 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843776.823718:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af000/0xa762dfcbd58d28c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.823723:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af000/0xa762dfcbd58d28c4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.823732:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd105fa2a00) 00010000:00010000:0.0:1788843776.823734:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843776.823737:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af000/0xa762dfcbd58d28c4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.823743:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af000/0xa762dfcbd58d28c4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843776.823833:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+28:15654:x1875738116626176:12345-192.168.203.33@tcp:34:lhsmtool_posix.0 Request processed in 758us (4005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843776.823842:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 50 00000100:00100000:3.0:1788843776.828471:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843776.828613:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116626432 00000100:00100000:0.0:1788843776.828624:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116626432 00000100:00100000:0.0:1788843776.828690:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 51 00000100:00100000:0.0:1788843776.828724:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd127be2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+28:15654:x1875738116626432:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788843776.828747:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843776.828772:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae800/0xa762dfcbd58d28cb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490e0c expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.828881:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af600/0xa762dfcbd58d28d2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.828900:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af600/0xa762dfcbd58d28d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.828912:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af600/0xa762dfcbd58d28d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843776.828924:0:17150:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788843776.829009:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af600/0xa762dfcbd58d28d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.829017:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af600/0xa762dfcbd58d28d2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.829024:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af600/0xa762dfcbd58d28d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.829031:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7af600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843776.829035:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af600/0xa762dfcbd58d28d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.829043:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af600/0xa762dfcbd58d28d2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.829056:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd105fa2a00) 00010000:00010000:0.0:1788843776.829066:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788843776.829072:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af600/0xa762dfcbd58d28d2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.829079:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af600/0xa762dfcbd58d28d2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.829119:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae800/0xa762dfcbd58d28cb lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e0c expref: 30 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.829130:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd1420eee00) 00010000:00010000:0.0:1788843776.829132:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788843776.829136:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae800/0xa762dfcbd58d28cb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e0c expref: 30 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.829176:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10f7ae800, rc 0) 00000100:00100000:0.0:1788843776.829247:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd127be2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+29:15654:x1875738116626432:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 526us (785us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1788843776.829254:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 51 00000100:00100000:3.0:1788843776.848218:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843776.849403:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116626560 00000100:00100000:0.0:1788843776.849418:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116626560 00000100:00100000:0.0:1788843776.849502:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 52 00000100:00100000:0.0:1788843776.849514:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd127be0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+29:15654:x1875738116626560:12345-192.168.203.33@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788843776.849551:0:17151:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788843776.849899:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd127be0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+29:15654:x1875738116626560:12345-192.168.203.33@tcp:53:lhsmtool_posix.0 Request processed in 386us (1690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843776.849909:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 52 00000100:00100000:3.0:1788843776.853261:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843776.853443:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116626816 00000100:00100000:2.0:1788843776.853455:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116626816 00000100:00100000:2.0:1788843776.853522:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 53 00000100:00100000:2.0:1788843776.853534:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd127be3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+29:15654:x1875738116626816:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788843776.853563:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843776.853598:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d28e0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490e13 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788843776.853966:0:17149:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =28 00000004:00080000:2.0:1788843776.853973:0:17149:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+28 in llog 00000004:00080000:2.0:1788843776.854004:0:17149:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:2.0:1788843776.854227:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d28e7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.854243:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d28e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.854256:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d28e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.854311:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d000/0xa762dfcbd58d28e0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e13 expref: 32 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.854329:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d28e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e13 expref: 31 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.854338:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd105fa2100) 00010000:00010000:2.0:1788843776.854341:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843776.854344:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10fa3dc00, rc 0) 00000100:00100000:2.0:1788843776.854411:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd127be3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+31:15654:x1875738116626816:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 880us (1170us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1788843776.854418:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 53 00000100:00100000:3.0:1788843776.860229:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843776.860774:0:19944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116627072 00000100:00100000:2.0:1788843776.860787:0:19944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116627072 00000100:00100000:2.0:1788843776.860852:0:19944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 54 00000100:00100000:2.0:1788843776.860879:0:19944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd127be3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+31:15654:x1875738116627072:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788843776.860945:0:19944:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843776.860976:0:19944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3dc00/0xa762dfcbd58d28e7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e13 expref: 31 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.861009:0:19944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd105fa2100) 00010000:00010000:2.0:1788843776.861021:0:19944:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788843776.861050:0:19944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030200/0xa762dfcbd58d28f5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.861067:0:19944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030200/0xa762dfcbd58d28f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.861077:0:19944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030200/0xa762dfcbd58d28f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.861093:0:19944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6400/0xa762dfcbd58d28fc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6940132f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.861099:0:19944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6400/0xa762dfcbd58d28fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6940132f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.861105:0:19944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6400/0xa762dfcbd58d28fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6940132f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.861186:0:19944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030200/0xa762dfcbd58d28f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.861193:0:19944:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030200/0xa762dfcbd58d28f5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.861208:0:19944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030200/0xa762dfcbd58d28f5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.861214:0:19944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd100030200 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843776.861219:0:19944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030200/0xa762dfcbd58d28f5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.861227:0:19944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030200/0xa762dfcbd58d28f5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.861237:0:19944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bd1420eed00) 00010000:00010000:2.0:1788843776.861240:0:19944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843776.861244:0:19944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030200/0xa762dfcbd58d28f5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.861250:0:19944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd100030200/0xa762dfcbd58d28f5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.861261:0:19944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6400/0xa762dfcbd58d28fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6940132f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.861266:0:19944:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6400/0xa762dfcbd58d28fc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6940132f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.861272:0:19944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6400/0xa762dfcbd58d28fc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6940132f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.861276:0:19944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e6400 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:2.0:1788843776.861279:0:19944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6400/0xa762dfcbd58d28fc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6940132f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.861293:0:19944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6400/0xa762dfcbd58d28fc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6940132f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.861301:0:19944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x6940132f (ffff9bd105fa2300) 00010000:00010000:2.0:1788843776.861303:0:19944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843776.861305:0:19944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6400/0xa762dfcbd58d28fc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6940132f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.861311:0:19944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6400/0xa762dfcbd58d28fc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6940132f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843776.861404:0:19944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd127be3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+30:15654:x1875738116627072:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 Request processed in 527us (1183us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788843776.861412:0:19944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 54 00000100:00100000:3.0:1788843776.865807:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843776.865979:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116627200 00000100:00100000:2.0:1788843776.866001:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116627200 00000100:00100000:2.0:1788843776.866056:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 55 00000100:00100000:2.0:1788843776.866067:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd127be1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+30:15654:x1875738116627200:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788843776.866089:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843776.866115:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7c00/0xa762dfcbd58d2903 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490e1a expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.866190:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6c00/0xa762dfcbd58d290a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.866207:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6c00/0xa762dfcbd58d290a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.866219:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6c00/0xa762dfcbd58d290a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.866345:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7c00/0xa762dfcbd58d2903 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e1a expref: 32 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.866364:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6c00/0xa762dfcbd58d290a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e1a expref: 31 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.866373:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd105fa2000) 00010000:00010000:2.0:1788843776.866376:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788843776.866380:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e6c00, rc 0) 00000100:00100000:2.0:1788843776.866441:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd127be1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+31:15654:x1875738116627200:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 376us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843776.866450:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 55 00000100:00100000:3.0:1788843776.873741:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843776.873884:0:19944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116627456 00000100:00100000:2.0:1788843776.873896:0:19944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116627456 00000100:00100000:2.0:1788843776.873965:0:19944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 56 00000100:00100000:2.0:1788843776.873976:0:19944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd127be0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+31:15654:x1875738116627456:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788843776.874077:0:19944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7c00/0xa762dfcbd58d2911 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.874097:0:19944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7c00/0xa762dfcbd58d2911 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.874110:0:19944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7c00/0xa762dfcbd58d2911 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788843776.874327:0:19944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1788843776.874336:0:19944:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 554927194677ns, next at 555927192221ns, rc = 0 00000004:00010000:2.0:1788843776.874402:0:19944:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ed84d31 reply state 000000007ee53b45 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7c00/0xa762dfcbd58d2911 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.874414:0:19944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7c00/0xa762dfcbd58d2911 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.874422:0:19944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd105fa2000) 00010000:00010000:2.0:1788843776.874425:0:19944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788843776.874429:0:19944:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788843776.874534:0:19944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd127be0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+33:15654:x1875738116627456:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 Request processed in 558us (803us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788843776.874552:0:19944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 56 00000100:00100000:3.0:1788843776.877339:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843776.877853:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116627584 00000100:00100000:2.0:1788843776.877866:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116627584 00000100:00100000:2.0:1788843776.877932:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 57 00000100:00100000:2.0:1788843776.877945:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd127be3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+33:15654:x1875738116627584:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788843776.877970:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843776.878005:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6400/0xa762dfcbd58d2918 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490e21 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.878068:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6400/0xa762dfcbd58d2918 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e21 expref: 34 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.878084:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6400/0xa762dfcbd58d2918 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e21 expref: 34 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.878105:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd105fa2000) 00010000:00010000:2.0:1788843776.878109:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788843776.878127:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e6400, rc 0) 00000100:00100000:2.0:1788843776.878482:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd127be3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+34:15654:x1875738116627584:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 538us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843776.878490:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 57 00000100:00100000:3.0:1788843776.890792:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843776.890918:0:19632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116627712 00000100:00100000:1.0:1788843776.890930:0:19632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116627712 00000100:00100000:1.0:1788843776.891021:0:19632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 20 00000100:00100000:1.0:1788843776.891033:0:19632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd127be1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:2389:x1875738116627712:12345-192.168.203.33@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788843776.891338:0:19632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd127be1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+6:2389:x1875738116627712:12345-192.168.203.33@tcp:2:lhsmtool_posix.0 Request processed in 306us (555us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788843776.891346:0:19632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 20 00000100:00080000:3.0:1788843776.892524:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843776.901527:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843776.901754:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116627968 00000100:00100000:0.0:1788843776.901783:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116627968 00000100:00100000:0.0:1788843776.901850:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 9 00000100:00100000:0.0:1788843776.901863:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd127be2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+34:15654:x1875738116627968:12345-192.168.203.33@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788843776.902101:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd127be2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+35:15654:x1875738116627968:12345-192.168.203.33@tcp:35:lhsmtool_posix.0 Request processed in 240us (584us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1788843776.902109:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 9 00000100:00100000:2.0:1788843776.904874:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843776.904992:0:19944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116628224 00000100:00100000:1.0:1788843776.905004:0:19944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116628224 00000100:00100000:1.0:1788843776.905074:0:19944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 58 00000100:00100000:1.0:1788843776.905086:0:19944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+35:15654:x1875738116628224:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788843776.905259:0:19944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+35:15654:x1875738116628224:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 Request processed in 175us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843776.905268:0:19944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 58 00000100:00100000:3.0:1788843776.909496:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843776.911822:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116628352 00000100:00100000:0.0:1788843776.911839:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116628352 00000100:00100000:0.0:1788843776.911922:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 59 00000100:00100000:0.0:1788843776.911934:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd127be0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+35:15654:x1875738116628352:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788843776.911955:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843776.911991:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae800/0xa762dfcbd58d291f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490e28 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.912067:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af600/0xa762dfcbd58d2926 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.912087:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af600/0xa762dfcbd58d2926 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.912099:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af600/0xa762dfcbd58d2926 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843776.912197:0:17150:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788843776.912219:0:17150:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af600/0xa762dfcbd58d2926 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.912245:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae800/0xa762dfcbd58d291f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e28 expref: 37 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.912284:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af600/0xa762dfcbd58d2926 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e28 expref: 36 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.912294:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd105fa2000) 00010000:00010000:0.0:1788843776.912297:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788843776.912301:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10f7af600, rc 0) 00000100:00100000:0.0:1788843776.912382:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd127be0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+36:15654:x1875738116628352:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 450us (2896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843776.912390:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 59 00000100:00100000:3.0:1788843776.919510:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843776.919600:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116628480 00000100:00100000:2.0:1788843776.919611:0:18655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116628480 00000100:00100000:2.0:1788843776.919680:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 21 00000100:00100000:2.0:1788843776.919691:0:18655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd127be3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+6:2390:x1875738116628480:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788843776.919710:0:18655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843776.919732:0:18655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e9ba058/0xa762dfcbd58d292d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490e2f expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788843776.919761:0:18655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f9700, blocks: 0x0 00010000:00010000:2.0:1788843776.919783:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=554s v=(0 0) 00010000:00010000:2.0:1788843776.919788:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843776.919799:0:18655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e9ba058/0xa762dfcbd58d292d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e2f expref: 7 pid: 18655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.919819:0:18655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002e9ba058/0xa762dfcbd58d292d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e2f expref: 7 pid: 18655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843776.919834:0:18655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd1153e6a00, rc 0) 00000100:00100000:2.0:1788843776.919889:0:18655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd127be3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+7:2390:x1875738116628480:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 200us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843776.919897:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 21 00000100:00100000:3.0:1788843776.936486:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843776.936912:0:19944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116628736 00000100:00100000:1.0:1788843776.936925:0:19944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116628736 00000100:00100000:1.0:1788843776.937004:0:19944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 60 00000100:00100000:1.0:1788843776.937018:0:19944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd127be2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+36:15654:x1875738116628736:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788843776.937186:0:19944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd127be2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+36:15654:x1875738116628736:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 Request processed in 171us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843776.937211:0:19944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 60 00000100:00100000:3.0:1788843776.940835:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843776.940945:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116628864 00000100:00100000:0.0:1788843776.940957:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116628864 00000100:00100000:0.0:1788843776.941037:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 61 00000100:00100000:0.0:1788843776.941048:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+36:15654:x1875738116628864:12345-192.168.203.33@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788843776.947185:0:17130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1788843776.947209:0:17130:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788843776.947259:0:17130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:0.0:1788843776.947425:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d27ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.947441:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d27ba lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.947449:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d27ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843776.947453:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1788843776.947457:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3ca00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843776.947465:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d27ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.947473:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d27ba lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843776.947481:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd14165df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134535680:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1788843776.947513:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bd1420eed00) 00010000:00010000:0.0:1788843776.947517:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788843776.947524:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d27ba lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.947531:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ca00/0xa762dfcbd58d27ba lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843776.947576:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843776.947640:0:19631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134535680 00000100:00100000:3.0:1788843776.947658:0:19631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134535680 00000100:00100000:0.0:1788843776.947693:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+19:15654:x1875738116628864:12345-192.168.203.33@tcp:44:lhsmtool_posix.0 Request processed in 6642us (6862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843776.947707:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 61 00000100:00100000:3.0:1788843776.947731:0:19631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788843776.947743:0:19631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1875738134535680:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788843776.947902:0:19631:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788843776.947906:0:19631:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788843776.947908:0:19631:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788843776.947910:0:19631:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788843776 -> 1788843776 00002000:00010000:3.0:1788843776.947913:0:19631:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788843776.947964:0:19631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3633:x1875738134535680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 223us (389us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788843776.947972:0:19631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1788843776.948012:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788843776.948042:0:3633:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd14165df80/2, rc 0, transno 8589934596 00000100:00100000:0.0:1788843776.948052:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd14165df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1875738134535680:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1788843776.948582:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71600/0xa762dfcbd58d2766 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.948594:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71600/0xa762dfcbd58d2766 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.948601:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71600/0xa762dfcbd58d2766 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.948607:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd118f71600 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843776.948611:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71600/0xa762dfcbd58d2766 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.948618:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71600/0xa762dfcbd58d2766 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.948633:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bd00744fa00) 00010000:00010000:1.0:1788843776.948636:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843776.948640:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71600/0xa762dfcbd58d2766 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.948646:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71600/0xa762dfcbd58d2766 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.948666:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d276d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.948673:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d276d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.948694:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d276d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.948699:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd007947c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843776.948702:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d276d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.948709:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d276d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.948719:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bd1420eed00) 00010000:00010000:1.0:1788843776.948721:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843776.948724:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d276d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.948730:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d276d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.948744:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d2815 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.948751:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d2815 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.948757:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d2815 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.948762:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3ce00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843776.948765:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d2815 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.948780:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d2815 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.948788:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bd105fa2600) 00010000:00010000:1.0:1788843776.948791:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843776.948794:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d2815 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.948800:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3ce00/0xa762dfcbd58d2815 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.948815:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afe00/0xa762dfcbd58d289a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.948822:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afe00/0xa762dfcbd58d289a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.948828:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afe00/0xa762dfcbd58d289a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.948833:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7afe00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843776.948835:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afe00/0xa762dfcbd58d289a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.948841:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afe00/0xa762dfcbd58d289a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.948848:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd105fa2a00) 00010000:00010000:1.0:1788843776.948850:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843776.948853:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afe00/0xa762dfcbd58d289a lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.948865:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7afe00/0xa762dfcbd58d289a lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.948876:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7c00/0xa762dfcbd58d2911 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.948882:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7c00/0xa762dfcbd58d2911 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.948888:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7c00/0xa762dfcbd58d2911 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.948893:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e7c00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:1.0:1788843776.948896:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7c00/0xa762dfcbd58d2911 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.948901:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7c00/0xa762dfcbd58d2911 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.948909:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd105fa2000) 00010000:00010000:1.0:1788843776.948911:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788843776.948914:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7c00/0xa762dfcbd58d2911 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.948920:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7c00/0xa762dfcbd58d2911 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843776.950534:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843776.954221:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116628992 00000100:00100000:0.0:1788843776.954239:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116628992 00000100:00100000:0.0:1788843776.954313:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 23 00000100:00100000:0.0:1788843776.954326:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+7:2390:x1875738116628992:12345-192.168.203.33@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788843776.954573:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+7:2390:x1875738116628992:12345-192.168.203.33@tcp:16:lhsmtool_posix.0 Request processed in 129us (3926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843776.954584:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 23 00000100:00100000:3.0:1788843776.963287:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843776.963404:0:19944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116629248 00000100:00100000:1.0:1788843776.963417:0:19944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116629248 00000100:00100000:1.0:1788843776.963490:0:19944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 62 00000100:00100000:1.0:1788843776.963502:0:19944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+15:15654:x1875738116629248:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788843776.963574:0:19944:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843776.963606:0:19944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7af600/0xa762dfcbd58d2926 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e28 expref: 15 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.963626:0:19944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd105fa2000) 00010000:00010000:1.0:1788843776.963632:0:19944:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788843776.963674:0:19944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d2934 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.963690:0:19944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d2934 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.963702:0:19944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d2934 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788843776.963829:0:19944:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000fcffaad reply state 00000000f1f92060 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d2934 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.963841:0:19944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd007947c00/0xa762dfcbd58d2934 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843776.963847:0:19944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd105fa2000) 00010000:00010000:1.0:1788843776.963850:0:19944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788843776.963852:0:19944:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788843776.963954:0:19944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+16:15654:x1875738116629248:12345-192.168.203.33@tcp:36:lhsmtool_posix.0 Request processed in 454us (677us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1788843776.963961:0:19944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 62 00000100:00100000:1.0:1788843776.973478:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843776.975203:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116629376 00000100:00100000:0.0:1788843776.975218:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116629376 00000100:00100000:0.0:1788843776.975295:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 24 00000100:00100000:0.0:1788843776.975307:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd12cdd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+7:15654:x1875738116629376:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788843776.975327:0:18654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843776.975348:0:18654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007d8a2fd/0xa762dfcbd58d293b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490e36 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.975416:0:18654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002e9ba058/0xa762dfcbd58d292d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e2f expref: 8 pid: 18655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.975426:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788843776.975431:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843776.975436:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007d8a2fd/0xa762dfcbd58d293b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e36 expref: 8 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.975488:0:18654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002e9ba058/0xa762dfcbd58d292d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e2f expref: 8 pid: 18655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.975504:0:18654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002e9ba058/0xa762dfcbd58d292d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e2f expref: 8 pid: 18655 timeout: 655 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843776.975519:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18654:1875738134535808:192.168.203.33@tcp:104: 00000100:00100000:0.0:1788843776.975621:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd110decd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788843776.982904:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18654:1875738134535808:192.168.203.33@tcp:104: 00010000:00010000:0.0:1788843776.982945:0:18654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000007d8a2fd/0xa762dfcbd58d293b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e36 expref: 8 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843776.982997:0:18654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd10f7ae800, rc 0) 00000100:00100000:0.0:1788843776.983060:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd12cdd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+8:15654:x1875738116629376:12345-192.168.203.33@tcp:101:lhsmtool_posix.0 Request processed in 7754us (9591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843776.983094:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 24 00000100:00100000:1.0:1788843776.986484:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843776.986570:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116629504 00000100:00100000:3.0:1788843776.986582:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116629504 00010000:00010000:3.0:1788843776.986625:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002e9ba058/0xa762dfcbd58d292d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e2f expref: 8 pid: 18655 timeout: 655 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843776.986699:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 19 00000100:00100000:3.0:1788843776.986709:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd007769f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+8:2390:x1875738116629504:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843776.986725:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843776.986747:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002e9ba058/0xa762dfcbd58d292d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e2f expref: 8 pid: 18655 timeout: 655 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843776.986762:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002e9ba058/0xa762dfcbd58d292d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e2f expref: 8 pid: 18655 timeout: 655 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843776.986789:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e9ba058/0xa762dfcbd58d292d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e2f expref: 8 pid: 18655 timeout: 655 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843776.986807:0:17137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843776.986812:0:17137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843776.986819:0:17137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000007d8a2fd/0xa762dfcbd58d293b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e36 expref: 7 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843776.986831:0:17137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007d8a2fd/0xa762dfcbd58d293b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e36 expref: 7 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843776.986871:0:17137:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000007d8a2fd/0xa762dfcbd58d293b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e36 expref: 7 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843776.986898:0:17137:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd14165f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:17137:1875738134535936:192.168.203.33@tcp:105: 00000100:00100000:3.0:1788843776.987025:0:17137:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0017e4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788843776.996352:0:17137:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd14165f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:17137:1875738134535936:192.168.203.33@tcp:105: 00010000:00010000:3.0:1788843776.996381:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843776.996427:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843776.996445:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd007769f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+7:2390:x1875738116629504:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 9737us (9971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843776.996457:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 19 00000100:00100000:0.0:1788843776.997278:0:19632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116629632 00000100:00100000:0.0:1788843776.997287:0:19632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116629632 00000100:00100000:0.0:1788843776.997341:0:19632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 25 00000100:00100000:0.0:1788843776.997352:0:19632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00776bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+7:2390:x1875738116629632:12345-192.168.203.33@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788843776.997507:0:19632:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788843776.997510:0:19632:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788843775 00002000:00010000:0.0:1788843776.997513:0:19632:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788843774 00002000:00010000:0.0:1788843776.997515:0:19632:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788843776 -> 1788843775 00002000:00010000:0.0:1788843776.997517:0:19632:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788843776.997560:0:19632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00776bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+8:2390:x1875738116629632:12345-192.168.203.33@tcp:2:lhsmtool_posix.0 Request processed in 211us (1134us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788843776.997567:0:19632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 25 00000100:00100000:2.0:1788843777.002809:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843777.002874:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116629760 00000100:00100000:0.0:1788843777.002886:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116629760 00000100:00100000:0.0:1788843777.003006:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 26 00000100:00100000:0.0:1788843777.003017:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+8:2389:x1875738116629760:12345-192.168.203.33@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788843777.003065:0:18656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e9414993/0xa762dfcbd58d2942 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.003097:0:18656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000007d8a2fd/0xa762dfcbd58d293b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e36 expref: 8 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.003107:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843777.003111:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788843777.003129:0:18656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9414993/0xa762dfcbd58d2942 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.003210:0:18656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000007d8a2fd/0xa762dfcbd58d293b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e36 expref: 8 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.003226:0:18656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000007d8a2fd/0xa762dfcbd58d293b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e36 expref: 8 pid: 18654 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843777.003243:0:18656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:18656:1875738134536064:192.168.203.33@tcp:104: 00000100:00100000:0.0:1788843777.003326:0:18656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd110decd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788843777.006929:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843777.007014:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116629888 00000100:00100000:3.0:1788843777.007025:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116629888 00010000:00010000:3.0:1788843777.007078:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000007d8a2fd/0xa762dfcbd58d293b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e36 expref: 9 pid: 18654 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843777.007125:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 20 00000100:00100000:3.0:1788843777.007137:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f987b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+9:2390:x1875738116629888:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843777.007174:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843777.007198:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000007d8a2fd/0xa762dfcbd58d293b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e36 expref: 9 pid: 18654 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843777.007214:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000007d8a2fd/0xa762dfcbd58d293b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e36 expref: 9 pid: 18654 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843777.007244:0:17135:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788843777.007249:0:17135:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788843777.007272:0:17135:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9414993/0xa762dfcbd58d2942 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843777.007282:0:17135:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9414993/0xa762dfcbd58d2942 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843777.007305:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788843777.007311:0:18656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007d8a2fd/0xa762dfcbd58d293b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e36 expref: 9 pid: 18654 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843777.007327:0:18656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:18656:1875738134536064:192.168.203.33@tcp:104: 00010000:00010000:2.0:1788843777.007351:0:18656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e9414993/0xa762dfcbd58d2942 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843777.007352:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f987b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+8:2390:x1875738116629888:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 218us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843777.007360:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 20 00010000:00010000:2.0:1788843777.007362:0:18656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e9414993/0xa762dfcbd58d2942 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843777.007368:0:18656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9414993/0xa762dfcbd58d2942 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843777.007388:0:18656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e9414993/0xa762dfcbd58d2942 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843777.007397:0:18656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9414993/0xa762dfcbd58d2942 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843777.007405:0:18656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9414993/0xa762dfcbd58d2942 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843777.007412:0:18656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7af000 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:2.0:1788843777.007423:0:18656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9414993/0xa762dfcbd58d2942 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843777.007434:0:18656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9414993/0xa762dfcbd58d2942 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843777.007447:0:18656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9414993/0xa762dfcbd58d2942 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843777.007455:0:18656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9414993/0xa762dfcbd58d2942 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843777.007500:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+7:2389:x1875738116629760:12345-192.168.203.33@tcp:1:lhsmtool_posix.0 Request processed in 4486us (4702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843777.007508:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 26 00000100:00100000:1.0:1788843777.015356:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843777.015442:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116630144 00000100:00100000:2.0:1788843777.015465:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116630144 00000100:00100000:2.0:1788843777.015530:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 63 00000100:00100000:2.0:1788843777.015541:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+16:15654:x1875738116630144:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788843777.015629:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7800/0xa762dfcbd58d2949 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843777.015658:0:17149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae200/0xa762dfcbd58d2893 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490df7 expref: 16 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843777.015668:0:17149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7800/0xa762dfcbd58d2949 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843777.015723:0:17149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae200/0xa762dfcbd58d2893 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490df7 expref: 16 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843777.015738:0:17149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae200/0xa762dfcbd58d2893 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490df7 expref: 16 pid: 17151 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843777.015754:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079b8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17149:1875738134536192:192.168.203.33@tcp:104: 00000100:00100000:2.0:1788843777.015843:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd111590e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788843777.020786:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079b8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17149:1875738134536192:192.168.203.33@tcp:104: 00010000:00010000:0.0:1788843777.020820:0:17149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7800/0xa762dfcbd58d2949 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843777.021951:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843777.022348:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116630272 00000100:00100000:3.0:1788843777.022360:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116630272 00010000:00010000:3.0:1788843777.022402:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae200/0xa762dfcbd58d2893 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490df7 expref: 17 pid: 17151 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843777.022448:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 21 00000100:00100000:3.0:1788843777.022469:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f987100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+17:2390:x1875738116630272:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843777.022485:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843777.022492:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae200/0xa762dfcbd58d2893 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490df7 expref: 17 pid: 17151 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843777.022505:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae200/0xa762dfcbd58d2893 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490df7 expref: 17 pid: 17151 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843777.022527:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7ae200/0xa762dfcbd58d2893 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490df7 expref: 17 pid: 17151 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843777.022545:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd105fa2a00) 00010000:00010000:3.0:1788843777.022567:0:17137:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d28af lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e05 expref: 16 pid: 19944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843777.022578:0:17137:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7800/0xa762dfcbd58d2949 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843777.022586:0:17137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7800/0xa762dfcbd58d2949 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843777.022594:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7800/0xa762dfcbd58d2949 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843777.022626:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788843777.022899:0:17149:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7800/0xa762dfcbd58d2949 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843777.022909:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7800/0xa762dfcbd58d2949 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843777.023176:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6e00/0xa762dfcbd58d2950 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843777.023190:0:17149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6400/0xa762dfcbd58d2918 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e21 expref: 17 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843777.023199:0:17149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6e00/0xa762dfcbd58d2950 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843777.023233:0:17149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6400/0xa762dfcbd58d2918 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e21 expref: 17 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843777.023248:0:17149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6400/0xa762dfcbd58d2918 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e21 expref: 17 pid: 17149 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843777.023274:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17149:1875738134536320:192.168.203.33@tcp:104: 00000100:00100000:2.0:1788843777.023360:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1115909c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843777.024078:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f987100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+17:2390:x1875738116630272:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 1599us (2121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843777.024090:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 21 00000100:00100000:2.0:1788843777.028025:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17149:1875738134536320:192.168.203.33@tcp:104: 00010000:00010000:2.0:1788843777.028062:0:17149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6e00/0xa762dfcbd58d2950 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843777.028922:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843777.030430:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116630400 00000100:00100000:0.0:1788843777.030445:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116630400 00010000:00010000:0.0:1788843777.030507:0:17136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6400/0xa762dfcbd58d2918 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e21 expref: 17 pid: 17149 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843777.030556:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 22 00000100:00100000:0.0:1788843777.030577:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f987800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+17:2389:x1875738116630400:12345-192.168.203.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843777.030595:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843777.030603:0:17136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6400/0xa762dfcbd58d2918 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e21 expref: 17 pid: 17149 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.030637:0:17136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6400/0xa762dfcbd58d2918 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e21 expref: 17 pid: 17149 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.030672:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6400/0xa762dfcbd58d2918 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e21 expref: 17 pid: 17149 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.030690:0:17136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd105fa2000) 00010000:00010000:0.0:1788843777.030695:0:17136:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6e00/0xa762dfcbd58d2950 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.030706:0:17136:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6e00/0xa762dfcbd58d2950 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.030714:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6e00/0xa762dfcbd58d2950 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.030754:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843777.030836:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f987800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+16:2389:x1875738116630400:12345-192.168.203.33@tcp:103:ldlm_bl.0 Request processed in 270us (1916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843777.030843:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 22 00010000:00010000:2.0:1788843777.031070:0:17149:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6e00/0xa762dfcbd58d2950 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843777.031081:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6e00/0xa762dfcbd58d2950 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788843777.031237:0:17149:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1788843777.031333:0:17149:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1788843777.031360:0:17149:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1788843777.031427:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17149:1875738134536448:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788843777.031484:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843777.031521:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1028d7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788843777.031620:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134536448 00000100:00100000:1.0:1788843777.031626:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134536448 00000100:00100000:1.0:1788843777.031679:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788843777.031688:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17149:x1875738134536448:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788843777.031777:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17149:x1875738134536448:12345-0@lo:1000:mdt00_000.0 Request processed in 90us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843777.031784:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788843777.031946:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17149:1875738134536448:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788843777.032119:0:17149:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1788843777.032190:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17149:1875738134536576:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788843777.032220:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843777.032239:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd1115906c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843777.032686:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134536576 00000100:00100000:2.0:1788843777.032693:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134536576 00000100:00100000:2.0:1788843777.032726:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788843777.032734:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17149:x1875738134536576:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788843777.032877:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17149:x1875738134536576:12345-0@lo:1000:mdt00_000.0 Request processed in 139us (651us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788843777.032885:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788843777.033866:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17149:1875738134536576:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788843777.033917:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6e00/0xa762dfcbd58d2950 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.033942:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6e00/0xa762dfcbd58d2950 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.033949:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6e00/0xa762dfcbd58d2950 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.033955:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e6e00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843777.033960:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6e00/0xa762dfcbd58d2950 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.033968:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6e00/0xa762dfcbd58d2950 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.033997:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd105fa2000) 00010000:00010000:0.0:1788843777.034001:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788843777.034006:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6e00/0xa762dfcbd58d2950 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.034012:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e6e00/0xa762dfcbd58d2950 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.034048:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d28a8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.034055:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d28a8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.034060:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d28a8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.034064:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10fa3c800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843777.034073:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d28a8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.034080:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d28a8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.034088:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd105fa2a00) 00010000:00010000:0.0:1788843777.034090:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788843777.034097:0:17149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d28af lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e05 expref: 19 pid: 19944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.034110:0:17149:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d28af lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e05 expref: 19 pid: 19944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.034120:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d28af lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e05 expref: 19 pid: 19944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.034197:0:17149:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3d800/0xa762dfcbd58d28af lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e05 expref: 19 pid: 19944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843777.034211:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd00723e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17149:1875738134536704:192.168.203.33@tcp:105: 00000100:00100000:0.0:1788843777.034295:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd111590e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788843777.040313:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843777.040362:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd00723e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17149:1875738134536704:192.168.203.33@tcp:105: 00010000:00010000:0.0:1788843777.040397:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d28a8 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.040408:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10fa3c800/0xa762dfcbd58d28a8 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843777.040452:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116630528 00000100:00100000:3.0:1788843777.040461:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116630528 00010000:00010000:0.0:1788843777.040482:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aec00/0xa762dfcbd58d2957 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.040498:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aec00/0xa762dfcbd58d2957 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.040512:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aec00/0xa762dfcbd58d2957 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.040522:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aec00/0xa762dfcbd58d2957 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843777.040524:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 10 00010000:00010000:0.0:1788843777.040534:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aec00/0xa762dfcbd58d2957 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843777.040541:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd137be8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+20:15653:x1875738116630528:12345-192.168.203.33@tcp:49:dd.0 00010000:00010000:0.0:1788843777.040543:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aec00/0xa762dfcbd58d2957 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.040552:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7aec00 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843777.040556:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aec00/0xa762dfcbd58d2957 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.040573:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aec00/0xa762dfcbd58d2957 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.040586:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd105fa2a00) 00010000:00010000:0.0:1788843777.040589:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843777.040593:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aec00/0xa762dfcbd58d2957 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.040599:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd10f7aec00/0xa762dfcbd58d2957 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.040619:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7800/0xa762dfcbd58d2949 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.040625:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7800/0xa762dfcbd58d2949 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.040632:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7800/0xa762dfcbd58d2949 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.040638:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e7800 already unused, calling callback (ffffffffc18b74f0) 00010000:00010000:0.0:1788843777.040641:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7800/0xa762dfcbd58d2949 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.040659:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7800/0xa762dfcbd58d2949 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.040668:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd105fa2a00) 00010000:00010000:0.0:1788843777.040670:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788843777.040673:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7800/0xa762dfcbd58d2949 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.040679:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7800/0xa762dfcbd58d2949 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843777.040817:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+20:15654:x1875738116630144:12345-192.168.203.33@tcp:57:lhsmtool_posix.0 Request processed in 25277us (25469us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1788843777.040827:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 63 00000020:00080000:0.0:1788843777.040833:0:17149:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788843777.040884:0:17185:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788843777.040889:0:17185:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788843777.040905:0:17185:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788843777.040913:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788843777.041120:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd137be8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+19:15653:x1875738116630528:12345-192.168.203.33@tcp:49:dd.0 Request processed in 581us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843777.041128:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 10 00000100:00100000:3.0:1788843777.043895:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843777.044319:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116630784 00000100:00100000:2.0:1788843777.044342:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116630784 00000100:00100000:2.0:1788843777.044399:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 11 00000100:00100000:2.0:1788843777.044409:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+19:15654:x1875738116630784:12345-192.168.203.33@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788843777.045012:0:17153:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788843777.045045:0:17153:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00000100:00100000:1.0:1788843777.047117:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00010000:00010000:2.0:1788843777.047213:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7400/0xa762dfcbd58d295e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843777.047236:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7400/0xa762dfcbd58d295e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843777.047248:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7400/0xa762dfcbd58d295e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843777.047258:0:17153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7400/0xa762dfcbd58d295e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843777.047265:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7400/0xa762dfcbd58d295e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843777.047270:0:17153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7400/0xa762dfcbd58d295e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843777.047293:0:17153:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788843777.047388:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+21:15654:x1875738116630784:12345-192.168.203.33@tcp:35:lhsmtool_posix.0 Request processed in 2980us (3502us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788843777.047397:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 11 00000020:00080000:2.0:1788843777.047404:0:17153:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788843777.049864:0:19636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843777.049878:0:19636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7400/0xa762dfcbd58d295e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843777.049890:0:19636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd1153e7400 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843777.049895:0:19636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7400/0xa762dfcbd58d295e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843777.049906:0:19636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7400/0xa762dfcbd58d295e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843777.049928:0:19636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd105fa2000) 00010000:00010000:1.0:1788843777.049947:0:19636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788843777.049953:0:19636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7400/0xa762dfcbd58d295e lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843777.049959:0:19636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd1153e7400/0xa762dfcbd58d295e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843777.049989:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843777.049992:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843777.049994:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843777.050755:0:19944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116630912 00000100:00100000:3.0:1788843777.050769:0:19944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116630912 00000100:00100000:3.0:1788843777.050846:0:19944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 64 00000100:00100000:3.0:1788843777.050857:0:19944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+21:15653:x1875738116630912:12345-192.168.203.33@tcp:101:dd.0 00010000:00010000:3.0:1788843777.050888:0:19944:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843777.050909:0:19944:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71a00/0xa762dfcbd58d2965 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xaf24d95f22490e3d expref: -99 pid: 19944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843777.050944:0:19944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71000/0xa762dfcbd58d296c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843777.050961:0:19944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71000/0xa762dfcbd58d296c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843777.050972:0:19944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71000/0xa762dfcbd58d296c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19944 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843777.051106:0:19944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71a00/0xa762dfcbd58d2965 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e3d expref: 23 pid: 19944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843777.051125:0:19944:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd118f71000/0xa762dfcbd58d296c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.33@tcp remote: 0xaf24d95f22490e3d expref: 22 pid: 19944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843777.051134:0:19944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd105fa2a00) 00010000:00010000:3.0:1788843777.051137:0:19944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788843777.051543:0:19944:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd118f71000, rc 0) 00000100:00100000:3.0:1788843777.051612:0:19944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+22:15653:x1875738116630912:12345-192.168.203.33@tcp:101:dd.0 Request processed in 756us (4503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843777.051620:0:19944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 64 00000100:00100000:1.0:1788843777.343528:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:0.0:1788843777.343669:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116631040 00000100:00100000:0.0:1788843777.343680:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116631040 00000100:00100000:0.0:1788843777.343771:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 0 00000100:00100000:0.0:1788843777.343780:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f986d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+7:2389:x1875738116631040:12345-192.168.203.33@tcp:4:dd.0 00002000:00010000:0.0:1788843777.343839:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a9f96ff, atime: 0x6a9f96fe, ctime: 0x6a9f96ff, blocks: 0x0 00010000:00010000:0.0:1788843777.343850:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a092430/0xa762dfcbd58d2973 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.343867:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=555s v=(0 0) 00010000:00010000:0.0:1788843777.343871:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843777.343877:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a092430/0xa762dfcbd58d2973 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843777.343894:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a092430/0xa762dfcbd58d2973 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843777.348248:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:1.0:1788843777.348400:0:18662:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788843777.348411:0:18662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1788843777.348743:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116631168 00000100:00100000:1.0:1788843777.348756:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116631168 00000100:00100000:3.0:1788843777.350350:0:20291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 1 00000100:00100000:3.0:1788843777.350372:0:20291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+8:2389:x1875738116631168:12345-192.168.203.33@tcp:4:dd.0 00010000:00010000:3.0:1788843777.350418:0:20291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f43cff97/0xa762dfcbd58d297a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843777.350447:0:20291:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843777.350453:0:20291:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843777.350460:0:20291:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f43cff97/0xa762dfcbd58d297a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843777.350476:0:20291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f43cff97/0xa762dfcbd58d297a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843777.382086:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788843777.497459:0:18651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:0.0:1788843777.497491:0:18651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:1.0:1788843777.502890:0:18660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1788843777.502905:0:18660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1788843775 -> 1788843776 00002000:00010000:1.0:1788843777.502908:0:18660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788843775 -> 1788843776 00002000:00010000:1.0:1788843777.502911:0:18660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:1.0:1788843777.502935:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a092430/0xa762dfcbd58d2973 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843777.502952:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a092430/0xa762dfcbd58d2973 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843777.502963:0:18660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a092430/0xa762dfcbd58d2973 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843777.502971:0:18660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd10f7aec00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:1.0:1788843777.503076:0:18660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a092430/0xa762dfcbd58d2973 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843777.503110:0:18660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a092430/0xa762dfcbd58d2973 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843777.503134:0:18660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a092430/0xa762dfcbd58d2973 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843777.503178:0:18660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a092430/0xa762dfcbd58d2973 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843777.503310:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f986d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+7:2389:x1875738116631040:12345-192.168.203.33@tcp:4:dd.0 Request processed in 159525us (159790us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788843777.503323:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 0 00000001:00080000:0.0:1788843777.533714:0:18651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:3.0:1788843777.533966:0:20291:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:3.0:1788843777.533971:0:20291:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:3.0:1788843777.534001:0:20291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f43cff97/0xa762dfcbd58d297a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843777.534015:0:20291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f43cff97/0xa762dfcbd58d297a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843777.534025:0:20291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f43cff97/0xa762dfcbd58d297a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843777.534032:0:20291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd118f71a00 already unused, calling callback (ffffffffc0cb1420) 00010000:00010000:3.0:1788843777.534037:0:20291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f43cff97/0xa762dfcbd58d297a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843777.534047:0:20291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f43cff97/0xa762dfcbd58d297a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843777.534099:0:20291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f43cff97/0xa762dfcbd58d297a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843777.534108:0:20291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f43cff97/0xa762dfcbd58d297a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843777.534285:0:20291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:2389:x1875738116631168:12345-192.168.203.33@tcp:4:dd.0 Request processed in 183915us (186041us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788843777.534298:0:20291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 1 00010000:00010000:1.0:1788843778.394271:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843778.462235:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134536832:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788843778.462316:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843778.462386:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134536832 00000100:00100000:1.0:1788843778.462396:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134536832 00000100:00100000:1.0:1788843778.462464:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788843778.462481:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134536832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788843778.462505:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923513344 avail 3684286464 00000100:00100000:1.0:1788843778.462559:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134536832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843778.462566:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788843778.462594:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843778.462676:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134536832:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788843778.465320:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134536960:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788843778.465400:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843778.465536:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134536960 00000100:00100000:2.0:1788843778.465551:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134536960 00000100:00100000:2.0:1788843778.465602:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788843778.465612:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134536960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788843778.465646:0:17890:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788843778.465698:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134536960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843778.465706:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788843778.465751:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134536960:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788843778.973907:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788843778.973939:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd14165f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134537088:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788843778.974047:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843778.974174:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134537088 00000100:00100000:3.0:1788843778.974183:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134537088 00000100:00100000:3.0:1788843778.974242:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788843778.974252:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0079b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134537088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788843778.974291:0:17154:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788843778.974358:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0079b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134537088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843778.974366:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788843778.974418:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd14165f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134537088:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1788843779.132753:0:20329:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1788843779.418350:0:19636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843779.994975:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20b96c6c-8494-483a-b913-89dfc06b1440:3632:1875738134537216:0@lo:400:kworker.0 00000100:00100000:3.0:1788843779.995054:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843779.995093:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ac9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134537728:0@lo:400:kworker.0 00000100:00100000:3.0:1788843779.995119:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843779.995135:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134538240:0@lo:400:kworker.0 00000100:00100000:3.0:1788843779.995188:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843779.995202:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1875738134538752:0@lo:400:kworker.0 00000100:00100000:3.0:1788843779.995218:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843779.995241:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788843779.995246:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134537344:0@lo:400:kworker.0 00000100:00100000:3.0:1788843779.995268:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843779.995286:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134537856:0@lo:400:kworker.0 00000100:00100000:3.0:1788843779.995305:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843779.995318:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134538368:0@lo:400:kworker.0 00000100:00100000:3.0:1788843779.995336:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843779.995359:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134537472:0@lo:400:kworker.0 00000100:00100000:3.0:1788843779.995383:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843779.995401:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134537984:0@lo:400:kworker.0 00000100:00100000:3.0:1788843779.995421:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843779.995559:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134538496:0@lo:400:kworker.0 00000100:00100000:3.0:1788843779.995583:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843779.995595:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788843779.995600:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0079bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134537600:0@lo:400:kworker.0 00000100:00100000:3.0:1788843779.995620:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843779.995645:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd007ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134538112:0@lo:400:kworker.0 00000100:00100000:3.0:1788843779.995665:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843779.995681:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1875738134538624:0@lo:400:kworker.0 00000100:00100000:3.0:1788843779.995701:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843779.995726:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134537216 00000100:00100000:0.0:1788843779.995734:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134537728 00000100:00100000:3.0:1788843779.995740:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134537216 00000100:00100000:0.0:1788843779.995740:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134537728 00000100:00100000:0.0:1788843779.995776:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134538240 00000100:00100000:0.0:1788843779.995779:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134538240 00000100:00100000:3.0:1788843779.995784:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788843779.995789:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134538752 00000100:00100000:0.0:1788843779.995791:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134538752 00000100:00100000:3.0:1788843779.995793:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+24:3632:x1875738134537216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843779.995812:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134538368 00000100:00100000:0.0:1788843779.995814:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134538368 00000100:00100000:0.0:1788843779.995824:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134538496 00000100:00100000:0.0:1788843779.995826:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134538496 00000100:00100000:0.0:1788843779.995835:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134538624 00000100:00100000:3.0:1788843779.995844:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20b96c6c-8494-483a-b913-89dfc06b1440+24:3632:x1875738134537216:12345-0@lo:400:kworker.0 Request processed in 51us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843779.995851:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788843779.995855:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134538624 00000100:00100000:0.0:1788843779.995872:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788843779.995878:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134537728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843779.995884:0:19944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788843779.995889:0:19944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134538240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843779.995914:0:19944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1875738134538240:12345-0@lo:400:kworker.0 Request processed in 24us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843779.995914:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1875738134537728:12345-0@lo:400:kworker.0 Request processed in 36us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843779.995920:0:19944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788843780.000771:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788843780.000824:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134539136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788843780.000970:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843780.001012:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788843780.001019:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134539008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788843780.001039:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843780.001078:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788843780.001092:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1875738134538752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843780.001155:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1875738134538752:12345-0@lo:400:kworker.0 Request processed in 55us (5921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843780.001162:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788843780.001176:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788843780.001183:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134538368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843780.001209:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1875738134538368:12345-0@lo:400:kworker.0 Request processed in 27us (5872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843780.001214:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788843780.001224:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788843780.001229:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134538496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843780.001251:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875738134538496:12345-0@lo:400:kworker.0 Request processed in 23us (5668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843780.001270:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788843780.001281:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788843780.001286:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875738134538624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843780.001310:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875738134538624:12345-0@lo:400:kworker.0 Request processed in 24us (5609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843780.001315:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788843780.001332:0:19632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134537472 00000100:00100000:0.0:1788843780.001340:0:19632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134537472 00000100:00100000:0.0:1788843780.001372:0:19632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134537984 00000100:00100000:0.0:1788843780.001375:0:19632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134537984 00000100:00100000:0.0:1788843780.001383:0:19632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134537600 00000100:00100000:0.0:1788843780.001385:0:19632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134537600 00000100:00100000:0.0:1788843780.001394:0:19632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134538112 00000100:00100000:0.0:1788843780.001396:0:19632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134538112 00000100:00100000:0.0:1788843780.001406:0:19632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788843780.001411:0:19632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134537472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843780.001438:0:19632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134537472:12345-0@lo:400:kworker.0 Request processed in 27us (6055us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843780.001443:0:19632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788843780.001453:0:19632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788843780.001458:0:19632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134537984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843780.001484:0:19632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134537984:12345-0@lo:400:kworker.0 Request processed in 25us (6062us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843780.001490:0:19632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788843780.001501:0:19632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788843780.001506:0:19632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134537600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843780.001542:0:19632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3630:x1875738134537600:12345-0@lo:400:kworker.0 Request processed in 37us (5922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843780.001548:0:19632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788843780.001558:0:19632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788843780.001563:0:19632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134538112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843780.001582:0:19632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3630:x1875738134538112:12345-0@lo:400:kworker.0 Request processed in 20us (5916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843780.001587:0:19632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1788843780.004720:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788843780.004735:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788843780.004739:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788843780.004742:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788843780.004769:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134539136 00000100:00100000:0.0:1788843780.004781:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134539136 00000100:00100000:0.0:1788843780.004901:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134539008 00000100:00100000:0.0:1788843780.004906:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134539008 00000100:00100000:0.0:1788843780.004926:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788843780.004936:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134539136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788843780.004974:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788843780.005057:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134539136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (4096us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843780.005064:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788843780.005081:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788843780.005087:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134539008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788843780.005104:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1788843780.005133:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1875738134539008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (4092us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843780.005168:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788843780.005219:0:3631:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000100:00100000:3.0:1788843780.005223:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134537344 00000004:00080000:0.0:1788843780.005224:0:3631:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd14165df80, transno 8589934596 00000100:00100000:3.0:1788843780.005227:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134537344 00000004:00080000:0.0:1788843780.005236:0:3631:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:3.0:1788843780.005251:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134537856 00000100:00100000:3.0:1788843780.005255:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134537856 00000100:00100000:3.0:1788843780.005267:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788843780.005268:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134539008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843780.005272:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134537344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843780.005285:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1875738134539136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843780.005310:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1875738134537344:12345-0@lo:400:kworker.0 Request processed in 38us (10041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843780.005315:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd141b9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134538880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788843780.005316:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788843780.005329:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788843780.005334:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134537856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843780.005350:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843780.005357:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1875738134537856:12345-0@lo:400:kworker.0 Request processed in 24us (10052us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843780.005363:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788843780.005380:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738134538880 00000100:00100000:0.0:1788843780.005383:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738134538880 00000100:00100000:0.0:1788843780.005402:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788843780.005407:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd00723e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134538880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788843780.005417:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788843780.005445:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd00723e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1875738134538880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843780.006560:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd141b9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1875738134538880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788843780.006611:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134537600:0@lo:400:kworker.0 00000100:00100000:1.0:1788843780.006623:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134538112:0@lo:400:kworker.0 00000100:00100000:1.0:1788843780.006758:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1875738134538624:0@lo:400:kworker.0 00000100:00100000:1.0:1788843780.006771:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1875738134537472:0@lo:400:kworker.0 00000100:00100000:1.0:1788843780.006783:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1875738134537984:0@lo:400:kworker.0 00010000:00080000:1.0:1788843780.006797:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f8d0a80 x1875738134538496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843780.006807:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1875738134538496:0@lo:400:kworker.0 00000100:00100000:1.0:1788843780.007160:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1875738134537344:0@lo:400:kworker.0 00000100:00100000:1.0:1788843780.007173:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1875738134537856:0@lo:400:kworker.0 00000100:00100000:1.0:1788843780.007185:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1875738134538368:0@lo:400:kworker.0 00000100:00100000:1.0:1788843780.007195:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0079b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20b96c6c-8494-483a-b913-89dfc06b1440:3632:1875738134537216:0@lo:400:kworker.0 00000100:00100000:1.0:1788843780.007205:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ac9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1875738134537728:0@lo:400:kworker.0 00000100:00100000:1.0:1788843780.007216:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd007ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1875738134538240:0@lo:400:kworker.0 00010000:00080000:1.0:1788843780.007227:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9bd10f8d0380 x1875738134538752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843780.007236:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd10f8d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1875738134538752:0@lo:400:kworker.0 00000100:00100000:3.0:1788843780.011576:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843780.011625:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:2.0:1788843780.011794:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116631296 00000100:00100000:2.0:1788843780.011807:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116631296 00000100:00100000:2.0:1788843780.011859:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 170 00000100:00100000:2.0:1788843780.011870:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0059e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f839db8-0699-423e-a998-0395c59fee9e+13:2388:x1875738116631296:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:2.0:1788843780.011947:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0059e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f839db8-0699-423e-a998-0395c59fee9e+13:2388:x1875738116631296:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 78us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843780.011955:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 170 00000100:00100000:3.0:1788843780.012386:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843780.012407:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843780.012427:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843780.012457:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843780.012476:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843780.012493:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843780.012513:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.33@tcp (source: 12345-192.168.203.33@tcp) 00000100:00100000:3.0:1788843780.012534:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116631424 00000100:00100000:3.0:1788843780.012539:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116631424 00000100:00100000:3.0:1788843780.012577:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116631552 00000100:00100000:3.0:1788843780.012580:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116631552 00000100:00100000:3.0:1788843780.012590:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116631936 00000100:00100000:3.0:1788843780.012592:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116631936 00000100:00100000:3.0:1788843780.012602:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116632064 00000100:00100000:3.0:1788843780.012605:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116632064 00000100:00100000:3.0:1788843780.012618:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 73 00000100:00100000:3.0:1788843780.012635:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+22:2387:x1875738116631424:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:0.0:1788843780.012738:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788843780.012768:0:19632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116631680 00000100:00100000:0.0:1788843780.012772:0:19632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116631680 00000100:00100000:0.0:1788843780.012800:0:19632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116631808 00000100:00100000:0.0:1788843780.012804:0:19632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116631808 00000100:00100000:0.0:1788843780.012816:0:19632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116632192 00000100:00100000:0.0:1788843780.012818:0:19632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116632192 00000100:00100000:0.0:1788843780.012830:0:19632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875738116632320 00000100:00100000:0.0:1788843780.012832:0:19632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875738116632320 00000100:00100000:3.0:1788843780.013108:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+22:2387:x1875738116631424:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 482us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843780.013116:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 73 00000100:00100000:3.0:1788843780.013132:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 74 00000100:00100000:3.0:1788843780.013153:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:2388:x1875738116631552:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843780.013181:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:2388:x1875738116631552:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 44us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843780.013188:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 74 00000100:00100000:3.0:1788843780.013200:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 75 00000100:00100000:3.0:1788843780.013208:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5af0cf-62ad-40c0-947c-f942bbf55123+6:2387:x1875738116631936:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843780.013244:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5af0cf-62ad-40c0-947c-f942bbf55123+6:2387:x1875738116631936:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 37us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843780.013251:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 75 00000100:00100000:3.0:1788843780.013263:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 76 00000100:00100000:3.0:1788843780.013270:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5af0cf-62ad-40c0-947c-f942bbf55123+5:2388:x1875738116632064:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843780.013294:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5af0cf-62ad-40c0-947c-f942bbf55123+5:2388:x1875738116632064:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 25us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843780.013300:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 76 00000100:00100000:3.0:1788843780.013321:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 23 00000100:00100000:3.0:1788843780.013328:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd14165ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:2387:x1875738116631680:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843780.013355:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd14165ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:2387:x1875738116631680:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 28us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843780.013361:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 23 00000100:00100000:3.0:1788843780.013373:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 24 00000100:00100000:3.0:1788843780.013380:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd102fbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:2388:x1875738116631808:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843780.013402:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd102fbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6921b2ba-4cb8-4cf7-a5c0-1c37d97b5fd0+5:2388:x1875738116631808:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 23us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843780.013408:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 24 00000100:00100000:3.0:1788843780.013419:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 25 00000100:00100000:3.0:1788843780.013425:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd10f8aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd5af0cf-62ad-40c0-947c-f942bbf55123+5:2387:x1875738116632192:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843780.013578:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd10f8aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd5af0cf-62ad-40c0-947c-f942bbf55123+5:2387:x1875738116632192:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 152us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843780.013585:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 25 00000100:00100000:3.0:1788843780.013604:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.33@tcp, seq: 26 00000100:00100000:3.0:1788843780.013611:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd141b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd5af0cf-62ad-40c0-947c-f942bbf55123+5:2388:x1875738116632320:12345-192.168.203.33@tcp:400:kworker.0 00000100:00100000:3.0:1788843780.013738:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd141b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cd5af0cf-62ad-40c0-947c-f942bbf55123+5:2388:x1875738116632320:12345-192.168.203.33@tcp:400:kworker.0 Request processed in 126us (1223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843780.013744:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.33@tcp, seq: 26 00000100:00080000:0.0:1788843780.013972:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788843780.013978:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788843780.013981:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788843780.013990:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788843780.122353:0:17185:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788843780.122362:0:17185:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788843780.122413:0:17185:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788843780.122423:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788843780.442530:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 43370 lines, 43370 kept, 0 dropped, 0 bad.